Jul 05 19:32:35.076077 ip-10-0-134-29 systemd[1]: Starting Kubernetes Kubelet...
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.436446    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440665    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440677    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440680    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440684    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440687    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440689    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440693    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:35.642861 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440696    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:35.504719 ip-10-0-134-29 systemd[1]: Started Kubernetes Kubelet.
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440698    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440701    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440703    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440706    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440709    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440711    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440714    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440716    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440720    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440723    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440725    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440728    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440731    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440733    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440736    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440739    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440741    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440745    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:35.654405 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440747    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440750    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440753    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440756    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440759    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440761    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440764    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440766    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440769    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440771    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440774    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440777    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440781    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440785    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440788    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440791    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440794    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440811    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440814    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:35.655250 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440818    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440821    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440824    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440827    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440831    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440834    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440836    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440839    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440841    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440845    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440848    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440851    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440854    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440856    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440859    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440862    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440865    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440867    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440870    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440872    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:35.656960 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440875    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440877    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440880    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440883    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440885    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440888    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440897    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440899    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440902    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440905    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440908    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440911    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440914    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440916    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440919    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440922    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440924    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440926    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440929    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440931    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:35.658654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440934    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440936    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440938    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440941    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440944    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440946    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440949    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440951    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440954    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440958    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440960    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440963    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440965    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.440968    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441766    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441778    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441781    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441786    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441790    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:35.659464 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441794    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441810    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441813    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441816    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441818    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441821    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441824    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441826    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441829    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441832    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441834    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441837    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441840    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441842    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441845    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441849    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441853    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441857    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441860    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441863    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:35.660296 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441866    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441869    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441871    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441875    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441878    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441880    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441883    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441886    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441889    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441893    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441895    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441898    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441900    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441902    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441905    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441908    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441910    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441913    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441915    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441918    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:35.661112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441920    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441923    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441925    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441928    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441930    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441933    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441935    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441937    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441940    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441942    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441945    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441947    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441950    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441952    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441955    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441958    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441962    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441965    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441967    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441970    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:35.661912 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441973    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441976    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441978    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441982    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441985    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441988    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441991    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441993    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441996    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.441998    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442001    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442003    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442005    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442008    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442011    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442013    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442016    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442018    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442021    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:35.662718 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442023    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442026    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442028    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442031    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442033    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442036    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442038    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442040    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442043    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442045    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442049    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442052    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442054    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442057    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442059    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442398    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442403    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442406    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442409    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442411    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:35.663522 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442414    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442416    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442419    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442421    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442425    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442429    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442432    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442435    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442439    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442442    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442445    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442448    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442451    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442454    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442457    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442460    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442463    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442465    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442468    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:35.664312 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442471    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442473    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442475    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442478    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442481    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442483    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442485    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442488    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442491    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442493    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442496    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442500    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442503    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442505    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442508    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442511    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442513    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442515    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442518    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442521    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:35.665129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442523    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442526    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442530    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442534    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442538    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442540    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442543    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442545    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442548    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442551    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442553    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442556    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442558    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442561    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442564    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442566    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442568    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442571    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442574    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442576    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:35.665888 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442579    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442582    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442585    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442589    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442591    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442594    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442596    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442599    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442601    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442604    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442606    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442608    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442611    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442615    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442619    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442622    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442626    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442629    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442632    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:35.666659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442635    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442637    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442640    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442642    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442645    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442647    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442650    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442652    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442655    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442657    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442659    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442662    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442664    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442667    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442670    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.442672    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442744    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442755    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442762    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442767    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442770    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442773    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 05 19:32:35.667462 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442777    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442781    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442784    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442787    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442790    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442794    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442810    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442814    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442817    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442820    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442822    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442825    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442830    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442832    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442835    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442838    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442842    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442845    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442848    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442851    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442854    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442857    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442860    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442863    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 05 19:32:35.668261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442866    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442869    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442874    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442878    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442880    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442883    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442886    2579 flags.go:64] FLAG: --enable-server="true"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442889    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442893    2579 flags.go:64] FLAG: --event-burst="100"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442896    2579 flags.go:64] FLAG: --event-qps="50"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442899    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442902    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442905    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442908    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442911    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442915    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442918    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442921    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442923    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442926    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442929    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442932    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442934    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442937    2579 flags.go:64] FLAG: --feature-gates=""
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442941    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 05 19:32:35.669096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442944    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442947    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442950    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442952    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442955    2579 flags.go:64] FLAG: --help="false"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442958    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-134-29.ec2.internal"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442961    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442964    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442967    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442971    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442976    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442978    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442981    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442984    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442987    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442990    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442993    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442996    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.442998    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443001    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443004    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443007    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443011    2579 flags.go:64] FLAG: --lock-file=""
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443014    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 05 19:32:35.669899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443017    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443020    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443024    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443027    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443030    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443033    2579 flags.go:64] FLAG: --logging-format="text"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443035    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443039    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443041    2579 flags.go:64] FLAG: --manifest-url=""
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443044    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443048    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443051    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443054    2579 flags.go:64] FLAG: --max-pods="110"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443057    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443060    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443063    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443066    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443069    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443073    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443076    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443083    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443086    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443089    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 05 19:32:35.670692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443091    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443094    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443099    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443102    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443105    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443107    2579 flags.go:64] FLAG: --port="10250"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443110    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443113    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079a7624c353c616b"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443117    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443120    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443123    2579 flags.go:64] FLAG: --register-node="true"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443125    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443129    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443132    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443135    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443137    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443141    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443144    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443146    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443150    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443152    2579 flags.go:64] FLAG: --runonce="false"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443155    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443158    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443161    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443164    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 05 19:32:35.676697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443166    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443170    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443173    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443190    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443194    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443198    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443201    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443204    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443207    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443210    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443212    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443218    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443220    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443223    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443227    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443231    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443234    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443237    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443240    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443242    2579 flags.go:64] FLAG: --v="2"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443246    2579 flags.go:64] FLAG: --version="false"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443250    2579 flags.go:64] FLAG: --vmodule=""
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443253    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.443256    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 05 19:32:35.677491 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443389    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443393    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443397    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443400    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443403    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443405    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443408    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443410    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443413    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443417    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443420    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443422    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443425    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443428    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443430    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443433    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443435    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443438    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443440    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443443    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:35.784112 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443445    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443448    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443450    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443454    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443456    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443460    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443464    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443467    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443470    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443472    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443476    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443479    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443481    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443484    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443487    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443489    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443492    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443494    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443497    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:35.784906 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443499    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443502    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443506    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443508    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443511    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443513    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443516    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443524    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443527    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443529    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443532    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443534    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443536    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443539    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443541    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443544    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443548    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443550    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443553    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443556    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:35.785694 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443560    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443564    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443568    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443572    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443575    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443580    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443583    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443588    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443591    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443595    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443599    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443602    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443604    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443607    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443611    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443614    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443616    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443619    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443622    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443626    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:35.786494 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443635    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443638    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443641    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443643    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443646    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443650    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443653    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443656    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443660    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443663    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443665    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443668    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443670    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443673    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443675    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443678    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443680    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443683    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443685    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:35.787274 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.443687    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.444250    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.451687    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.451701    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.452341    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.452348    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452403    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452408    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452412    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452415    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452419    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452422    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452424    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452428    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452431    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:35.788094 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452434    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452437    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452439    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452442    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452444    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452447    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452450    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452453    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452459    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452462    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452464    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452467    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452471    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452475    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452478    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452481    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452484    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452486    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452489    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:35.788897 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452492    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452495    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452497    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452500    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452502    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452505    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452507    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452511    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452515    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452518    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452521    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452523    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452527    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452529    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452532    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452534    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452536    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452539    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452542    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:35.789687 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452545    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452548    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452551    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452554    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452564    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452567    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452570    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452573    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452576    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452578    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452581    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452583    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452586    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452589    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452593    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452597    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452600    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452602    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452606    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:35.790476 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452608    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452611    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452614    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452616    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452619    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452621    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452624    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452627    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452630    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452632    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452635    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452637    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452640    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452642    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452645    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452648    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452651    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452653    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452657    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452660    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:35.791273 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452662    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452665    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452667    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452670    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452673    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452675    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452678    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452680    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452683    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452685    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452688    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452691    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452693    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.452698    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452819    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:35.792081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452824    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452827    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452830    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452833    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452836    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452840    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452842    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452845    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452847    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452850    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452852    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452855    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452857    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452861    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452864    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452868    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452871    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452873    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452876    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452878    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:35.792894 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452881    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452883    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452886    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452888    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452891    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452894    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452896    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452899    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452901    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452904    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452906    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452909    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452911    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452913    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452916    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452918    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452921    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452923    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452926    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452929    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:35.793676 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452931    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452934    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452936    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452938    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452941    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452945    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452947    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452951    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452954    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452956    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452959    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452962    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452964    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452966    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452969    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452971    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452974    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452976    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452980    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:35.794481 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452983    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452986    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452989    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452992    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452995    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.452997    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453000    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453002    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453005    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453007    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453010    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453012    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453015    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453019    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453021    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453024    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453026    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453029    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453033    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:35.795281 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453035    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453039    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453042    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453044    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453047    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453050    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453052    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453055    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453058    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453062    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453065    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453068    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453071    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453073    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453076    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453078    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453081    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453084    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453086    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:35.796093 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:35.453088    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.453094    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.453182    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.455191    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.456438    2579 server.go:1019] "Starting client certificate rotation"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.456536    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.456583    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.461013    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.462325    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.472320    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.474582    2579 log.go:25] "Validated CRI v1 image API"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.475426    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 05 19:32:35.796889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.477469    2579 fs.go:135] Filesystem UUIDs: map[4e28a2f1-c702-4b2c-96fd-115e20bae79d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 85ade2db-60f4-40b9-919f-9bc37ff210d6:/dev/nvme0n1p3]
Jul 05 19:32:35.797281 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.477494    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.482176    2579 manager.go:216] Machine: {Timestamp:2026-07-05 19:32:35.481697758 +0000 UTC m=+0.304188430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099063 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27cce39c37e35a2eb4a296dbf3e45a SystemUUID:ec27cce3-9c37-e35a-2eb4-a296dbf3e45a BootID:fb77e9b1-20d1-42bd-b1ae-76079ee54159 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:68:7e:c7:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:68:7e:c7:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:08:2d:af:04:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.482269    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.482332    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.485177    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.485203    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-29.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.486391    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.486404    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 05 19:32:35.797666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.486412    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.487023    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.487380    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.488494    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492483    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492602    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492637    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492650    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492663    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492674    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.492682    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.493116    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.493138    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.495747    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.498085    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.498122    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499293    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499307    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499312    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499317    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499325    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499330    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499338    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499343    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499350    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499355    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499363    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.499370    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.500748    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.500759    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.503257    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-29.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.503308    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.503414    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.503941    2579 server.go:1268] "Started kubelet"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.504007    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.504000    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.504071    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.505763    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.506363    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 05 19:32:35.798075 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.506574    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8jcm"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.509587    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.510554    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-29.ec2.internal.18bf7babdae2aa89  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-29.ec2.internal,UID:ip-10-0-134-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-29.ec2.internal,},FirstTimestamp:2026-07-05 19:32:35.503917705 +0000 UTC m=+0.326408377,LastTimestamp:2026-07-05 19:32:35.503917705 +0000 UTC m=+0.326408377,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-29.ec2.internal,}"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.513407    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.513421    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.513493    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.514043    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.514055    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.514095    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.514262    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.514269    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.515262    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8jcm"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516230    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516242    2579 factory.go:55] Registering systemd factory
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516250    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516548    2579 factory.go:153] Registering CRI-O factory
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516571    2579 factory.go:223] Registration of the crio container factory successfully
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516602    2579 factory.go:103] Registering Raw factory
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.516616    2579 manager.go:1196] Started watching for new ooms in manager
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.517094    2579 manager.go:349] Starting recovery of all containers
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.517420    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.517507    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.526044    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.527848    2579 manager.go:354] Recovery completed
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.533042    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.534828    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.534856    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.534870    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.535338    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.535346    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.535349    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.535365    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.536013    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:35.802873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.536038    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.536051    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.537373    2579 policy_none.go:49] "None policy: Start"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.537385    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.537395    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.539381    2579 policy_none.go:47] "Start"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575440    2579 manager.go:337] "Starting Device Plugin manager"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.575463    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575472    2579 server.go:87] "Starting device plugin registration server"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575651    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575660    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575823    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575901    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.575910    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.576239    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.576284    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.611396    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.611431    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.611449    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:35.611481    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 05 19:32:35.804076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.613406    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.826268    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.826269    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"]
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.826431    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.827118    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.827140    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.827149    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:35.910370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:35.827177    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.042321    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.042352    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.042368    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.043149    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.043165    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-29.ec2.internal\": node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.044599    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.044704    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.044745    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.045361    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.045385    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.045396    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.045362    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.045461    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:36.130395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.045472    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:36.143997 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.142745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.143997 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.142777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.143997 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.142814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/301d2e284fa3bf2b30f75ef544be44ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-29.ec2.internal\" (UID: \"301d2e284fa3bf2b30f75ef544be44ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.169237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.169265    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.170010    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.170034    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.170878    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.185233    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.204234    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-29.ec2.internal\" not found" node="ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.222893 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.210950    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-29.ec2.internal\" not found" node="ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.243652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/301d2e284fa3bf2b30f75ef544be44ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-29.ec2.internal\" (UID: \"301d2e284fa3bf2b30f75ef544be44ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.243671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.243691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.243719    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.243737    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/301d2e284fa3bf2b30f75ef544be44ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-29.ec2.internal\" (UID: \"301d2e284fa3bf2b30f75ef544be44ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.243754    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.304722 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.285745    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.414180 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.386155    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.414180 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.405449    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:36.519588 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.474098    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 05 19:32:36.519588 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.474218    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 19:32:36.519588 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.474221    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 19:32:36.519588 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.487225    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.739652 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.662322    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.739652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.690103    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 19:27:35 +0000 UTC" deadline="2028-04-02 17:22:30.167482474 +0000 UTC"
Jul 05 19:32:36.739652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.690129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.739652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.690131    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15285h49m53.477354243s"
Jul 05 19:32:36.739652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.690147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:36.739652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.699460    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:36.854304 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.763030    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.867573 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:36.863320    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 05 19:32:36.963085 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:36.934989    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:37.065954 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.013746    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:37.065954 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.024257    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 19:32:37.065954 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.025042    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 05 19:32:37.065954 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.032962    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 19:32:37.370302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.370286    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:37.514825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.514789    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 05 19:32:37.528480 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.528462    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 19:32:37.548939 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.548918    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xtrgh"
Jul 05 19:32:37.557076 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.557061    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xtrgh"
Jul 05 19:32:37.690400 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.690381    2579 apiserver.go:52] "Watching apiserver"
Jul 05 19:32:37.696126 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:37.696007    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e27d054810d078240eb360988177e7.slice/crio-3514f5877887561e7c7886386372ed4e9cf6c732c4111587dd285f071d667ace WatchSource:0}: Error finding container 3514f5877887561e7c7886386372ed4e9cf6c732c4111587dd285f071d667ace: Status 404 returned error can't find the container with id 3514f5877887561e7c7886386372ed4e9cf6c732c4111587dd285f071d667ace
Jul 05 19:32:37.700756 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.700703    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 05 19:32:37.701166 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.701142    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28","openshift-cluster-node-tuning-operator/tuned-m2pq5","openshift-dns/node-resolver-dpbpw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal","openshift-multus/multus-additional-cni-plugins-ckqjg","openshift-multus/multus-fqs67","kube-system/konnectivity-agent-27jnz","openshift-image-registry/node-ca-5bnxd","openshift-multus/network-metrics-daemon-r749c","openshift-network-diagnostics/network-check-target-m7gm9","openshift-network-operator/iptables-alerter-zr92t","openshift-ovn-kubernetes/ovnkube-node-t5kj9","kube-system/global-pull-secret-syncer-kjtpp"]
Jul 05 19:32:37.701368 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.701353    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 19:32:37.704775 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.704759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.706889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.706869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:37.706998 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.706937    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:37.708360 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.708100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9twd2\""
Jul 05 19:32:37.708360 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.708142    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 05 19:32:37.708360 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.708244    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.708360 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.708333    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.708588 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.708426    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 05 19:32:37.709521 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.709503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.711726 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.711710    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.712224 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.712195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.712300 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.712228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-22ppp\""
Jul 05 19:32:37.712300 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.712269    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.713964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.713946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.714057 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.714004    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:37.714356 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.714339    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.714433 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.714345    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bkj5s\""
Jul 05 19:32:37.714616 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.714597    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.716918 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.716899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.719256 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.719233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:37.719337 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.719296    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 05 19:32:37.719564 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.719538    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tww8g\""
Jul 05 19:32:37.719737 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.719723    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 05 19:32:37.721438 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.721423    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.721758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.721739    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 05 19:32:37.721913 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.721794    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.722031 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.722017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mxdf7\""
Jul 05 19:32:37.722104 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.722046    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.724041 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.724022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.725714 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.725692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.725835 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.725820    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wd4gh\""
Jul 05 19:32:37.726083 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.726066    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 05 19:32:37.726477 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.726456    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.726982 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.726965    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 05 19:32:37.727324 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.727304    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 05 19:32:37.727409 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.727337    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 05 19:32:37.727465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.727440    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.727698 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.727680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vlrs5\""
Jul 05 19:32:37.727762 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.727743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:37.727876 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.727835    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:37.728028 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.728011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 05 19:32:37.728284 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.728266    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.730296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.730277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:37.732573 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.732551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:37.732975 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.732955    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wqq9\""
Jul 05 19:32:37.732975 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.732967    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 05 19:32:37.733143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.733046    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 05 19:32:37.735326 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.735309    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 05 19:32:37.735499 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.735486    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lsn9x\""
Jul 05 19:32:37.735651 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.735635    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 05 19:32:37.735714 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.735698    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 05 19:32:37.795437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed6ee0c6-6fd1-4229-a772-be0061011a8b-cni-binary-copy\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-etc-kubernetes\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795452    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-socket-dir-parent\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-kubelet\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-multus-certs\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59kcr\" (UniqueName: \"kubernetes.io/projected/ed6ee0c6-6fd1-4229-a772-be0061011a8b-kube-api-access-59kcr\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1228d4d9-116c-4242-9526-235474e51bc6-tmp\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-system-cni-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-cnibin\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-os-release\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-hostroot\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysconfig\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysctl-conf\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-host\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.795827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-k8s-cni-cncf-io\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-modprobe-d\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysctl-d\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97bae834-6b1d-43b6-ac09-ccffa217d9af-kubelet-config\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97bae834-6b1d-43b6-ac09-ccffa217d9af-dbus\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-os-release\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-cni-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-cni-bin\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.795989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-daemon-config\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-sys\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-var-lib-kubelet\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d929\" (UniqueName: \"kubernetes.io/projected/1228d4d9-116c-4242-9526-235474e51bc6-kube-api-access-5d929\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b228f734-4eb4-4d85-8da0-a8457c88c0e8-hosts-file\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-kubernetes\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1228d4d9-116c-4242-9526-235474e51bc6-etc-tuned\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b228f734-4eb4-4d85-8da0-a8457c88c0e8-tmp-dir\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngmx\" (UniqueName: \"kubernetes.io/projected/b228f734-4eb4-4d85-8da0-a8457c88c0e8-kube-api-access-tngmx\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vncf\" (UniqueName: \"kubernetes.io/projected/1ed620df-38be-4e21-9cce-e6b2f75a09d5-kube-api-access-4vncf\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-run\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-lib-modules\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-netns\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-cni-multus\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-conf-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-systemd\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.796584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-system-cni-dir\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.796978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cnibin\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.796978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.796372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.814939 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.814919    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 05 19:32:37.896698 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-systemd\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.896825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-system-cni-dir\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.896825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cnibin\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.896825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-registration-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.896825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.896825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rd5\" (UniqueName: \"kubernetes.io/projected/c317b1c2-a657-4090-a84f-eda551f5e8c7-kube-api-access-55rd5\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896822    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-system-cni-dir\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896856    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-systemd\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ee1d8a-91ff-4153-960a-fb1e554e2220-host-slash\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896830    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cnibin\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-systemd-units\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-env-overrides\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59kcr\" (UniqueName: \"kubernetes.io/projected/ed6ee0c6-6fd1-4229-a772-be0061011a8b-kube-api-access-59kcr\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.896991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-host\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.897059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-device-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-system-cni-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-cnibin\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysconfig\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysctl-conf\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-host\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897173    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-cnibin\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97bae834-6b1d-43b6-ac09-ccffa217d9af-kubelet-config\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysconfig\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897205    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-system-cni-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-k8s-cni-cncf-io\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97bae834-6b1d-43b6-ac09-ccffa217d9af-kubelet-config\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-host\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897254    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-k8s-cni-cncf-io\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97bae834-6b1d-43b6-ac09-ccffa217d9af-dbus\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.897498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n86n5\" (UniqueName: \"kubernetes.io/projected/d9ee1d8a-91ff-4153-960a-fb1e554e2220-kube-api-access-n86n5\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-systemd\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897298    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysctl-conf\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-var-lib-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-ovn\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-log-socket\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-cni-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897426    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97bae834-6b1d-43b6-ac09-ccffa217d9af-dbus\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-daemon-config\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897440    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d929\" (UniqueName: \"kubernetes.io/projected/1228d4d9-116c-4242-9526-235474e51bc6-kube-api-access-5d929\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897469    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-cni-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-kubelet\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1228d4d9-116c-4242-9526-235474e51bc6-etc-tuned\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b228f734-4eb4-4d85-8da0-a8457c88c0e8-tmp-dir\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vncf\" (UniqueName: \"kubernetes.io/projected/1ed620df-38be-4e21-9cce-e6b2f75a09d5-kube-api-access-4vncf\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqhw\" (UniqueName: \"kubernetes.io/projected/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-kube-api-access-qrqhw\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a982052a-2fc3-41f9-9f98-9dcd36feb199-konnectivity-ca\") pod \"konnectivity-agent-27jnz\" (UID: \"a982052a-2fc3-41f9-9f98-9dcd36feb199\") " pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897714    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-run\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8mwr\" (UniqueName: \"kubernetes.io/projected/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-kube-api-access-s8mwr\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-socket-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897864    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-run\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.897895    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9gx\" (UniqueName: \"kubernetes.io/projected/38fb09ee-3e0a-4954-9437-7907264abb03-kube-api-access-hw9gx\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.897971    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:32:38.397950147 +0000 UTC m=+3.220440821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:37.898696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.897968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b228f734-4eb4-4d85-8da0-a8457c88c0e8-tmp-dir\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898014    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-daemon-config\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ee1d8a-91ff-4153-960a-fb1e554e2220-iptables-alerter-script\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovnkube-config\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-netns\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-cni-multus\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898114    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-netns\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-conf-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898160    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-cni-multus\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovnkube-script-lib\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898177    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-conf-dir\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed6ee0c6-6fd1-4229-a772-be0061011a8b-cni-binary-copy\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-etc-kubernetes\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-serviceca\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-slash\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a982052a-2fc3-41f9-9f98-9dcd36feb199-agent-certs\") pod \"konnectivity-agent-27jnz\" (UID: \"a982052a-2fc3-41f9-9f98-9dcd36feb199\") " pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898287    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-etc-kubernetes\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898304    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-socket-dir-parent\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-kubelet\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898406    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-multus-socket-dir-parent\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-multus-certs\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898448    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-run-multus-certs\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898460    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-kubelet\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1228d4d9-116c-4242-9526-235474e51bc6-tmp\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-sys-fs\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.899826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-os-release\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-hostroot\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-os-release\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898667    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed6ee0c6-6fd1-4229-a772-be0061011a8b-cni-binary-copy\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898673    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-os-release\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898681    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-hostroot\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-etc-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-modprobe-d\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysctl-d\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-cni-bin\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-sys\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-var-lib-kubelet\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898865    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-modprobe-d\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b228f734-4eb4-4d85-8da0-a8457c88c0e8-hosts-file\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-cni-netd\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898915    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed6ee0c6-6fd1-4229-a772-be0061011a8b-host-var-lib-cni-bin\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-kubernetes\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngmx\" (UniqueName: \"kubernetes.io/projected/b228f734-4eb4-4d85-8da0-a8457c88c0e8-kube-api-access-tngmx\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898991    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b228f734-4eb4-4d85-8da0-a8457c88c0e8-hosts-file\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899000    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-sysctl-d\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.898996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-run-netns\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-node-log\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.900642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-lib-modules\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-cni-bin\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899223    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-var-lib-kubelet\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899317    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-etc-kubernetes\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899329    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-sys\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899334    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1228d4d9-116c-4242-9526-235474e51bc6-lib-modules\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ed620df-38be-4e21-9cce-e6b2f75a09d5-os-release\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.899423    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ed620df-38be-4e21-9cce-e6b2f75a09d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.900883    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1228d4d9-116c-4242-9526-235474e51bc6-etc-tuned\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.901036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.900923    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1228d4d9-116c-4242-9526-235474e51bc6-tmp\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.905136 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.905116    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59kcr\" (UniqueName: \"kubernetes.io/projected/ed6ee0c6-6fd1-4229-a772-be0061011a8b-kube-api-access-59kcr\") pod \"multus-fqs67\" (UID: \"ed6ee0c6-6fd1-4229-a772-be0061011a8b\") " pod="openshift-multus/multus-fqs67"
Jul 05 19:32:37.907756 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.907736    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d929\" (UniqueName: \"kubernetes.io/projected/1228d4d9-116c-4242-9526-235474e51bc6-kube-api-access-5d929\") pod \"tuned-m2pq5\" (UID: \"1228d4d9-116c-4242-9526-235474e51bc6\") " pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:37.911467 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.911449    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:37.911540 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.911483    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:37.911540 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.911496    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:37.911540 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.911503    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vncf\" (UniqueName: \"kubernetes.io/projected/1ed620df-38be-4e21-9cce-e6b2f75a09d5-kube-api-access-4vncf\") pod \"multus-additional-cni-plugins-ckqjg\" (UID: \"1ed620df-38be-4e21-9cce-e6b2f75a09d5\") " pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:37.911647 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:37.911553    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:38.41153932 +0000 UTC m=+3.234029995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:37.912256 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.912241    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngmx\" (UniqueName: \"kubernetes.io/projected/b228f734-4eb4-4d85-8da0-a8457c88c0e8-kube-api-access-tngmx\") pod \"node-resolver-dpbpw\" (UID: \"b228f734-4eb4-4d85-8da0-a8457c88c0e8\") " pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:37.999886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.999840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-device-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:37.999886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.999873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n86n5\" (UniqueName: \"kubernetes.io/projected/d9ee1d8a-91ff-4153-960a-fb1e554e2220-kube-api-access-n86n5\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.000012 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.999896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-systemd\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000012 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.999957    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-device-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.000012 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:37.999997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-var-lib-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000034    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-systemd\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000041    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-var-lib-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-ovn\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000076    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-log-socket\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-kubelet\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqhw\" (UniqueName: \"kubernetes.io/projected/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-kube-api-access-qrqhw\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-run-ovn\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a982052a-2fc3-41f9-9f98-9dcd36feb199-konnectivity-ca\") pod \"konnectivity-agent-27jnz\" (UID: \"a982052a-2fc3-41f9-9f98-9dcd36feb199\") " pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-kubelet\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000186    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-log-socket\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mwr\" (UniqueName: \"kubernetes.io/projected/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-kube-api-access-s8mwr\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-socket-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9gx\" (UniqueName: \"kubernetes.io/projected/38fb09ee-3e0a-4954-9437-7907264abb03-kube-api-access-hw9gx\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ee1d8a-91ff-4153-960a-fb1e554e2220-iptables-alerter-script\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.000358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovnkube-config\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000371    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-socket-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovnkube-script-lib\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-serviceca\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-slash\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a982052a-2fc3-41f9-9f98-9dcd36feb199-agent-certs\") pod \"konnectivity-agent-27jnz\" (UID: \"a982052a-2fc3-41f9-9f98-9dcd36feb199\") " pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-sys-fs\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000552    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-slash\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-etc-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-cni-netd\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.000827 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000708    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a982052a-2fc3-41f9-9f98-9dcd36feb199-konnectivity-ca\") pod \"konnectivity-agent-27jnz\" (UID: \"a982052a-2fc3-41f9-9f98-9dcd36feb199\") " pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-run-netns\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000741    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-run-netns\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-node-log\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-cni-bin\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000817    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-sys-fs\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-registration-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rd5\" (UniqueName: \"kubernetes.io/projected/c317b1c2-a657-4090-a84f-eda551f5e8c7-kube-api-access-55rd5\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ee1d8a-91ff-4153-960a-fb1e554e2220-host-slash\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.000899    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000900    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ee1d8a-91ff-4153-960a-fb1e554e2220-iptables-alerter-script\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-systemd-units\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-serviceca\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-env-overrides\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000938    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovnkube-config\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.000955    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:38.500940619 +0000 UTC m=+3.323431283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000945    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000966    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-etc-openvswitch\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000975    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovnkube-script-lib\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000982    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-cni-netd\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.000984    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-systemd-units\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001086    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-registration-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001087    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-node-log\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001113    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ee1d8a-91ff-4153-960a-fb1e554e2220-host-slash\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001125    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-cni-bin\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-host\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001237    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.001868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001241    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-host\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.002247 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001293    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38fb09ee-3e0a-4954-9437-7907264abb03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.002247 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.002247 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001377    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.002247 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.001433    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-env-overrides\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.002620 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.002605    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a982052a-2fc3-41f9-9f98-9dcd36feb199-agent-certs\") pod \"konnectivity-agent-27jnz\" (UID: \"a982052a-2fc3-41f9-9f98-9dcd36feb199\") " pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:38.002877 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.002855    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.011299 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.011281    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rd5\" (UniqueName: \"kubernetes.io/projected/c317b1c2-a657-4090-a84f-eda551f5e8c7-kube-api-access-55rd5\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:38.011437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.011416    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n86n5\" (UniqueName: \"kubernetes.io/projected/d9ee1d8a-91ff-4153-960a-fb1e554e2220-kube-api-access-n86n5\") pod \"iptables-alerter-zr92t\" (UID: \"d9ee1d8a-91ff-4153-960a-fb1e554e2220\") " pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.011566 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.011551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8mwr\" (UniqueName: \"kubernetes.io/projected/05f77337-2ea3-4f03-a1dd-ab57d8f5e697-kube-api-access-s8mwr\") pod \"node-ca-5bnxd\" (UID: \"05f77337-2ea3-4f03-a1dd-ab57d8f5e697\") " pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.011972 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.011951    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9gx\" (UniqueName: \"kubernetes.io/projected/38fb09ee-3e0a-4954-9437-7907264abb03-kube-api-access-hw9gx\") pod \"aws-ebs-csi-driver-node-wrq28\" (UID: \"38fb09ee-3e0a-4954-9437-7907264abb03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.012153 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.012137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqhw\" (UniqueName: \"kubernetes.io/projected/aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6-kube-api-access-qrqhw\") pod \"ovnkube-node-t5kj9\" (UID: \"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.015044 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.015029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fqs67"
Jul 05 19:32:38.021142 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.021127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m2pq5"
Jul 05 19:32:38.025136 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.025121    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6ee0c6_6fd1_4229_a772_be0061011a8b.slice/crio-6dc812bc4a47010d4a9d16fe5032ef573edd71e8550a80355944ddc713d68ff7 WatchSource:0}: Error finding container 6dc812bc4a47010d4a9d16fe5032ef573edd71e8550a80355944ddc713d68ff7: Status 404 returned error can't find the container with id 6dc812bc4a47010d4a9d16fe5032ef573edd71e8550a80355944ddc713d68ff7
Jul 05 19:32:38.029013 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.028994    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1228d4d9_116c_4242_9526_235474e51bc6.slice/crio-09b7143c408f5102f0d27a596acb0264286a11c8bf161a4e466bb42e5fb1faf7 WatchSource:0}: Error finding container 09b7143c408f5102f0d27a596acb0264286a11c8bf161a4e466bb42e5fb1faf7: Status 404 returned error can't find the container with id 09b7143c408f5102f0d27a596acb0264286a11c8bf161a4e466bb42e5fb1faf7
Jul 05 19:32:38.029976 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.029961    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpbpw"
Jul 05 19:32:38.035485 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.035470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ckqjg"
Jul 05 19:32:38.038245 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.038225    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb228f734_4eb4_4d85_8da0_a8457c88c0e8.slice/crio-6472a0b06637be4adeca534904560d27d778c63814ef27d54b9e829efec4b4cf WatchSource:0}: Error finding container 6472a0b06637be4adeca534904560d27d778c63814ef27d54b9e829efec4b4cf: Status 404 returned error can't find the container with id 6472a0b06637be4adeca534904560d27d778c63814ef27d54b9e829efec4b4cf
Jul 05 19:32:38.041562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.041545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bnxd"
Jul 05 19:32:38.045092 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.045073    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed620df_38be_4e21_9cce_e6b2f75a09d5.slice/crio-0a48c422f771c4db844bbe992ec7f6c1f223e46ddd960a35a48dab3047ab7095 WatchSource:0}: Error finding container 0a48c422f771c4db844bbe992ec7f6c1f223e46ddd960a35a48dab3047ab7095: Status 404 returned error can't find the container with id 0a48c422f771c4db844bbe992ec7f6c1f223e46ddd960a35a48dab3047ab7095
Jul 05 19:32:38.045812 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.045782    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:32:38.049490 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.049474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f77337_2ea3_4f03_a1dd_ab57d8f5e697.slice/crio-11de6185d2b7529d106002d5d0ffa2930e1412847a4fafb11412f07a11ca5783 WatchSource:0}: Error finding container 11de6185d2b7529d106002d5d0ffa2930e1412847a4fafb11412f07a11ca5783: Status 404 returned error can't find the container with id 11de6185d2b7529d106002d5d0ffa2930e1412847a4fafb11412f07a11ca5783
Jul 05 19:32:38.052316 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.052298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28"
Jul 05 19:32:38.053506 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.053486    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7ae0fd_2fbd_4c2e_8fa7_5ff6c98f48c6.slice/crio-46fe7ad7d126ae4cd60397027c36dd0f757c6966335d9a0cfa21968d647c68b9 WatchSource:0}: Error finding container 46fe7ad7d126ae4cd60397027c36dd0f757c6966335d9a0cfa21968d647c68b9: Status 404 returned error can't find the container with id 46fe7ad7d126ae4cd60397027c36dd0f757c6966335d9a0cfa21968d647c68b9
Jul 05 19:32:38.056834 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.056816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:32:38.060659 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.060640    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fb09ee_3e0a_4954_9437_7907264abb03.slice/crio-c65341689a5efe74d1842fa58b75315e236786ebedfe5ff6fa00ee11a5a9cc18 WatchSource:0}: Error finding container c65341689a5efe74d1842fa58b75315e236786ebedfe5ff6fa00ee11a5a9cc18: Status 404 returned error can't find the container with id c65341689a5efe74d1842fa58b75315e236786ebedfe5ff6fa00ee11a5a9cc18
Jul 05 19:32:38.061251 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.061228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zr92t"
Jul 05 19:32:38.066069 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.066051    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda982052a_2fc3_41f9_9f98_9dcd36feb199.slice/crio-c82979535948cbebfeb5f7e6d5abc077e2b2e532856e0a319817f95086545259 WatchSource:0}: Error finding container c82979535948cbebfeb5f7e6d5abc077e2b2e532856e0a319817f95086545259: Status 404 returned error can't find the container with id c82979535948cbebfeb5f7e6d5abc077e2b2e532856e0a319817f95086545259
Jul 05 19:32:38.070578 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:32:38.070561    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ee1d8a_91ff_4153_960a_fb1e554e2220.slice/crio-23bb38d762c80a08874ca4b37b5731b95147f08cd47b670e2cff2e0bddbe288a WatchSource:0}: Error finding container 23bb38d762c80a08874ca4b37b5731b95147f08cd47b670e2cff2e0bddbe288a: Status 404 returned error can't find the container with id 23bb38d762c80a08874ca4b37b5731b95147f08cd47b670e2cff2e0bddbe288a
Jul 05 19:32:38.406086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.405477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:38.406086 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.405628    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:38.406086 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.405688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:32:39.40567086 +0000 UTC m=+4.228161543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:38.506137 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.506060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:38.506137 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.506106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:38.506351 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.506286    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:38.506351 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.506309    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:38.506351 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.506323    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:38.506498 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.506374    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:39.506357543 +0000 UTC m=+4.328848206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:38.506956 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.506812    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:38.506956 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:38.506872    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:39.506855504 +0000 UTC m=+4.329346168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:38.561975 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.561882    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:27:37 +0000 UTC" deadline="2027-12-15 23:59:35.180825032 +0000 UTC"
Jul 05 19:32:38.561975 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.561949    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12676h26m56.618880364s"
Jul 05 19:32:38.719737 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.719633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bnxd" event={"ID":"05f77337-2ea3-4f03-a1dd-ab57d8f5e697","Type":"ContainerStarted","Data":"11de6185d2b7529d106002d5d0ffa2930e1412847a4fafb11412f07a11ca5783"}
Jul 05 19:32:38.728608 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.728574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpbpw" event={"ID":"b228f734-4eb4-4d85-8da0-a8457c88c0e8","Type":"ContainerStarted","Data":"6472a0b06637be4adeca534904560d27d778c63814ef27d54b9e829efec4b4cf"}
Jul 05 19:32:38.736993 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.736964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fqs67" event={"ID":"ed6ee0c6-6fd1-4229-a772-be0061011a8b","Type":"ContainerStarted","Data":"6dc812bc4a47010d4a9d16fe5032ef573edd71e8550a80355944ddc713d68ff7"}
Jul 05 19:32:38.762245 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.762214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal" event={"ID":"301d2e284fa3bf2b30f75ef544be44ae","Type":"ContainerStarted","Data":"79dfe0ef01b74a0976ad7b11703d5ed958f943b55f4176df850cddf0af5f4a43"}
Jul 05 19:32:38.781241 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.781210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-27jnz" event={"ID":"a982052a-2fc3-41f9-9f98-9dcd36feb199","Type":"ContainerStarted","Data":"c82979535948cbebfeb5f7e6d5abc077e2b2e532856e0a319817f95086545259"}
Jul 05 19:32:38.804035 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.803984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerStarted","Data":"0a48c422f771c4db844bbe992ec7f6c1f223e46ddd960a35a48dab3047ab7095"}
Jul 05 19:32:38.814773 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.814733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m2pq5" event={"ID":"1228d4d9-116c-4242-9526-235474e51bc6","Type":"ContainerStarted","Data":"09b7143c408f5102f0d27a596acb0264286a11c8bf161a4e466bb42e5fb1faf7"}
Jul 05 19:32:38.838663 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.838631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" event={"ID":"27e27d054810d078240eb360988177e7","Type":"ContainerStarted","Data":"3514f5877887561e7c7886386372ed4e9cf6c732c4111587dd285f071d667ace"}
Jul 05 19:32:38.846240 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.846206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zr92t" event={"ID":"d9ee1d8a-91ff-4153-960a-fb1e554e2220","Type":"ContainerStarted","Data":"23bb38d762c80a08874ca4b37b5731b95147f08cd47b670e2cff2e0bddbe288a"}
Jul 05 19:32:38.861721 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.861696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28" event={"ID":"38fb09ee-3e0a-4954-9437-7907264abb03","Type":"ContainerStarted","Data":"c65341689a5efe74d1842fa58b75315e236786ebedfe5ff6fa00ee11a5a9cc18"}
Jul 05 19:32:38.889948 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:38.889924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"46fe7ad7d126ae4cd60397027c36dd0f757c6966335d9a0cfa21968d647c68b9"}
Jul 05 19:32:39.099952 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.099822    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:39.415673 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.415601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:39.415937 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.415815    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:39.415937 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.415877    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:32:41.415859111 +0000 UTC m=+6.238349784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:39.516317 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.516179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:39.516317 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.516225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:39.516594 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.516363    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:39.516594 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.516409    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:39.516594 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.516479    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:39.516594 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.516573    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:41.51655344 +0000 UTC m=+6.339044117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:39.517014 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.516993    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:39.517118 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.517049    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:41.517034291 +0000 UTC m=+6.339524966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:39.614723 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.613936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:39.614723 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.614059    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:39.614723 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.614428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:39.614723 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.614524    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:39.614723 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:39.614592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:39.614723 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:39.614657    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:41.437487 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:41.437447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:41.438049 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.437657    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:41.438049 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.437733    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:32:45.437718389 +0000 UTC m=+10.260209048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:41.538743 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:41.538639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:41.538743 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:41.538693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:41.538985 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.538817    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:41.538985 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.538885    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:45.538868082 +0000 UTC m=+10.361358755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:41.538985 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.538887    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:41.538985 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.538905    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:41.538985 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.538917    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:41.538985 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.538954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:45.538943706 +0000 UTC m=+10.361434385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:41.612779 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:41.612747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:41.612965 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:41.612747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:41.612965 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:41.612747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:41.612965 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.612919    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:41.613127 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.613046    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:41.613192 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:41.613168    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:43.611978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:43.611876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:43.612387 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:43.611876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:43.612387 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:43.612001    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:43.612387 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:43.612028    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:43.612387 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:43.612134    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:43.612387 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:43.612218    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:45.470753 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:45.470667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:45.471221 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.470852    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:45.471221 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.470929    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:32:53.470906763 +0000 UTC m=+18.293397446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:45.571673 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:45.571644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:45.571862 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:45.571686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:45.571862 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.571821    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:45.571862 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.571854    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:45.572026 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.571872    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:45.572026 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.571884    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:45.572026 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.571893    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:53.571871789 +0000 UTC m=+18.394362451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:45.572026 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.571933    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:53.571916982 +0000 UTC m=+18.394407655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:45.612062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:45.612030    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:45.612201 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.612173    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:45.613524 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:45.613502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:45.613651 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.613600    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:45.613746 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:45.613727    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:45.613844 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:45.613825    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:47.612152 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:47.612124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:47.612597 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:47.612249    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:47.612696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:47.612678    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:47.612823 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:47.612786    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:47.612994 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:47.612972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:47.613103 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:47.613083    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:49.614410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:49.614331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:49.614874 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:49.614456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:49.614874 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:49.614465    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:49.614874 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:49.614499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:49.614874 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:49.614613    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:49.614874 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:49.614736    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:51.611650 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:51.611612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:51.611650 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:51.611649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:51.612199 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:51.611619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:51.612199 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:51.611758    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:51.612199 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:51.611860    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:51.612199 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:51.611956    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:53.530663 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:53.530622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:53.531131 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.530789    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:53.531131 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.530879    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.530856275 +0000 UTC m=+34.353346948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:53.611939 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:53.611906    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:53.612097 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:53.612033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:53.612097 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.612047    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:53.612236 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.612125    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:53.612236 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:53.612187    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:53.612335 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.612281    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:53.631290 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:53.631259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:53.631437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:53.631375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:53.631501 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.631481    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:53.631550 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.631505    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:53.631550 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.631515    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:53.631550 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.631516    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:53.631675 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.631574    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.631555982 +0000 UTC m=+34.454046656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:53.631675 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:53.631594    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.631585406 +0000 UTC m=+34.454076067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:55.613416 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:55.613177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:55.613861 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:55.613260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:55.613861 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:55.613497    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:55.613861 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:55.613605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:55.613861 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:55.613293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:55.613861 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:55.613723    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:57.612487 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:57.612458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:57.612870 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:57.612455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:57.612870 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:57.612562    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:57.612870 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:57.612466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:57.612870 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:57.612675    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:57.612870 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:57.612741    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:58.951331 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.951159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28" event={"ID":"38fb09ee-3e0a-4954-9437-7907264abb03","Type":"ContainerStarted","Data":"81a42967dec423c559fda9b822d1196383e56942d7cb3992b2db8c7a64ee3e1a"}
Jul 05 19:32:58.954111 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.954083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"529cc73e270b07c4d6956b16ed88717b5dbdacf9d595568330fe16743845ee6b"}
Jul 05 19:32:58.954206 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.954150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"c3d467e05694bc24e37c6c47f9c286254603f9334a94f55be023c9906f712a81"}
Jul 05 19:32:58.954206 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.954199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"c675b586f734ee4352b645181a0c0b6ac8df2c27d43e436885cddf78bd98eaa7"}
Jul 05 19:32:58.954301 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.954235    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"953b65104d55aa89125566c77c548826acbbdc7de74a720029187cfdd65361fa"}
Jul 05 19:32:58.954301 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.954263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"078f8b021e453894c955a5e77588fd8fbb27b93ee27bbcb3a29c131daa20beb4"}
Jul 05 19:32:58.954369 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.954301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"a4ab34fb8c8100e7df3c2716f115f08dcd450b281fd69693ab7b451899107376"}
Jul 05 19:32:58.955397 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.955372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bnxd" event={"ID":"05f77337-2ea3-4f03-a1dd-ab57d8f5e697","Type":"ContainerStarted","Data":"34c7499a9f02b9d0d07a4023a58ecee33cee512bd108d5114495fd007e69df61"}
Jul 05 19:32:58.956753 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.956723    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpbpw" event={"ID":"b228f734-4eb4-4d85-8da0-a8457c88c0e8","Type":"ContainerStarted","Data":"3a68458ee1d95e53d913166762a82f9abbf708524acd41c7dc22843aa08de82d"}
Jul 05 19:32:58.958053 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.958032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fqs67" event={"ID":"ed6ee0c6-6fd1-4229-a772-be0061011a8b","Type":"ContainerStarted","Data":"6431e269f3258a156baf9ad872aefe88a5cc22755ca7cb37e76029503c8d5c0d"}
Jul 05 19:32:58.962113 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.962046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal" event={"ID":"301d2e284fa3bf2b30f75ef544be44ae","Type":"ContainerStarted","Data":"1d22a938968e06b8800135983affde3e402a2e6f088fba275b8e05bbc3831fb5"}
Jul 05 19:32:58.963708 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.963685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-27jnz" event={"ID":"a982052a-2fc3-41f9-9f98-9dcd36feb199","Type":"ContainerStarted","Data":"61077b96d14651b671049b81f0ba09150f99c723970f13c34614f34dd6e2bc91"}
Jul 05 19:32:58.965616 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.965595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerStarted","Data":"cd80b195ee01bc3704ebf389189affa7537437830f48a8c8d9e3e8d748a1e508"}
Jul 05 19:32:58.966905 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.966885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m2pq5" event={"ID":"1228d4d9-116c-4242-9526-235474e51bc6","Type":"ContainerStarted","Data":"acd6aeff7482b070347332d9a214f0ed410b4f3b138afcb2ec9d80738ce925f8"}
Jul 05 19:32:58.968283 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.968262    2579 generic.go:356] "Generic (PLEG): container finished" podID="27e27d054810d078240eb360988177e7" containerID="48bd10716dde0c813cb4d4f6b1cd5ea638824069c26764d1fc120f6a178a78a7" exitCode=0
Jul 05 19:32:58.968375 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.968300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" event={"ID":"27e27d054810d078240eb360988177e7","Type":"ContainerDied","Data":"48bd10716dde0c813cb4d4f6b1cd5ea638824069c26764d1fc120f6a178a78a7"}
Jul 05 19:32:58.976622 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.976587    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5bnxd" podStartSLOduration=4.178568345 podStartE2EDuration="23.976575778s" totalImagesPullingTime="19.798007433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:58.975923851 +0000 UTC m=+23.798414535" watchObservedRunningTime="2026-07-05 19:32:58.976575778 +0000 UTC m=+23.799066460"
Jul 05 19:32:58.991720 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:58.991686    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal" podStartSLOduration=22.991674182 podStartE2EDuration="22.991674182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:58.991090881 +0000 UTC m=+23.813581564" watchObservedRunningTime="2026-07-05 19:32:58.991674182 +0000 UTC m=+23.814164865"
Jul 05 19:32:59.013255 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.013220    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fqs67" podStartSLOduration=3.912225716 podStartE2EDuration="24.013206189s" totalImagesPullingTime="20.100980473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:59.013189446 +0000 UTC m=+23.835680130" watchObservedRunningTime="2026-07-05 19:32:59.013206189 +0000 UTC m=+23.835696870"
Jul 05 19:32:59.031572 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.031395    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m2pq5" podStartSLOduration=4.212478462 podStartE2EDuration="24.031383185s" totalImagesPullingTime="19.818904723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:59.030961662 +0000 UTC m=+23.853452345" watchObservedRunningTime="2026-07-05 19:32:59.031383185 +0000 UTC m=+23.853873867"
Jul 05 19:32:59.069867 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.069828    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-27jnz" podStartSLOduration=4.290286582 podStartE2EDuration="24.06979153s" totalImagesPullingTime="19.779504948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:59.06960272 +0000 UTC m=+23.892093403" watchObservedRunningTime="2026-07-05 19:32:59.06979153 +0000 UTC m=+23.892282212"
Jul 05 19:32:59.103932 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.103886    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpbpw" podStartSLOduration=4.297741836 podStartE2EDuration="24.10386814s" totalImagesPullingTime="19.806126304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:59.103692754 +0000 UTC m=+23.926183435" watchObservedRunningTime="2026-07-05 19:32:59.10386814 +0000 UTC m=+23.926358823"
Jul 05 19:32:59.612560 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.612481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:32:59.612724 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.612487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:32:59.612724 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:59.612619    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:32:59.612724 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.612669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:32:59.612855 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:59.612775    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:32:59.612897 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:32:59.612866    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:32:59.971749 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.971679    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ed620df-38be-4e21-9cce-e6b2f75a09d5" containerID="cd80b195ee01bc3704ebf389189affa7537437830f48a8c8d9e3e8d748a1e508" exitCode=0
Jul 05 19:32:59.972206 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.971751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerDied","Data":"cd80b195ee01bc3704ebf389189affa7537437830f48a8c8d9e3e8d748a1e508"}
Jul 05 19:32:59.973484 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.973450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" event={"ID":"27e27d054810d078240eb360988177e7","Type":"ContainerStarted","Data":"cd36e05f0922f9d6077c0ed95efb39c9debb6d1e02a86e06c04a0a0f7fa375ae"}
Jul 05 19:32:59.974745 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:32:59.974721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zr92t" event={"ID":"d9ee1d8a-91ff-4153-960a-fb1e554e2220","Type":"ContainerStarted","Data":"649f8f0cd622efac02299c66f152293ba0d89dc6ec2913e61d8f91ed044331bb"}
Jul 05 19:33:00.009519 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.009477    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zr92t" podStartSLOduration=5.233462561 podStartE2EDuration="25.009464943s" totalImagesPullingTime="19.776002382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:00.009028279 +0000 UTC m=+24.831518962" watchObservedRunningTime="2026-07-05 19:33:00.009464943 +0000 UTC m=+24.831955624"
Jul 05 19:33:00.027767 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.027732    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" podStartSLOduration=24.027721524 podStartE2EDuration="24.027721524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:00.027574227 +0000 UTC m=+24.850064908" watchObservedRunningTime="2026-07-05 19:33:00.027721524 +0000 UTC m=+24.850212206"
Jul 05 19:33:00.135065 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.135036    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 05 19:33:00.704074 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.703327    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T19:33:00.135056938Z","UUID":"0a40d30b-f1a8-40cb-8948-34e8cd31a1e4","Handler":null,"Name":"","Endpoint":""}
Jul 05 19:33:00.705444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.705420    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 05 19:33:00.705569 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.705464    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 05 19:33:00.912313 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.912280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:33:00.979155 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.979080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28" event={"ID":"38fb09ee-3e0a-4954-9437-7907264abb03","Type":"ContainerStarted","Data":"6e452a47d7bd8cf8ef2d61afa88f0aa118035ff36a5b2ed6a6c4c2b996db68b1"}
Jul 05 19:33:00.982781 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:00.982752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"1fb74b5f3e1702883d3529987f268de68e3d16fbdb62b3c116cc8f81c7aa24df"}
Jul 05 19:33:01.375989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.375960    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:33:01.376621 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.376603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:33:01.612039 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.611962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:01.612192 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.611962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:01.612192 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.611971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:01.612192 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:01.612098    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:33:01.612192 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:01.612165    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:33:01.612404 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:01.612267    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:33:01.987516 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.987436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28" event={"ID":"38fb09ee-3e0a-4954-9437-7907264abb03","Type":"ContainerStarted","Data":"a2154141583074ce35287072d4c72901be911d57e3ac9b88f9268ba0ba540eaa"}
Jul 05 19:33:01.991335 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:01.991310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-27jnz"
Jul 05 19:33:02.021448 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:02.021397    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrq28" podStartSLOduration=5.05788108 podStartE2EDuration="27.021384221s" totalImagesPullingTime="21.963503141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:02.013779438 +0000 UTC m=+26.836270121" watchObservedRunningTime="2026-07-05 19:33:02.021384221 +0000 UTC m=+26.843874903"
Jul 05 19:33:02.159681 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:02.159641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:02.249006 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:02.248925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:03.611836 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:03.611793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:03.612278 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:03.611793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:03.612278 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:03.611947    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:33:03.612278 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:03.612017    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:33:03.612278 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:03.611818    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:03.612278 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:03.612105    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:33:04.995352 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:04.994922    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ed620df-38be-4e21-9cce-e6b2f75a09d5" containerID="2e697c21b5991ee72d7ccae96e45e1085bf0e5fb04738bca00d1d4a4a3e2164c" exitCode=0
Jul 05 19:33:04.996111 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:04.995004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerDied","Data":"2e697c21b5991ee72d7ccae96e45e1085bf0e5fb04738bca00d1d4a4a3e2164c"}
Jul 05 19:33:04.999116 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:04.999094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" event={"ID":"aa7ae0fd-2fbd-4c2e-8fa7-5ff6c98f48c6","Type":"ContainerStarted","Data":"c2bf3bd2b8adbbdf7f823318967635e55fc4642b36aedb5fb70d14da0aae936e"}
Jul 05 19:33:04.999294 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:04.999280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:33:04.999360 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:04.999353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:33:05.015103 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.014980    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:33:05.045589 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.045553    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9" podStartSLOduration=10.210323371 podStartE2EDuration="30.045541827s" totalImagesPullingTime="19.835218456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:05.045107672 +0000 UTC m=+29.867598353" watchObservedRunningTime="2026-07-05 19:33:05.045541827 +0000 UTC m=+29.868032508"
Jul 05 19:33:05.279365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.279257    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:05.333013 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.332975    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:05.612992 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.612906    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:05.613240 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.612999    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:05.613240 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:05.613042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:05.613240 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:05.613063    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:33:05.613240 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:05.613112    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:33:05.613240 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:05.613209    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:33:06.003813 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.003764    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ed620df-38be-4e21-9cce-e6b2f75a09d5" containerID="2be035eb42aa6686abc46378854855452d80e7ae3175fc8527c5982e978cd8b2" exitCode=0
Jul 05 19:33:06.004259 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.003841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerDied","Data":"2be035eb42aa6686abc46378854855452d80e7ae3175fc8527c5982e978cd8b2"}
Jul 05 19:33:06.005199 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.004425    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:33:06.019429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.019406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:33:06.060285 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.060254    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjtpp"]
Jul 05 19:33:06.060445 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.060409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:06.060518 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:06.060498    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:33:06.060972 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.060933    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m7gm9"]
Jul 05 19:33:06.061086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.061027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:06.061135 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:06.061112    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:33:06.061683 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.061660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r749c"]
Jul 05 19:33:06.061774 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.061762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:06.061901 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:06.061880    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:33:06.483208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.483174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:06.584043 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:06.584012    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:07.001907 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:07.001878    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:07.101920 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:07.101892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:07.614960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:07.614747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:07.615081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:07.614810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:07.615081 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:07.614987    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:33:07.615081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:07.614816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:07.615176 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:07.615055    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:33:07.615176 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:07.615136    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:33:08.010457 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:08.010383    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ed620df-38be-4e21-9cce-e6b2f75a09d5" containerID="168c573b8240e1521f8a840318833a38a5eb82439e04bc7c4c0f5b4ec8299fbf" exitCode=0
Jul 05 19:33:08.010585 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:08.010462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerDied","Data":"168c573b8240e1521f8a840318833a38a5eb82439e04bc7c4c0f5b4ec8299fbf"}
Jul 05 19:33:09.473356 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.473274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:09.550390 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.550357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:09.550643 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.550518    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:33:09.550643 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.550595    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret podName:97bae834-6b1d-43b6-ac09-ccffa217d9af nodeName:}" failed. No retries permitted until 2026-07-05 19:33:41.550574197 +0000 UTC m=+66.373064863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret") pod "global-pull-secret-syncer-kjtpp" (UID: "97bae834-6b1d-43b6-ac09-ccffa217d9af") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:33:09.573180 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.573152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:09.615318 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.615226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:09.615425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.615332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:09.615425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.615343    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:09.615425 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.615340    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7gm9" podUID="027036c4-fe1f-4fd2-ac3a-e83b64f22a56"
Jul 05 19:33:09.615588 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.615455    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtpp" podUID="97bae834-6b1d-43b6-ac09-ccffa217d9af"
Jul 05 19:33:09.615588 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.615572    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r749c" podUID="c317b1c2-a657-4090-a84f-eda551f5e8c7"
Jul 05 19:33:09.651277 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.651251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:09.651404 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:09.651294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:09.651462 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.651409    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:33:09.651462 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.651434    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:33:09.651462 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.651449    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:33:09.651462 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.651461    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8v2hp for pod openshift-network-diagnostics/network-check-target-m7gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:33:09.651661 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.651484    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs podName:c317b1c2-a657-4090-a84f-eda551f5e8c7 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:41.6514538 +0000 UTC m=+66.473944483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs") pod "network-metrics-daemon-r749c" (UID: "c317b1c2-a657-4090-a84f-eda551f5e8c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:33:09.651661 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:09.651512    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp podName:027036c4-fe1f-4fd2-ac3a-e83b64f22a56 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:41.651491571 +0000 UTC m=+66.473982231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8v2hp" (UniqueName: "kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp") pod "network-check-target-m7gm9" (UID: "027036c4-fe1f-4fd2-ac3a-e83b64f22a56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:33:10.311092 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:10.311056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:10.377275 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:10.377240    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:11.026325 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.026255    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeReady"
Jul 05 19:33:11.026757 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.026391    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 05 19:33:11.066426 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.066398    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tpfml"]
Jul 05 19:33:11.072687 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.072667    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t9gnz"]
Jul 05 19:33:11.072787 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.072765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.075631 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.075609    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 05 19:33:11.075631 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.075630    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 05 19:33:11.075789 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.075615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6b4c\""
Jul 05 19:33:11.076735 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.076718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.079305 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.079150    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jcsgz\""
Jul 05 19:33:11.079959 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.079322    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 05 19:33:11.082092 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.080957    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 05 19:33:11.082092 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.081168    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 05 19:33:11.082092 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.081938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tpfml"]
Jul 05 19:33:11.082970 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.082951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t9gnz"]
Jul 05 19:33:11.164945 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.164909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc50911-f31c-41c6-b83d-ce95e11ce8fc-cert\") pod \"ingress-canary-t9gnz\" (UID: \"3cc50911-f31c-41c6-b83d-ce95e11ce8fc\") " pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.165100 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.164957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn9b\" (UniqueName: \"kubernetes.io/projected/3cc50911-f31c-41c6-b83d-ce95e11ce8fc-kube-api-access-xcn9b\") pod \"ingress-canary-t9gnz\" (UID: \"3cc50911-f31c-41c6-b83d-ce95e11ce8fc\") " pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.165100 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.165017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-config-volume\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.165100 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.165048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.165100 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.165072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbxr7\" (UniqueName: \"kubernetes.io/projected/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-kube-api-access-wbxr7\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.165278 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.165105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-tmp-dir\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.266244 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-tmp-dir\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.266424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc50911-f31c-41c6-b83d-ce95e11ce8fc-cert\") pod \"ingress-canary-t9gnz\" (UID: \"3cc50911-f31c-41c6-b83d-ce95e11ce8fc\") " pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.266424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn9b\" (UniqueName: \"kubernetes.io/projected/3cc50911-f31c-41c6-b83d-ce95e11ce8fc-kube-api-access-xcn9b\") pod \"ingress-canary-t9gnz\" (UID: \"3cc50911-f31c-41c6-b83d-ce95e11ce8fc\") " pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.266424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-config-volume\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.266424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.266424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbxr7\" (UniqueName: \"kubernetes.io/projected/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-kube-api-access-wbxr7\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.266654 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:11.266590    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:11.266654 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.266632    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-tmp-dir\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.266761 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:11.266642    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls podName:d6c5c9dc-5704-49d3-a473-7aa826f59d1d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:11.766626831 +0000 UTC m=+36.589117496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls") pod "dns-default-tpfml" (UID: "d6c5c9dc-5704-49d3-a473-7aa826f59d1d") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:11.267077 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.267055    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-config-volume\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.270901 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.270881    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc50911-f31c-41c6-b83d-ce95e11ce8fc-cert\") pod \"ingress-canary-t9gnz\" (UID: \"3cc50911-f31c-41c6-b83d-ce95e11ce8fc\") " pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.277715 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.277665    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbxr7\" (UniqueName: \"kubernetes.io/projected/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-kube-api-access-wbxr7\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.278055 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.278037    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn9b\" (UniqueName: \"kubernetes.io/projected/3cc50911-f31c-41c6-b83d-ce95e11ce8fc-kube-api-access-xcn9b\") pod \"ingress-canary-t9gnz\" (UID: \"3cc50911-f31c-41c6-b83d-ce95e11ce8fc\") " pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.391341 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.391312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t9gnz"
Jul 05 19:33:11.616150 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.616075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:11.616322 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.616075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:11.616322 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.616075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:11.619413 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.619393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 19:33:11.620606 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.620586    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmzkm\""
Jul 05 19:33:11.620722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.620640    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 19:33:11.620722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.620647    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 19:33:11.620722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.620587    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 19:33:11.620962 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.620743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dghwm\""
Jul 05 19:33:11.770442 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.770403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:11.770616 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:11.770606    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:11.770698 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:11.770686    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls podName:d6c5c9dc-5704-49d3-a473-7aa826f59d1d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:12.770658656 +0000 UTC m=+37.593149340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls") pod "dns-default-tpfml" (UID: "d6c5c9dc-5704-49d3-a473-7aa826f59d1d") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:11.993998 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:11.993850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t9gnz"]
Jul 05 19:33:11.998129 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:11.998101    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc50911_f31c_41c6_b83d_ce95e11ce8fc.slice/crio-4f11b7a719e7ff4054e5b5856024f498466bf996e473e4529be4e6a1516b8c2e WatchSource:0}: Error finding container 4f11b7a719e7ff4054e5b5856024f498466bf996e473e4529be4e6a1516b8c2e: Status 404 returned error can't find the container with id 4f11b7a719e7ff4054e5b5856024f498466bf996e473e4529be4e6a1516b8c2e
Jul 05 19:33:12.021059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:12.021035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t9gnz" event={"ID":"3cc50911-f31c-41c6-b83d-ce95e11ce8fc","Type":"ContainerStarted","Data":"4f11b7a719e7ff4054e5b5856024f498466bf996e473e4529be4e6a1516b8c2e"}
Jul 05 19:33:12.777782 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:12.777747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:12.778565 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:12.777906    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:12.778565 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:12.777966    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls podName:d6c5c9dc-5704-49d3-a473-7aa826f59d1d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.777950126 +0000 UTC m=+39.600440806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls") pod "dns-default-tpfml" (UID: "d6c5c9dc-5704-49d3-a473-7aa826f59d1d") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:13.026729 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:13.026696    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ed620df-38be-4e21-9cce-e6b2f75a09d5" containerID="78cd247aeda8c65d87cd9b6aaa468af88b73753a292988f7e702f241bae722e6" exitCode=0
Jul 05 19:33:13.026923 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:13.026776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerDied","Data":"78cd247aeda8c65d87cd9b6aaa468af88b73753a292988f7e702f241bae722e6"}
Jul 05 19:33:13.940061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:13.940023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.031948 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.031918    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ed620df-38be-4e21-9cce-e6b2f75a09d5" containerID="edae4568bedd9aa40cee1529d0bc8a9f45ef4c20f8b94678f4bf020af878a999" exitCode=0
Jul 05 19:33:14.032070 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.031973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerDied","Data":"edae4568bedd9aa40cee1529d0bc8a9f45ef4c20f8b94678f4bf020af878a999"}
Jul 05 19:33:14.033637 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.033616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.054898 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.054869    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nhplh"]
Jul 05 19:33:14.070036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.070016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.073144 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.073096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 05 19:33:14.073252 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.073200    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 05 19:33:14.073435 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.073407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phcbk\""
Jul 05 19:33:14.073435 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.073423    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 05 19:33:14.081434 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.073413    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 05 19:33:14.081434 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.079400    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhplh"]
Jul 05 19:33:14.144189 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.144160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.157169 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.157151    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"]
Jul 05 19:33:14.168884 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.168865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"]
Jul 05 19:33:14.168961 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.168950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"
Jul 05 19:33:14.171918 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.171900    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 05 19:33:14.172024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.171906    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 05 19:33:14.172024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.171985    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nvvl2\""
Jul 05 19:33:14.188537 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.188518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg7vs\" (UniqueName: \"kubernetes.io/projected/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-api-access-gg7vs\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.188607 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.188548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.188607 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.188578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.188678 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.188606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65c11bab-e792-4a12-a4fb-6bffc6dabfab-data-volume\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.188678 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.188646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65c11bab-e792-4a12-a4fb-6bffc6dabfab-crio-socket\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.240120 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.240097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.289745 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.289723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.289851 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.289755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65c11bab-e792-4a12-a4fb-6bffc6dabfab-data-volume\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.289851 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.289809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65c11bab-e792-4a12-a4fb-6bffc6dabfab-crio-socket\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.289966 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.289867    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.289966 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.289937    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.78991774 +0000 UTC m=+39.612408417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.289966 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.289872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg7vs\" (UniqueName: \"kubernetes.io/projected/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-api-access-gg7vs\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.290166 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.289983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wplwm\" (UniqueName: \"kubernetes.io/projected/6e6a143e-c3ec-4fc5-bdf8-98787e670ede-kube-api-access-wplwm\") pod \"migrator-d57d58cc9-rvh77\" (UID: \"6e6a143e-c3ec-4fc5-bdf8-98787e670ede\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"
Jul 05 19:33:14.290166 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.290031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.290166 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.290056    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65c11bab-e792-4a12-a4fb-6bffc6dabfab-crio-socket\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.290166 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.290096    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65c11bab-e792-4a12-a4fb-6bffc6dabfab-data-volume\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.290296 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.290245    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:14.290374 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.290357    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.790343947 +0000 UTC m=+39.612834608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:14.301906 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.301772    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg7vs\" (UniqueName: \"kubernetes.io/projected/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-api-access-gg7vs\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.340308 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.340287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.391022 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.390991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wplwm\" (UniqueName: \"kubernetes.io/projected/6e6a143e-c3ec-4fc5-bdf8-98787e670ede-kube-api-access-wplwm\") pod \"migrator-d57d58cc9-rvh77\" (UID: \"6e6a143e-c3ec-4fc5-bdf8-98787e670ede\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"
Jul 05 19:33:14.399049 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.399027    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wplwm\" (UniqueName: \"kubernetes.io/projected/6e6a143e-c3ec-4fc5-bdf8-98787e670ede-kube-api-access-wplwm\") pod \"migrator-d57d58cc9-rvh77\" (UID: \"6e6a143e-c3ec-4fc5-bdf8-98787e670ede\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"
Jul 05 19:33:14.440854 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.440825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.477900 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.477876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"
Jul 05 19:33:14.603585 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.603473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77"]
Jul 05 19:33:14.605968 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:14.605938    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6a143e_c3ec_4fc5_bdf8_98787e670ede.slice/crio-41f7324b7c8b76ed44536aa8ba9b1a1079893095e31a5ea3a3daf866a0bf25ae WatchSource:0}: Error finding container 41f7324b7c8b76ed44536aa8ba9b1a1079893095e31a5ea3a3daf866a0bf25ae: Status 404 returned error can't find the container with id 41f7324b7c8b76ed44536aa8ba9b1a1079893095e31a5ea3a3daf866a0bf25ae
Jul 05 19:33:14.668370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.668345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.758476 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.758423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:14.793959 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.793940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:14.794046 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.794004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.794046 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:14.794033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:14.794110 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.794078    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:14.794110 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.794093    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.794171 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.794132    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls podName:d6c5c9dc-5704-49d3-a473-7aa826f59d1d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:18.794118359 +0000 UTC m=+43.616609019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls") pod "dns-default-tpfml" (UID: "d6c5c9dc-5704-49d3-a473-7aa826f59d1d") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:14.794171 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.794146    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:15.7941401 +0000 UTC m=+40.616630760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.794171 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.794148    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:14.794266 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:14.794191    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:15.79417477 +0000 UTC m=+40.616665446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:15.039416 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.039332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" event={"ID":"1ed620df-38be-4e21-9cce-e6b2f75a09d5","Type":"ContainerStarted","Data":"54e63972fe8c369768ce1b3e38ccaa044e7e21d3d11be3cd16b2bb54cd271a4a"}
Jul 05 19:33:15.040949 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.040920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t9gnz" event={"ID":"3cc50911-f31c-41c6-b83d-ce95e11ce8fc","Type":"ContainerStarted","Data":"186e99f0f7cee6f8af4c2db50396baaa0846307c58367d40317b7adcac25a9d4"}
Jul 05 19:33:15.042051 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.042022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77" event={"ID":"6e6a143e-c3ec-4fc5-bdf8-98787e670ede","Type":"ContainerStarted","Data":"41f7324b7c8b76ed44536aa8ba9b1a1079893095e31a5ea3a3daf866a0bf25ae"}
Jul 05 19:33:15.067910 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.067876    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ckqjg" podStartSLOduration=10.11637906 podStartE2EDuration="40.067861598s" totalImagesPullingTime="29.951482538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:15.066254652 +0000 UTC m=+39.888745333" watchObservedRunningTime="2026-07-05 19:33:15.067861598 +0000 UTC m=+39.890352279"
Jul 05 19:33:15.083098 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.083057    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t9gnz" podStartSLOduration=1.829205053 podStartE2EDuration="4.083045192s" totalImagesPullingTime="2.253840139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:15.082437565 +0000 UTC m=+39.904928246" watchObservedRunningTime="2026-07-05 19:33:15.083045192 +0000 UTC m=+39.905535874"
Jul 05 19:33:15.201668 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.201639    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:15.266499 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.266470    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:15.402539 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.402463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:15.455340 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.455310    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:15.802514 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.802470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:15.802689 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:15.802536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:15.802689 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:15.802617    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:15.802689 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:15.802662    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:15.802878 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:15.802691    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.802665066 +0000 UTC m=+42.625155729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:15.802878 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:15.802722    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.802709424 +0000 UTC m=+42.625200087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:16.234891 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.234696    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpbpw_b228f734-4eb4-4d85-8da0-a8457c88c0e8/dns-node-resolver/0.log"
Jul 05 19:33:16.251244 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.251221    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dgnwv"]
Jul 05 19:33:16.256500 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.256481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.259668 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.259649    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 05 19:33:16.260631 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.260606    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mjl9w\""
Jul 05 19:33:16.260736 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.260610    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 05 19:33:16.260736 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.260706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 05 19:33:16.260867 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.260610    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 05 19:33:16.263997 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.263716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dgnwv"]
Jul 05 19:33:16.287644 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.287584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:16.346871 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.346849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:16.407912 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.407890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-signing-key\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.407988 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.407930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt5dl\" (UniqueName: \"kubernetes.io/projected/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-kube-api-access-rt5dl\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.407988 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.407972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-signing-cabundle\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.509273 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.509225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-signing-cabundle\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.509380 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.509345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-signing-key\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.509441 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.509390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt5dl\" (UniqueName: \"kubernetes.io/projected/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-kube-api-access-rt5dl\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.509876 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.509859    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-signing-cabundle\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.511920 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.511905    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-signing-key\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.516875 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.516845    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt5dl\" (UniqueName: \"kubernetes.io/projected/2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6-kube-api-access-rt5dl\") pod \"service-ca-758f599c5-dgnwv\" (UID: \"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6\") " pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.566645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.566622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dgnwv"
Jul 05 19:33:16.702361 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.702330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dgnwv"]
Jul 05 19:33:16.706850 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:16.706819    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efaf9c7_d3a3_4aba_8a7c_ceb3599471f6.slice/crio-cdd269465b04e7112b3ae9f8681f3c4aaba65a8c1d27b269e37ac4fe7340235b WatchSource:0}: Error finding container cdd269465b04e7112b3ae9f8681f3c4aaba65a8c1d27b269e37ac4fe7340235b: Status 404 returned error can't find the container with id cdd269465b04e7112b3ae9f8681f3c4aaba65a8c1d27b269e37ac4fe7340235b
Jul 05 19:33:16.828126 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:16.828070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bnxd_05f77337-2ea3-4f03-a1dd-ab57d8f5e697/node-ca/0.log"
Jul 05 19:33:17.048555 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.048524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77" event={"ID":"6e6a143e-c3ec-4fc5-bdf8-98787e670ede","Type":"ContainerStarted","Data":"3fb6a32fcac3308ac8de3843c3350fddfcbc93a3173dc11e4060b16912bd0fcf"}
Jul 05 19:33:17.048699 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.048579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77" event={"ID":"6e6a143e-c3ec-4fc5-bdf8-98787e670ede","Type":"ContainerStarted","Data":"dd04fa8262598bf05b422880fe57d20fb2595a519cae38d98c5aebd2a621c62a"}
Jul 05 19:33:17.049598 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.049575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dgnwv" event={"ID":"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6","Type":"ContainerStarted","Data":"cdd269465b04e7112b3ae9f8681f3c4aaba65a8c1d27b269e37ac4fe7340235b"}
Jul 05 19:33:17.069686 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.069621    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rvh77" podStartSLOduration=1.38714557 podStartE2EDuration="3.069609283s" totalImagesPullingTime="1.682463713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:17.069263622 +0000 UTC m=+41.891754303" watchObservedRunningTime="2026-07-05 19:33:17.069609283 +0000 UTC m=+41.892099966"
Jul 05 19:33:17.183444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.183384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:17.821263 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.821233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:17.821669 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:17.821361    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:17.821669 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:17.821430    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.821413702 +0000 UTC m=+46.643904379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:17.821669 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:17.821450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:17.821669 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:17.821561    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:17.821669 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:17.821603    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.821592164 +0000 UTC m=+46.644082837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:18.026733 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:18.026708    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9gnz_3cc50911-f31c-41c6-b83d-ce95e11ce8fc/serve-healthcheck-canary/0.log"
Jul 05 19:33:18.765320 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:18.765286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:18.830268 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:18.830242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:18.830597 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:18.830364    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:18.830597 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:18.830415    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls podName:d6c5c9dc-5704-49d3-a473-7aa826f59d1d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:26.830400048 +0000 UTC m=+51.652890707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls") pod "dns-default-tpfml" (UID: "d6c5c9dc-5704-49d3-a473-7aa826f59d1d") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:19.634683 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:19.634648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:19.877154 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:19.877118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:20.047042 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:20.046994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:20.059056 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:20.059023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dgnwv" event={"ID":"2efaf9c7-d3a3-4aba-8a7c-ceb3599471f6","Type":"ContainerStarted","Data":"6291ee6a7a4d60d5cddc994c5588f80a2c538bb386f4ac6b339352db4c2a6d41"}
Jul 05 19:33:20.076553 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:20.076506    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-dgnwv" podStartSLOduration=1.837627565 podStartE2EDuration="4.076489604s" totalImagesPullingTime="2.238862039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:20.074257252 +0000 UTC m=+44.896747935" watchObservedRunningTime="2026-07-05 19:33:20.076489604 +0000 UTC m=+44.898980285"
Jul 05 19:33:20.146383 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:20.146351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:20.209560 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:20.209536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:20.977763 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:20.977733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:21.568817 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:21.568770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:21.768426 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:21.768369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:21.853600 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:21.853537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:21.853727 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:21.853701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:21.853828 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:21.853813    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:21.853884 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:21.853877    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls podName:65c11bab-e792-4a12-a4fb-6bffc6dabfab nodeName:}" failed. No retries permitted until 2026-07-05 19:33:29.85386056 +0000 UTC m=+54.676351236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhplh" (UID: "65c11bab-e792-4a12-a4fb-6bffc6dabfab") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:21.854117 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:21.854096    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65c11bab-e792-4a12-a4fb-6bffc6dabfab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:21.967975 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:21.967931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:22.367329 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:22.367285    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:23.170952 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:23.170906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:23.271591 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:23.271556    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:23.373877 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:23.373850    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:23.682716 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:23.682669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:23.783674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:23.783650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:23.970290 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:23.970205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:24.567384 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:24.567352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:24.971358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:24.971280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:25.093415 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:25.093388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:25.260253 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:25.260231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:25.572653 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:25.572584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:25.874636 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:25.874565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:26.170810 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:26.170719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:26.574940 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:26.574905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:26.890057 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:26.889963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:26.892166 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:26.892142    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6c5c9dc-5704-49d3-a473-7aa826f59d1d-metrics-tls\") pod \"dns-default-tpfml\" (UID: \"d6c5c9dc-5704-49d3-a473-7aa826f59d1d\") " pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:26.965358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:26.965333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:26.985346 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:26.985327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:27.117139 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:27.117108    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tpfml"]
Jul 05 19:33:27.119911 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:27.119880    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c5c9dc_5704_49d3_a473_7aa826f59d1d.slice/crio-672cad93eb3fe5bee759943af015f05dcda4716d6126087ca8624a9b2db7e37e WatchSource:0}: Error finding container 672cad93eb3fe5bee759943af015f05dcda4716d6126087ca8624a9b2db7e37e: Status 404 returned error can't find the container with id 672cad93eb3fe5bee759943af015f05dcda4716d6126087ca8624a9b2db7e37e
Jul 05 19:33:27.168424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:27.168362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:27.771855 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:27.771824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:28.081466 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:28.081382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tpfml" event={"ID":"d6c5c9dc-5704-49d3-a473-7aa826f59d1d","Type":"ContainerStarted","Data":"672cad93eb3fe5bee759943af015f05dcda4716d6126087ca8624a9b2db7e37e"}
Jul 05 19:33:28.167891 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:28.167856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:28.455086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:28.455016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:28.520454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:28.520424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:28.582661 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:28.582635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:28.978307 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:28.978274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:29.078415 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.078382    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:29.373579 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.373539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:29.771956 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.771925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:29.911188 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.911121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:29.913292 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.913274    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65c11bab-e792-4a12-a4fb-6bffc6dabfab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhplh\" (UID: \"65c11bab-e792-4a12-a4fb-6bffc6dabfab\") " pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:29.970406 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.970377    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:29.986214 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:29.986190    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhplh"
Jul 05 19:33:30.089067 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.089028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tpfml" event={"ID":"d6c5c9dc-5704-49d3-a473-7aa826f59d1d","Type":"ContainerStarted","Data":"b37d781eb2acbbebe20d1ae74db4e260eb0fbe865b50c7caebef45879ff6ef6e"}
Jul 05 19:33:30.089195 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.089133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tpfml" event={"ID":"d6c5c9dc-5704-49d3-a473-7aa826f59d1d","Type":"ContainerStarted","Data":"3c69ec4f593665ddee987b197c90d01809668e99f7b750c8a90b30cb9932aaae"}
Jul 05 19:33:30.089195 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.089167    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:30.106826 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.106768    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tpfml" podStartSLOduration=16.795722388 podStartE2EDuration="19.106749222s" totalImagesPullingTime="2.311026834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:30.105502586 +0000 UTC m=+54.927993268" watchObservedRunningTime="2026-07-05 19:33:30.106749222 +0000 UTC m=+54.929239906"
Jul 05 19:33:30.122447 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.122424    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhplh"]
Jul 05 19:33:30.125530 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:30.125494    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c11bab_e792_4a12_a4fb_6bffc6dabfab.slice/crio-7f1561773a7b07b25f88024c29e3767d2a35ce7606c73db1f102f4f5d2b8c7c1 WatchSource:0}: Error finding container 7f1561773a7b07b25f88024c29e3767d2a35ce7606c73db1f102f4f5d2b8c7c1: Status 404 returned error can't find the container with id 7f1561773a7b07b25f88024c29e3767d2a35ce7606c73db1f102f4f5d2b8c7c1
Jul 05 19:33:30.367951 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.367902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:30.566888 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:30.566845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:31.094361 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:31.094291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhplh" event={"ID":"65c11bab-e792-4a12-a4fb-6bffc6dabfab","Type":"ContainerStarted","Data":"7f1561773a7b07b25f88024c29e3767d2a35ce7606c73db1f102f4f5d2b8c7c1"}
Jul 05 19:33:34.108599 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:34.108528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhplh" event={"ID":"65c11bab-e792-4a12-a4fb-6bffc6dabfab","Type":"ContainerStarted","Data":"c298e2956bae0cdadb699ed6c62643501901def97aa3c4a702b393fba31b0034"}
Jul 05 19:33:35.113400 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:35.113360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhplh" event={"ID":"65c11bab-e792-4a12-a4fb-6bffc6dabfab","Type":"ContainerStarted","Data":"6cdc04ecd82222e0e1cefbf8fea76f5e494f1be858774887f0cb5299d84eac5c"}
Jul 05 19:33:35.323761 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:35.323726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:35.404236 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:35.404166    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:35.491223 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:35.491195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:35.616337 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:35.616289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:35.808668 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:35.808634    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.005903 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.005870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.201896 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.201820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.267969 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.267930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.415675 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.415642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.511719 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.511690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.584915 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.584883    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79f9564f79-xjpzv"]
Jul 05 19:33:36.641730 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.641692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.646760 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.646739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79f9564f79-xjpzv"]
Jul 05 19:33:36.646902 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.646856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.649875 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.649856    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 05 19:33:36.650087 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.650071    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cndlv\""
Jul 05 19:33:36.650145 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.650121    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 05 19:33:36.651137 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.651098    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 05 19:33:36.658661 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.658632    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 05 19:33:36.725603 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.725570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.757955 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.757927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/831954ee-ac37-481c-a808-9132997dcc54-image-registry-private-configuration\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.757969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-registry-tls\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.758042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/831954ee-ac37-481c-a808-9132997dcc54-registry-certificates\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758175 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.758092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/831954ee-ac37-481c-a808-9132997dcc54-installation-pull-secrets\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758175 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.758127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fbz\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-kube-api-access-l7fbz\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758175 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.758160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-bound-sa-token\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758313 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.758211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/831954ee-ac37-481c-a808-9132997dcc54-ca-trust-extracted\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.758313 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.758238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/831954ee-ac37-481c-a808-9132997dcc54-trusted-ca\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.827457 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.827367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:36.859536 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/831954ee-ac37-481c-a808-9132997dcc54-ca-trust-extracted\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/831954ee-ac37-481c-a808-9132997dcc54-trusted-ca\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/831954ee-ac37-481c-a808-9132997dcc54-image-registry-private-configuration\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-registry-tls\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/831954ee-ac37-481c-a808-9132997dcc54-registry-certificates\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859995 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/831954ee-ac37-481c-a808-9132997dcc54-installation-pull-secrets\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859995 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fbz\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-kube-api-access-l7fbz\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859995 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-bound-sa-token\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.859995 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.859967    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/831954ee-ac37-481c-a808-9132997dcc54-ca-trust-extracted\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.861003 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.860977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/831954ee-ac37-481c-a808-9132997dcc54-registry-certificates\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.861171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.861120    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/831954ee-ac37-481c-a808-9132997dcc54-trusted-ca\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.862669 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.862640    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/831954ee-ac37-481c-a808-9132997dcc54-image-registry-private-configuration\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.862760 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.862709    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/831954ee-ac37-481c-a808-9132997dcc54-installation-pull-secrets\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.862760 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.862712    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-registry-tls\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.870396 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.870368    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-bound-sa-token\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.870593 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.870572    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fbz\" (UniqueName: \"kubernetes.io/projected/831954ee-ac37-481c-a808-9132997dcc54-kube-api-access-l7fbz\") pod \"image-registry-79f9564f79-xjpzv\" (UID: \"831954ee-ac37-481c-a808-9132997dcc54\") " pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:36.958356 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:36.958321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:37.226349 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:37.226258    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:37.331978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:37.331952    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:37.385726 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:37.385696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79f9564f79-xjpzv"]
Jul 05 19:33:37.388081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:37.388056    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831954ee_ac37_481c_a808_9132997dcc54.slice/crio-201adc3edaca5439ad8106a05181cab7fb1bf7556dd076490295709b65635e99 WatchSource:0}: Error finding container 201adc3edaca5439ad8106a05181cab7fb1bf7556dd076490295709b65635e99: Status 404 returned error can't find the container with id 201adc3edaca5439ad8106a05181cab7fb1bf7556dd076490295709b65635e99
Jul 05 19:33:38.021279 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.021254    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5kj9"
Jul 05 19:33:38.124537 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.124501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv" event={"ID":"831954ee-ac37-481c-a808-9132997dcc54","Type":"ContainerStarted","Data":"ddf00a7e590a3cbb4a977f471e6587e4de0336197185bbd9810762f76b0fd583"}
Jul 05 19:33:38.124694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.124555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:38.124694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.124574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv" event={"ID":"831954ee-ac37-481c-a808-9132997dcc54","Type":"ContainerStarted","Data":"201adc3edaca5439ad8106a05181cab7fb1bf7556dd076490295709b65635e99"}
Jul 05 19:33:38.126500 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.126477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhplh" event={"ID":"65c11bab-e792-4a12-a4fb-6bffc6dabfab","Type":"ContainerStarted","Data":"b05ccc42b180e090a7c0e3785bd1a20b2e6d72d5c12387f474139cec3652b13c"}
Jul 05 19:33:38.185997 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.185944    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv" podStartSLOduration=2.185924789 podStartE2EDuration="2.185924789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:38.18558303 +0000 UTC m=+63.008073712" watchObservedRunningTime="2026-07-05 19:33:38.185924789 +0000 UTC m=+63.008415472"
Jul 05 19:33:38.186143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.186123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:38.210027 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.209988    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nhplh" podStartSLOduration=17.132694407 podStartE2EDuration="24.209974703s" totalImagesPullingTime="7.077280296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:33:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:38.20993674 +0000 UTC m=+63.032427422" watchObservedRunningTime="2026-07-05 19:33:38.209974703 +0000 UTC m=+63.032465385"
Jul 05 19:33:38.277603 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.277536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:38.378736 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:38.378706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:39.534616 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:39.534580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:39.594678 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:39.594650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:40.096275 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:40.096248    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tpfml"
Jul 05 19:33:40.200996 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:40.200970    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:40.253752 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:40.253726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:41.597159 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.597123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:41.600161 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.600142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 19:33:41.609404 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.609377    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97bae834-6b1d-43b6-ac09-ccffa217d9af-original-pull-secret\") pod \"global-pull-secret-syncer-kjtpp\" (UID: \"97bae834-6b1d-43b6-ac09-ccffa217d9af\") " pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:41.639932 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.639909    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtpp"
Jul 05 19:33:41.698561 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.698462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:41.698561 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.698502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:41.703779 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.703690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 19:33:41.703779 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.703727    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 19:33:41.710939 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.710915    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c317b1c2-a657-4090-a84f-eda551f5e8c7-metrics-certs\") pod \"network-metrics-daemon-r749c\" (UID: \"c317b1c2-a657-4090-a84f-eda551f5e8c7\") " pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:41.712367 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.712321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 19:33:41.721233 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.721212    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2hp\" (UniqueName: \"kubernetes.io/projected/027036c4-fe1f-4fd2-ac3a-e83b64f22a56-kube-api-access-8v2hp\") pod \"network-check-target-m7gm9\" (UID: \"027036c4-fe1f-4fd2-ac3a-e83b64f22a56\") " pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:41.779127 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.779102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjtpp"]
Jul 05 19:33:41.782171 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:41.782146    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bae834_6b1d_43b6_ac09_ccffa217d9af.slice/crio-c56e14cfbf891a0a2bc9cba273ed2d93bb9006fd11c9db8d7d8e3f0946928bc2 WatchSource:0}: Error finding container c56e14cfbf891a0a2bc9cba273ed2d93bb9006fd11c9db8d7d8e3f0946928bc2: Status 404 returned error can't find the container with id c56e14cfbf891a0a2bc9cba273ed2d93bb9006fd11c9db8d7d8e3f0946928bc2
Jul 05 19:33:41.938460 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.938400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dghwm\""
Jul 05 19:33:41.938548 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.938494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmzkm\""
Jul 05 19:33:41.945295 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.945277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:41.948523 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:41.948508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r749c"
Jul 05 19:33:42.001602 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.001064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.073490 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.073462    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m7gm9"]
Jul 05 19:33:42.076406 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:42.076379    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027036c4_fe1f_4fd2_ac3a_e83b64f22a56.slice/crio-7db74c99b9697c1b3df885801b29f1247d80655ba05b8e49bb80754065a3a477 WatchSource:0}: Error finding container 7db74c99b9697c1b3df885801b29f1247d80655ba05b8e49bb80754065a3a477: Status 404 returned error can't find the container with id 7db74c99b9697c1b3df885801b29f1247d80655ba05b8e49bb80754065a3a477
Jul 05 19:33:42.076641 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.076621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.088437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.088413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r749c"]
Jul 05 19:33:42.091353 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:42.091333    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc317b1c2_a657_4090_a84f_eda551f5e8c7.slice/crio-84c0a8a2c13efdb45df785c034f3a80da653ff4ab6ba3569ca8f7fbaef0cb02d WatchSource:0}: Error finding container 84c0a8a2c13efdb45df785c034f3a80da653ff4ab6ba3569ca8f7fbaef0cb02d: Status 404 returned error can't find the container with id 84c0a8a2c13efdb45df785c034f3a80da653ff4ab6ba3569ca8f7fbaef0cb02d
Jul 05 19:33:42.139813 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.139761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjtpp" event={"ID":"97bae834-6b1d-43b6-ac09-ccffa217d9af","Type":"ContainerStarted","Data":"c56e14cfbf891a0a2bc9cba273ed2d93bb9006fd11c9db8d7d8e3f0946928bc2"}
Jul 05 19:33:42.140764 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.140737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m7gm9" event={"ID":"027036c4-fe1f-4fd2-ac3a-e83b64f22a56","Type":"ContainerStarted","Data":"7db74c99b9697c1b3df885801b29f1247d80655ba05b8e49bb80754065a3a477"}
Jul 05 19:33:42.141789 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.141771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r749c" event={"ID":"c317b1c2-a657-4090-a84f-eda551f5e8c7","Type":"ContainerStarted","Data":"84c0a8a2c13efdb45df785c034f3a80da653ff4ab6ba3569ca8f7fbaef0cb02d"}
Jul 05 19:33:42.149236 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.149210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.302680 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.302649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.633939 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.633767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.733971 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.733831    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.833716 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.833679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:42.893575 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:42.893505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:43.215898 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:43.215819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:43.318430 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:43.318372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:43.464194 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:43.464153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:43.563045 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:43.562989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:44.050735 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.050645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:44.115780 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.115746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:44.151716 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.151682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r749c" event={"ID":"c317b1c2-a657-4090-a84f-eda551f5e8c7","Type":"ContainerStarted","Data":"88d1ed870013c533b5c152191105545fc0259168028f36598b67e7daea97036d"}
Jul 05 19:33:44.151886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.151771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r749c" event={"ID":"c317b1c2-a657-4090-a84f-eda551f5e8c7","Type":"ContainerStarted","Data":"73f1dc5447f9dd54917ed133bf26c0d8b308c396ed30f7775529fc02ff628e7d"}
Jul 05 19:33:44.170631 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.170580    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r749c" podStartSLOduration=67.726026914 podStartE2EDuration="1m9.170560609s" totalImagesPullingTime="1.444533695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:44.168166731 +0000 UTC m=+68.990657414" watchObservedRunningTime="2026-07-05 19:33:44.170560609 +0000 UTC m=+68.993051292"
Jul 05 19:33:44.273019 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.272989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:44.617229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.617199    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:44.678165 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:44.678123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:45.013981 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:45.013949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:45.065722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:45.065675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:46.167460 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:46.167422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:46.253631 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:46.253583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:46.314055 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:46.314019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:46.629454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:46.629421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:47.164711 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:47.164675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjtpp" event={"ID":"97bae834-6b1d-43b6-ac09-ccffa217d9af","Type":"ContainerStarted","Data":"2a921d347cd5c2d4825ba47a4fbda143cbde9a32f84eb84e1681179bcdba5e00"}
Jul 05 19:33:47.166125 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:47.166098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m7gm9" event={"ID":"027036c4-fe1f-4fd2-ac3a-e83b64f22a56","Type":"ContainerStarted","Data":"124b6f707295f5b1f5651981138ebb2843868b9318b7be3165e3d4727cc5e4be"}
Jul 05 19:33:47.166240 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:47.166162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:33:47.181351 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:47.181309    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kjtpp" podStartSLOduration=67.28891078 podStartE2EDuration="1m12.181297614s" totalImagesPullingTime="4.892386834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:47.180385699 +0000 UTC m=+72.002876381" watchObservedRunningTime="2026-07-05 19:33:47.181297614 +0000 UTC m=+72.003788295"
Jul 05 19:33:47.198269 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:47.198233    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m7gm9" podStartSLOduration=67.604315018 podStartE2EDuration="1m12.198222737s" totalImagesPullingTime="4.593907719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:47.197238669 +0000 UTC m=+72.019729352" watchObservedRunningTime="2026-07-05 19:33:47.198222737 +0000 UTC m=+72.020713419"
Jul 05 19:33:49.216281 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:49.216246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:49.316297 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:49.316271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:49.446892 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:49.446868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:50.040952 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:50.040924    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:51.313352 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.313321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:51.510043 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.510002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:51.569899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.569828    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"]
Jul 05 19:33:51.574617 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.574597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.577698 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.577676    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 05 19:33:51.577936 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.577915    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 05 19:33:51.579005 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.578988    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 05 19:33:51.579101 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.579045    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qz4s7\""
Jul 05 19:33:51.579168 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.579022    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 05 19:33:51.579168 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.578996    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 05 19:33:51.586284 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.586265    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-thcwj"]
Jul 05 19:33:51.590322 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.590304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"]
Jul 05 19:33:51.590436 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.590420    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.593368 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.593351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 05 19:33:51.593467 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.593400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-frhf9\""
Jul 05 19:33:51.593862 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.593845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 05 19:33:51.594400 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.594382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 05 19:33:51.611221 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.611199    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:51.665981 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.665950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgfb5\" (UniqueName: \"kubernetes.io/projected/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-kube-api-access-pgfb5\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666084 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.665995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvttc\" (UniqueName: \"kubernetes.io/projected/0a959acd-5ea9-4fab-a618-265582f1db3c-kube-api-access-mvttc\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.666084 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-root\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666084 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-sys\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-textfile\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-metrics-client-ca\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666278 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-tls\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666278 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666347 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.666347 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-wtmp\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.666418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a959acd-5ea9-4fab-a618-265582f1db3c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.666418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.666418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.666403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.678273 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.678246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:51.767099 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-metrics-client-ca\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-tls\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.767348 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-wtmp\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767348 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a959acd-5ea9-4fab-a618-265582f1db3c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.767348 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.767348 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767348 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgfb5\" (UniqueName: \"kubernetes.io/projected/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-kube-api-access-pgfb5\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767348 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvttc\" (UniqueName: \"kubernetes.io/projected/0a959acd-5ea9-4fab-a618-265582f1db3c-kube-api-access-mvttc\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.767642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-root\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-sys\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-textfile\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767642 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:51.767459    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 05 19:33:51.767642 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:33:51.767543    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-tls podName:0a959acd-5ea9-4fab-a618-265582f1db3c nodeName:}" failed. No retries permitted until 2026-07-05 19:33:52.267523681 +0000 UTC m=+77.090014354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-7fvx6" (UID: "0a959acd-5ea9-4fab-a618-265582f1db3c") : secret "openshift-state-metrics-tls" not found
Jul 05 19:33:51.767907 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767699    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-metrics-client-ca\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.767907 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767884    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-root\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.768153 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.768134    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-sys\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.768269 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.767706    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-textfile\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.768360 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.768277    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a959acd-5ea9-4fab-a618-265582f1db3c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.768454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.768328    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.768454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.768371    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-wtmp\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.770233 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.770208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-tls\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.770340 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.770259    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.770340 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.770285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.776605 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.776578    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvttc\" (UniqueName: \"kubernetes.io/projected/0a959acd-5ea9-4fab-a618-265582f1db3c-kube-api-access-mvttc\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:51.777538 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.777511    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgfb5\" (UniqueName: \"kubernetes.io/projected/4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4-kube-api-access-pgfb5\") pod \"node-exporter-thcwj\" (UID: \"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4\") " pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.817752 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.817723    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:51.900031 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.899966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-thcwj"
Jul 05 19:33:51.912284 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:51.912261    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7e6a65_d8df_4a08_b4f5_36058ddcbbc4.slice/crio-a70f8bf637916a086afb94eb0d31bc1ae0a7683a4144c06fdcbb4557c4a5add1 WatchSource:0}: Error finding container a70f8bf637916a086afb94eb0d31bc1ae0a7683a4144c06fdcbb4557c4a5add1: Status 404 returned error can't find the container with id a70f8bf637916a086afb94eb0d31bc1ae0a7683a4144c06fdcbb4557c4a5add1
Jul 05 19:33:51.915856 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:51.915834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:52.025898 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.025872    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:52.124233 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.124210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:52.182809 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.182743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thcwj" event={"ID":"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4","Type":"ContainerStarted","Data":"a70f8bf637916a086afb94eb0d31bc1ae0a7683a4144c06fdcbb4557c4a5add1"}
Jul 05 19:33:52.271305 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.271267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:52.273519 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.273502    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a959acd-5ea9-4fab-a618-265582f1db3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-7fvx6\" (UID: \"0a959acd-5ea9-4fab-a618-265582f1db3c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:52.484918 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.484892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"
Jul 05 19:33:52.549894 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.549861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:52.617225 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.617191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:52.638596 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.638558    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6"]
Jul 05 19:33:52.642226 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:52.642200    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a959acd_5ea9_4fab_a618_265582f1db3c.slice/crio-480147d1334fb5f7c76f1ff4234dc98facb880b1481657524784adc4ed6cfd0c WatchSource:0}: Error finding container 480147d1334fb5f7c76f1ff4234dc98facb880b1481657524784adc4ed6cfd0c: Status 404 returned error can't find the container with id 480147d1334fb5f7c76f1ff4234dc98facb880b1481657524784adc4ed6cfd0c
Jul 05 19:33:52.862299 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:52.862191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:53.188344 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:53.188311    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4" containerID="3985559b06466979a1f7ca644901e8782ace76350d623ca23ad12c2f485de82b" exitCode=0
Jul 05 19:33:53.188449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:53.188403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thcwj" event={"ID":"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4","Type":"ContainerDied","Data":"3985559b06466979a1f7ca644901e8782ace76350d623ca23ad12c2f485de82b"}
Jul 05 19:33:53.190257 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:53.190234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6" event={"ID":"0a959acd-5ea9-4fab-a618-265582f1db3c","Type":"ContainerStarted","Data":"c6bbc5e93d74310487becdbadafb0003c207637d1debac6d4a30372fb1c21941"}
Jul 05 19:33:53.190343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:53.190279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6" event={"ID":"0a959acd-5ea9-4fab-a618-265582f1db3c","Type":"ContainerStarted","Data":"966fe6f5dc82065bb9d7f46286b694c8503e469496360e60312bd2988dcc6695"}
Jul 05 19:33:53.190343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:53.190297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6" event={"ID":"0a959acd-5ea9-4fab-a618-265582f1db3c","Type":"ContainerStarted","Data":"480147d1334fb5f7c76f1ff4234dc98facb880b1481657524784adc4ed6cfd0c"}
Jul 05 19:33:54.058822 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.058715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:54.157176 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.157140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:54.195772 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.195737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thcwj" event={"ID":"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4","Type":"ContainerStarted","Data":"bb269a3d92aff5004e4278aba00619b4cbdd3b9da37ea7eefab4837da07ff7f8"}
Jul 05 19:33:54.195902 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.195839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thcwj" event={"ID":"4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4","Type":"ContainerStarted","Data":"7c2a27c64e2032749e7dd4bbcc20bac8e79b77db006aeea8e89d87c369a26b14"}
Jul 05 19:33:54.197697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.197671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6" event={"ID":"0a959acd-5ea9-4fab-a618-265582f1db3c","Type":"ContainerStarted","Data":"cc21578ba473f26c0f94ee347bc6124c44d342967a8c21faf5bb1d98dc4a20d7"}
Jul 05 19:33:54.221651 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.221621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:54.235768 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.235731    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-7fvx6" podStartSLOduration=2.261253044 podStartE2EDuration="3.235715393s" totalImagesPullingTime="974.462349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:54.234931597 +0000 UTC m=+79.057422270" watchObservedRunningTime="2026-07-05 19:33:54.235715393 +0000 UTC m=+79.058206074"
Jul 05 19:33:54.236034 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.236014    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-thcwj" podStartSLOduration=2.092295839 podStartE2EDuration="3.236009601s" totalImagesPullingTime="1.079188865s" totalInitContainerRuntime="64.524897ms" isStatefulPod=true podCreationTimestamp="2026-07-05 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:54.217922921 +0000 UTC m=+79.040413630" watchObservedRunningTime="2026-07-05 19:33:54.236009601 +0000 UTC m=+79.058500297"
Jul 05 19:33:54.585618 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.585591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:54.589552 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.589528    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5fb8579844-97gvn"]
Jul 05 19:33:54.593172 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.593148    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.597065 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.596895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 05 19:33:54.597065 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.596972    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 05 19:33:54.597065 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.597008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sbzq2\""
Jul 05 19:33:54.597065 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.597044    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 05 19:33:54.597342 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.597144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4te2319tur4r4\""
Jul 05 19:33:54.597342 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.597260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 05 19:33:54.597445 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.597433    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 05 19:33:54.614093 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.614067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fb8579844-97gvn"]
Jul 05 19:33:54.679622 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.679599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:54.685876 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.685849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.685972 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.685883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gwr7\" (UniqueName: \"kubernetes.io/projected/d01bd35a-3f45-4052-bf08-eb1f77ed441a-kube-api-access-2gwr7\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.685972 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.685932    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-tls\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.686062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.685980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bd35a-3f45-4052-bf08-eb1f77ed441a-metrics-client-ca\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.686062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.686014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.686062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.686035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.686062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.686056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.686201 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.686072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-grpc-tls\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.775586 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.775565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:54.786526 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bd35a-3f45-4052-bf08-eb1f77ed441a-metrics-client-ca\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786607 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786607 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786607 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786737 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-grpc-tls\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786816 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786816 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gwr7\" (UniqueName: \"kubernetes.io/projected/d01bd35a-3f45-4052-bf08-eb1f77ed441a-kube-api-access-2gwr7\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.786896 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.786857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-tls\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.787419 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.787376    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bd35a-3f45-4052-bf08-eb1f77ed441a-metrics-client-ca\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.789531 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.789507    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-tls\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.789725 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.789702    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.789848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.789774    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.789848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.789834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.790021 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.790001    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.790114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.790098    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bd35a-3f45-4052-bf08-eb1f77ed441a-secret-grpc-tls\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.795703 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.795680    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gwr7\" (UniqueName: \"kubernetes.io/projected/d01bd35a-3f45-4052-bf08-eb1f77ed441a-kube-api-access-2gwr7\") pod \"thanos-querier-5fb8579844-97gvn\" (UID: \"d01bd35a-3f45-4052-bf08-eb1f77ed441a\") " pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:54.903482 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:54.903431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:55.036439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:55.036415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fb8579844-97gvn"]
Jul 05 19:33:55.038954 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:33:55.038927    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01bd35a_3f45_4052_bf08_eb1f77ed441a.slice/crio-82ff35e86ebf1e676ae56f86631c765f86b9d1f29f5a310ea157d26d37d59bc1 WatchSource:0}: Error finding container 82ff35e86ebf1e676ae56f86631c765f86b9d1f29f5a310ea157d26d37d59bc1: Status 404 returned error can't find the container with id 82ff35e86ebf1e676ae56f86631c765f86b9d1f29f5a310ea157d26d37d59bc1
Jul 05 19:33:55.050210 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:55.050189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:55.202205 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:55.202128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"82ff35e86ebf1e676ae56f86631c765f86b9d1f29f5a310ea157d26d37d59bc1"}
Jul 05 19:33:56.382017 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:56.381978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:56.468715 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:56.468681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:56.739746 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:56.739709    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:57.760547 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:57.760511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:57.865003 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:57.864972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:57.968652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:57.968544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:58.216023 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.215996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"087e4681098e836b18d1669538e0d1dd71e3de7df5b41817395c07cf59404201"}
Jul 05 19:33:58.216149 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.216057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"e0d5ac60f8413d1a206a49cd13603af45f90e392e47ba889cbecffd0e591815c"}
Jul 05 19:33:58.216149 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.216084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"450f8e89153ae8ebe8a6d16e969316795a6c85849c714a1295bd3749ff59f42e"}
Jul 05 19:33:58.216149 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.216130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:33:58.216251 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.216158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"d6c9051d7860c5ab3fdbccc12ce53184b0cf079574ab045596ed2e7d17a0a0f0"}
Jul 05 19:33:58.216251 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.216185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"3a62f7514e12ec2f47f94c5e6762d7636b6e14218c2813e14b24849ce539df1d"}
Jul 05 19:33:58.216251 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.216219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" event={"ID":"d01bd35a-3f45-4052-bf08-eb1f77ed441a","Type":"ContainerStarted","Data":"2f851e2122fc6d1bc5bb826d0f2ff5a617bd3bca7a4afc00b4ba50b6ce3e2090"}
Jul 05 19:33:58.247666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.247623    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn" podStartSLOduration=1.488013226 podStartE2EDuration="4.247608461s" totalImagesPullingTime="2.759595235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:58.247247428 +0000 UTC m=+83.069738132" watchObservedRunningTime="2026-07-05 19:33:58.247608461 +0000 UTC m=+83.070099144"
Jul 05 19:33:58.546351 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.546315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:58.638381 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:58.638348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:59.134701 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:59.134673    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79f9564f79-xjpzv"
Jul 05 19:33:59.298334 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:59.298304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:59.358555 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:59.358532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:59.706909 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:59.706877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:33:59.767059 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:33:59.767032    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:01.575994 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:01.575966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:01.677226 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:01.677199    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:02.437118 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.437079    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-db7bf7bb6-b9k7p"]
Jul 05 19:34:02.458422 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.458389    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db7bf7bb6-b9k7p"]
Jul 05 19:34:02.458573 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.458497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.463552 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.463511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 05 19:34:02.463723 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.463711    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 05 19:34:02.463780 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.463720    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 05 19:34:02.465151 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.465130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 05 19:34:02.465315 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.465187    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 05 19:34:02.465315 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.465191    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l2czl\""
Jul 05 19:34:02.466656 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.466638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 05 19:34:02.466656 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.466655    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 05 19:34:02.470017 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.469999    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 05 19:34:02.542986 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.542961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-serving-cert\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.543084 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.543003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-service-ca\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.543084 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.543034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-trusted-ca-bundle\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.543181 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.543084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-oauth-config\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.543181 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.543138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-oauth-serving-cert\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.543256 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.543171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnchq\" (UniqueName: \"kubernetes.io/projected/327c8413-d844-4568-9857-42572ce4c6d2-kube-api-access-lnchq\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.543256 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.543207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-console-config\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.644475 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-service-ca\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.644475 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-trusted-ca-bundle\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645008 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-oauth-config\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645008 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-oauth-serving-cert\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645008 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnchq\" (UniqueName: \"kubernetes.io/projected/327c8413-d844-4568-9857-42572ce4c6d2-kube-api-access-lnchq\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645008 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-console-config\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645008 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.644815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-serving-cert\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645270 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.645251    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-service-ca\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645442 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.645425    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-oauth-serving-cert\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645442 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.645434    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-console-config\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.645659 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.645637    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-trusted-ca-bundle\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.647498 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.647477    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-oauth-config\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.647586 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.647481    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-serving-cert\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.655419 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.655391    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnchq\" (UniqueName: \"kubernetes.io/projected/327c8413-d844-4568-9857-42572ce4c6d2-kube-api-access-lnchq\") pod \"console-db7bf7bb6-b9k7p\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") " pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.768430 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.768399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:02.906030 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:02.905927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db7bf7bb6-b9k7p"]
Jul 05 19:34:03.235066 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:03.235036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7bf7bb6-b9k7p" event={"ID":"327c8413-d844-4568-9857-42572ce4c6d2","Type":"ContainerStarted","Data":"2cd2d918cfcf2707d342f5ba4fe07e615ac08c6eacb4d93ed12e6397aa20f46e"}
Jul 05 19:34:03.875187 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:03.875142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:03.948960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:03.948929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:04.225618 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:04.225546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5fb8579844-97gvn"
Jul 05 19:34:06.195841 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:06.195789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:06.249411 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:06.249377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7bf7bb6-b9k7p" event={"ID":"327c8413-d844-4568-9857-42572ce4c6d2","Type":"ContainerStarted","Data":"210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257"}
Jul 05 19:34:06.269351 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:06.269308    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-db7bf7bb6-b9k7p" podStartSLOduration=1.527530328 podStartE2EDuration="4.269295534s" totalImagesPullingTime="2.741765206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:34:06.267831001 +0000 UTC m=+91.090321683" watchObservedRunningTime="2026-07-05 19:34:06.269295534 +0000 UTC m=+91.091786215"
Jul 05 19:34:06.271879 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:06.271857    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:10.584873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:10.584841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:12.768676 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:12.768630    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:12.769110 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:12.768703    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:12.774141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:12.774117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:13.280129 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:13.280103    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:34:13.435777 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:13.435724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:13.536482 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:13.536405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:13.594983 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:13.594960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:18.172390 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:18.172362    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m7gm9"
Jul 05 19:34:24.300101 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:24.300073    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9gnz_3cc50911-f31c-41c6-b83d-ce95e11ce8fc/serve-healthcheck-canary/0.log"
Jul 05 19:34:28.458523 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:28.458488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:28.520606 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:28.520556    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:36.272633 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:36.272584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:36.345772 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:36.345719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:36.409231 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:36.409204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:34:54.983392 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:34:54.983352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:10.881245 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:10.881209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:11.197479 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:11.197399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:20.546652 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.546596    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84446dc56f-t9vxr"]
Jul 05 19:35:20.549896 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.549879    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.561033 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.561011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84446dc56f-t9vxr"]
Jul 05 19:35:20.591224 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.591202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:20.687885 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.687861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfm2l\" (UniqueName: \"kubernetes.io/projected/d2b85700-dcdb-46bf-939e-59f01ee69512-kube-api-access-cfm2l\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.687971 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.687899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-service-ca\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.687971 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.687919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-oauth-serving-cert\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.687971 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.687939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-console-config\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.688071 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.688004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-oauth-config\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.688071 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.688036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-serving-cert\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.688071 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.688061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-trusted-ca-bundle\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789091 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-service-ca\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789209 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-oauth-serving-cert\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789209 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-console-config\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789209 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-oauth-config\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789209 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-serving-cert\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789209 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-trusted-ca-bundle\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfm2l\" (UniqueName: \"kubernetes.io/projected/d2b85700-dcdb-46bf-939e-59f01ee69512-kube-api-access-cfm2l\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.789978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789953    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-console-config\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.790083 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789952    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-service-ca\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.790083 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.789989    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-oauth-serving-cert\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.790262 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.790239    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-trusted-ca-bundle\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.791533 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.791503    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-oauth-config\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.791602 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.791583    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-serving-cert\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.796868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.796820    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfm2l\" (UniqueName: \"kubernetes.io/projected/d2b85700-dcdb-46bf-939e-59f01ee69512-kube-api-access-cfm2l\") pod \"console-84446dc56f-t9vxr\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") " pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.858749 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.858721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:20.980066 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:20.980040    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84446dc56f-t9vxr"]
Jul 05 19:35:20.982460 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:35:20.982434    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b85700_dcdb_46bf_939e_59f01ee69512.slice/crio-732a18f5dcc4c45f6aa102e1418cc8aa21ec33d17d2869393140871a24d41957 WatchSource:0}: Error finding container 732a18f5dcc4c45f6aa102e1418cc8aa21ec33d17d2869393140871a24d41957: Status 404 returned error can't find the container with id 732a18f5dcc4c45f6aa102e1418cc8aa21ec33d17d2869393140871a24d41957
Jul 05 19:35:21.505566 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:21.505536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84446dc56f-t9vxr" event={"ID":"d2b85700-dcdb-46bf-939e-59f01ee69512","Type":"ContainerStarted","Data":"669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f"}
Jul 05 19:35:21.505721 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:21.505583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84446dc56f-t9vxr" event={"ID":"d2b85700-dcdb-46bf-939e-59f01ee69512","Type":"ContainerStarted","Data":"732a18f5dcc4c45f6aa102e1418cc8aa21ec33d17d2869393140871a24d41957"}
Jul 05 19:35:21.524509 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:21.524466    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84446dc56f-t9vxr" podStartSLOduration=1.52445118 podStartE2EDuration="1.52445118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:35:21.522205277 +0000 UTC m=+166.344695973" watchObservedRunningTime="2026-07-05 19:35:21.52445118 +0000 UTC m=+166.346941900"
Jul 05 19:35:30.859365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:30.859275    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:30.859365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:30.859349    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:30.863888 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:30.863866    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:31.548332 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:31.548300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:35:31.594409 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:31.594380    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db7bf7bb6-b9k7p"]
Jul 05 19:35:31.697559 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:31.697530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:31.796104 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:31.796076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:31.847432 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:31.847365    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:54.423708 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:54.423675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:35:56.616741 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.616709    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-db7bf7bb6-b9k7p" podUID="327c8413-d844-4568-9857-42572ce4c6d2" containerName="console" containerID="cri-o://210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257" gracePeriod=15
Jul 05 19:35:56.854844 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.854822    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:35:56.930228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-console-config\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930202    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-service-ca\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-serving-cert\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930254    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnchq\" (UniqueName: \"kubernetes.io/projected/327c8413-d844-4568-9857-42572ce4c6d2-kube-api-access-lnchq\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-oauth-serving-cert\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-trusted-ca-bundle\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-oauth-config\") pod \"327c8413-d844-4568-9857-42572ce4c6d2\" (UID: \"327c8413-d844-4568-9857-42572ce4c6d2\") "
Jul 05 19:35:56.930657 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930565    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:56.930657 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930591    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-console-config" (OuterVolumeSpecName: "console-config") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:56.930899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930873    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:56.931017 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.930891    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:56.932547 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.932523    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:56.932622 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.932554    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:56.932622 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:56.932573    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327c8413-d844-4568-9857-42572ce4c6d2-kube-api-access-lnchq" (OuterVolumeSpecName: "kube-api-access-lnchq") pod "327c8413-d844-4568-9857-42572ce4c6d2" (UID: "327c8413-d844-4568-9857-42572ce4c6d2"). InnerVolumeSpecName "kube-api-access-lnchq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:35:57.030842 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030818    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-trusted-ca-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.030842 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030839    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-oauth-config\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.031000 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030848    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-console-config\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.031000 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030856    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.031000 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030865    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/327c8413-d844-4568-9857-42572ce4c6d2-console-serving-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.031000 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030873    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnchq\" (UniqueName: \"kubernetes.io/projected/327c8413-d844-4568-9857-42572ce4c6d2-kube-api-access-lnchq\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.031000 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.030882    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/327c8413-d844-4568-9857-42572ce4c6d2-oauth-serving-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:35:57.629014 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.628986    2579 generic.go:356] "Generic (PLEG): container finished" podID="327c8413-d844-4568-9857-42572ce4c6d2" containerID="210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257" exitCode=0
Jul 05 19:35:57.629410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.629049    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7bf7bb6-b9k7p"
Jul 05 19:35:57.629410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.629071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7bf7bb6-b9k7p" event={"ID":"327c8413-d844-4568-9857-42572ce4c6d2","Type":"ContainerDied","Data":"210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257"}
Jul 05 19:35:57.629410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.629126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7bf7bb6-b9k7p" event={"ID":"327c8413-d844-4568-9857-42572ce4c6d2","Type":"ContainerDied","Data":"2cd2d918cfcf2707d342f5ba4fe07e615ac08c6eacb4d93ed12e6397aa20f46e"}
Jul 05 19:35:57.629410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.629150    2579 scope.go:117] "RemoveContainer" containerID="210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257"
Jul 05 19:35:57.637646 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.637633    2579 scope.go:117] "RemoveContainer" containerID="210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257"
Jul 05 19:35:57.637909 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:35:57.637891    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257\": container with ID starting with 210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257 not found: ID does not exist" containerID="210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257"
Jul 05 19:35:57.637960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.637917    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257"} err="failed to get container status \"210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257\": rpc error: code = NotFound desc = could not find container \"210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257\": container with ID starting with 210b08cb80a99497d4872a6eacd53d9cbcaa8c8dc2fe5337f3673e6869237257 not found: ID does not exist"
Jul 05 19:35:57.646027 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.646006    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db7bf7bb6-b9k7p"]
Jul 05 19:35:57.649285 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:57.649266    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db7bf7bb6-b9k7p"]
Jul 05 19:35:59.616229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:35:59.616188    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327c8413-d844-4568-9857-42572ce4c6d2" path="/var/lib/kubelet/pods/327c8413-d844-4568-9857-42572ce4c6d2/volumes"
Jul 05 19:36:26.098633 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:26.098598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:26.181014 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:26.180982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:30.658126 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:30.658083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:35.330919 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.330887    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd54bb9d8-8b4ht"]
Jul 05 19:36:35.331409 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.331134    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327c8413-d844-4568-9857-42572ce4c6d2" containerName="console"
Jul 05 19:36:35.331409 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.331146    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="327c8413-d844-4568-9857-42572ce4c6d2" containerName="console"
Jul 05 19:36:35.331409 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.331200    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="327c8413-d844-4568-9857-42572ce4c6d2" containerName="console"
Jul 05 19:36:35.333892 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.333870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.344064 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.344042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd54bb9d8-8b4ht"]
Jul 05 19:36:35.386395 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-console-config\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.386527 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-trusted-ca-bundle\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.386527 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-oauth-serving-cert\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.386527 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwq42\" (UniqueName: \"kubernetes.io/projected/a7687006-248c-4ae3-81de-df9a823e1f89-kube-api-access-zwq42\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.386527 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-service-ca\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.386527 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-serving-cert\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.386750 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.386602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-oauth-config\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.426208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.426180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:35.487365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-service-ca\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.487365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-serving-cert\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.487482 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-oauth-config\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.487482 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-console-config\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.487482 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-trusted-ca-bundle\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.487482 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-oauth-serving-cert\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.487653 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.487486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq42\" (UniqueName: \"kubernetes.io/projected/a7687006-248c-4ae3-81de-df9a823e1f89-kube-api-access-zwq42\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.488120 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.488089    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-service-ca\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.488220 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.488140    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-oauth-serving-cert\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.488220 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.488200    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-console-config\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.488459 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.488435    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-trusted-ca-bundle\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.489930 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.489908    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-serving-cert\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.490043 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.490019    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-oauth-config\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.494917 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.494892    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwq42\" (UniqueName: \"kubernetes.io/projected/a7687006-248c-4ae3-81de-df9a823e1f89-kube-api-access-zwq42\") pod \"console-5bd54bb9d8-8b4ht\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") " pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.643139 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.643082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:35.764881 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:35.764848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd54bb9d8-8b4ht"]
Jul 05 19:36:35.767749 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:36:35.767720    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7687006_248c_4ae3_81de_df9a823e1f89.slice/crio-d53b9d3550d3bc820ff3b6039dda47ecb1c629cde20bf61a1050a4ad40bb2302 WatchSource:0}: Error finding container d53b9d3550d3bc820ff3b6039dda47ecb1c629cde20bf61a1050a4ad40bb2302: Status 404 returned error can't find the container with id d53b9d3550d3bc820ff3b6039dda47ecb1c629cde20bf61a1050a4ad40bb2302
Jul 05 19:36:36.760699 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:36.760661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd54bb9d8-8b4ht" event={"ID":"a7687006-248c-4ae3-81de-df9a823e1f89","Type":"ContainerStarted","Data":"e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33"}
Jul 05 19:36:36.761084 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:36.760717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd54bb9d8-8b4ht" event={"ID":"a7687006-248c-4ae3-81de-df9a823e1f89","Type":"ContainerStarted","Data":"d53b9d3550d3bc820ff3b6039dda47ecb1c629cde20bf61a1050a4ad40bb2302"}
Jul 05 19:36:36.779542 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:36.779497    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd54bb9d8-8b4ht" podStartSLOduration=1.7794794569999999 podStartE2EDuration="1.779479457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:36:36.778248281 +0000 UTC m=+241.600738962" watchObservedRunningTime="2026-07-05 19:36:36.779479457 +0000 UTC m=+241.601970205"
Jul 05 19:36:38.082329 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:38.082296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:38.137549 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:38.137518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:43.463156 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:43.463101    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:43.562461 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:43.562432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:43.617233 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:43.617209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:44.478439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:44.478406    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:44.577714 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:44.577675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:45.643837 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:45.643812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:45.644187 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:45.644063    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:45.648479 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:45.648461    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:45.793854 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:45.793831    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:36:45.835515 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:45.835489    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84446dc56f-t9vxr"]
Jul 05 19:36:45.930013 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:45.929925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:46.029133 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:46.029093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:36:46.130559 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:36:46.130535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:10.855559 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:10.855461    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84446dc56f-t9vxr" podUID="d2b85700-dcdb-46bf-939e-59f01ee69512" containerName="console" containerID="cri-o://669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f" gracePeriod=15
Jul 05 19:37:11.095286 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.095264    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:37:11.241167 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-oauth-serving-cert\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241176    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfm2l\" (UniqueName: \"kubernetes.io/projected/d2b85700-dcdb-46bf-939e-59f01ee69512-kube-api-access-cfm2l\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241198    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-serving-cert\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241241    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-trusted-ca-bundle\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241281    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-service-ca\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241493 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241313    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-console-config\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241493 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241341    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-oauth-config\") pod \"d2b85700-dcdb-46bf-939e-59f01ee69512\" (UID: \"d2b85700-dcdb-46bf-939e-59f01ee69512\") "
Jul 05 19:37:11.241679 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241555    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:37:11.241763 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241735    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-console-config" (OuterVolumeSpecName: "console-config") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:37:11.241844 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241777    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:37:11.241934 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.241908    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:37:11.243459 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.243429    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b85700-dcdb-46bf-939e-59f01ee69512-kube-api-access-cfm2l" (OuterVolumeSpecName: "kube-api-access-cfm2l") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "kube-api-access-cfm2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:37:11.243557 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.243461    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:37:11.243557 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.243478    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2b85700-dcdb-46bf-939e-59f01ee69512" (UID: "d2b85700-dcdb-46bf-939e-59f01ee69512"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:37:11.342399 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342377    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-trusted-ca-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.342399 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342399    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.342544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342408    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-console-config\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.342544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342415    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-oauth-config\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.342544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342425    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b85700-dcdb-46bf-939e-59f01ee69512-oauth-serving-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.342544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342432    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfm2l\" (UniqueName: \"kubernetes.io/projected/d2b85700-dcdb-46bf-939e-59f01ee69512-kube-api-access-cfm2l\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.342544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.342441    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b85700-dcdb-46bf-939e-59f01ee69512-console-serving-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:11.881143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.881063    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2b85700-dcdb-46bf-939e-59f01ee69512" containerID="669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f" exitCode=0
Jul 05 19:37:11.881143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.881110    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84446dc56f-t9vxr"
Jul 05 19:37:11.881143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.881115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84446dc56f-t9vxr" event={"ID":"d2b85700-dcdb-46bf-939e-59f01ee69512","Type":"ContainerDied","Data":"669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f"}
Jul 05 19:37:11.881591 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.881155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84446dc56f-t9vxr" event={"ID":"d2b85700-dcdb-46bf-939e-59f01ee69512","Type":"ContainerDied","Data":"732a18f5dcc4c45f6aa102e1418cc8aa21ec33d17d2869393140871a24d41957"}
Jul 05 19:37:11.881591 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.881175    2579 scope.go:117] "RemoveContainer" containerID="669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f"
Jul 05 19:37:11.889609 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.889592    2579 scope.go:117] "RemoveContainer" containerID="669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f"
Jul 05 19:37:11.889898 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:37:11.889879    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f\": container with ID starting with 669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f not found: ID does not exist" containerID="669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f"
Jul 05 19:37:11.889969 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.889911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f"} err="failed to get container status \"669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f\": rpc error: code = NotFound desc = could not find container \"669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f\": container with ID starting with 669fd64f60b2e87d0bfb6e550f40d39800285827578fa6788351d108bc05e74f not found: ID does not exist"
Jul 05 19:37:11.897558 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.897537    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84446dc56f-t9vxr"]
Jul 05 19:37:11.900443 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:11.900424    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84446dc56f-t9vxr"]
Jul 05 19:37:13.616224 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:13.616193    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b85700-dcdb-46bf-939e-59f01ee69512" path="/var/lib/kubelet/pods/d2b85700-dcdb-46bf-939e-59f01ee69512/volumes"
Jul 05 19:37:19.527169 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:19.527135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:19.629640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:19.629608    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:20.228238 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.228207    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"]
Jul 05 19:37:20.228506 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.228492    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b85700-dcdb-46bf-939e-59f01ee69512" containerName="console"
Jul 05 19:37:20.228546 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.228509    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b85700-dcdb-46bf-939e-59f01ee69512" containerName="console"
Jul 05 19:37:20.228584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.228555    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b85700-dcdb-46bf-939e-59f01ee69512" containerName="console"
Jul 05 19:37:20.232808 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.232783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.236027 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.236010    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4lj88\""
Jul 05 19:37:20.236119 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.236049    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 05 19:37:20.237294 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.237280    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 05 19:37:20.241095 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.241071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"]
Jul 05 19:37:20.403066 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.403041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lrz\" (UniqueName: \"kubernetes.io/projected/b89f062e-d4fd-4c2d-97ea-3d50bb187265-kube-api-access-h7lrz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.403215 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.403108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.403215 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.403128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.503390 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.503362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lrz\" (UniqueName: \"kubernetes.io/projected/b89f062e-d4fd-4c2d-97ea-3d50bb187265-kube-api-access-h7lrz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.503532 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.503515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.503575 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.503543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.503893 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.503878    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.503933 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.503907    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.511727 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.511709    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lrz\" (UniqueName: \"kubernetes.io/projected/b89f062e-d4fd-4c2d-97ea-3d50bb187265-kube-api-access-h7lrz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.541689 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.541668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:20.664852 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.664823    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"]
Jul 05 19:37:20.667673 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:37:20.667648    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89f062e_d4fd_4c2d_97ea_3d50bb187265.slice/crio-b86368ab33f34d71025ccb1ac6b630a0d72f54a8c258628b1342a8d25846a08d WatchSource:0}: Error finding container b86368ab33f34d71025ccb1ac6b630a0d72f54a8c258628b1342a8d25846a08d: Status 404 returned error can't find the container with id b86368ab33f34d71025ccb1ac6b630a0d72f54a8c258628b1342a8d25846a08d
Jul 05 19:37:20.914701 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:20.914616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7" event={"ID":"b89f062e-d4fd-4c2d-97ea-3d50bb187265","Type":"ContainerStarted","Data":"b86368ab33f34d71025ccb1ac6b630a0d72f54a8c258628b1342a8d25846a08d"}
Jul 05 19:37:23.661208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:23.661181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:25.521580 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.521476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:25.541987 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.541961    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"]
Jul 05 19:37:25.546492 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.546470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.549910 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.549829    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 05 19:37:25.550029 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.549984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 05 19:37:25.550854 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.550572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 05 19:37:25.550854 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.550711    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 05 19:37:25.553757 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.551281    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 05 19:37:25.553757 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.551561    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 05 19:37:25.553757 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.551834    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 05 19:37:25.557686 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.557379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"]
Jul 05 19:37:25.610868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.610830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:25.647159 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.647119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-hub\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.647296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.647161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.647296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.647194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300bb30-4e1c-4b29-a974-4460737fe263-additional-service-ca\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.647296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.647226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.647296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.647268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-ca\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.647515 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.647307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6wc\" (UniqueName: \"kubernetes.io/projected/6300bb30-4e1c-4b29-a974-4460737fe263-kube-api-access-4x6wc\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.672456 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.672434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:25.748104 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.748072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6wc\" (UniqueName: \"kubernetes.io/projected/6300bb30-4e1c-4b29-a974-4460737fe263-kube-api-access-4x6wc\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.748279 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.748234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-hub\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.748341 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.748276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.748341 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.748308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300bb30-4e1c-4b29-a974-4460737fe263-additional-service-ca\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.748454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.748338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.748454 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.748393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-ca\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.749243 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.749189    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300bb30-4e1c-4b29-a974-4460737fe263-additional-service-ca\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.751328 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.751306    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-hub\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.751449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.751379    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-ca\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.751449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.751416    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.751639 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.751615    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6300bb30-4e1c-4b29-a974-4460737fe263-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.756072 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.756047    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6wc\" (UniqueName: \"kubernetes.io/projected/6300bb30-4e1c-4b29-a974-4460737fe263-kube-api-access-4x6wc\") pod \"cluster-proxy-proxy-agent-766bfc4576-hjpk4\" (UID: \"6300bb30-4e1c-4b29-a974-4460737fe263\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:25.868632 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:25.868555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"
Jul 05 19:37:26.638736 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:26.638703    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4"]
Jul 05 19:37:26.641230 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:37:26.641183    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6300bb30_4e1c_4b29_a974_4460737fe263.slice/crio-0db8c53654108f9a0e511e16310949054ea9b6ae327a8db4e3d22985429a3ddd WatchSource:0}: Error finding container 0db8c53654108f9a0e511e16310949054ea9b6ae327a8db4e3d22985429a3ddd: Status 404 returned error can't find the container with id 0db8c53654108f9a0e511e16310949054ea9b6ae327a8db4e3d22985429a3ddd
Jul 05 19:37:26.938495 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:26.938416    2579 generic.go:356] "Generic (PLEG): container finished" podID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerID="079f3f4da977ec2e7d647bd54e9d7f4a5a8bee5109a022141a094118b099b977" exitCode=0
Jul 05 19:37:26.938633 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:26.938506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7" event={"ID":"b89f062e-d4fd-4c2d-97ea-3d50bb187265","Type":"ContainerDied","Data":"079f3f4da977ec2e7d647bd54e9d7f4a5a8bee5109a022141a094118b099b977"}
Jul 05 19:37:26.939689 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:26.939659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4" event={"ID":"6300bb30-4e1c-4b29-a974-4460737fe263","Type":"ContainerStarted","Data":"0db8c53654108f9a0e511e16310949054ea9b6ae327a8db4e3d22985429a3ddd"}
Jul 05 19:37:30.963243 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:30.963160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7" event={"ID":"b89f062e-d4fd-4c2d-97ea-3d50bb187265","Type":"ContainerStarted","Data":"24f4985bedf9f760c9d11d4b3e55420fc6ff5e0ab3a3f0547cc67d08d2175832"}
Jul 05 19:37:30.965573 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:30.965550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4" event={"ID":"6300bb30-4e1c-4b29-a974-4460737fe263","Type":"ContainerStarted","Data":"2910379d3537b4dadc300327ec52b2200936759f48254752d9fb41566d05aa8b"}
Jul 05 19:37:31.971021 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:31.970985    2579 generic.go:356] "Generic (PLEG): container finished" podID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerID="24f4985bedf9f760c9d11d4b3e55420fc6ff5e0ab3a3f0547cc67d08d2175832" exitCode=0
Jul 05 19:37:31.971409 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:31.971064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7" event={"ID":"b89f062e-d4fd-4c2d-97ea-3d50bb187265","Type":"ContainerDied","Data":"24f4985bedf9f760c9d11d4b3e55420fc6ff5e0ab3a3f0547cc67d08d2175832"}
Jul 05 19:37:31.973364 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:31.973335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4" event={"ID":"6300bb30-4e1c-4b29-a974-4460737fe263","Type":"ContainerStarted","Data":"b3124512040010a84808645e53db16bcfd7eafe8cbd5aae7cabd2b3f35d3830d"}
Jul 05 19:37:31.973443 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:31.973375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4" event={"ID":"6300bb30-4e1c-4b29-a974-4460737fe263","Type":"ContainerStarted","Data":"b15aa2cc63c1e363ad70687262d2da02586c2f9ce03a9b4ecfae9bd12c5e925b"}
Jul 05 19:37:32.005588 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:32.005549    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766bfc4576-hjpk4" podStartSLOduration=2.815350594 podStartE2EDuration="7.005536027s" totalImagesPullingTime="4.190185433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:37:32.004475069 +0000 UTC m=+296.826965753" watchObservedRunningTime="2026-07-05 19:37:32.005536027 +0000 UTC m=+296.828026708"
Jul 05 19:37:35.544666 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:35.544639    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 05 19:37:39.004978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:39.004942    2579 generic.go:356] "Generic (PLEG): container finished" podID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerID="46c97d8160e60f885004cbbfc35a57a75548ebc69e7d358eb82d513c8a3f1b74" exitCode=0
Jul 05 19:37:39.005373 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:39.005020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7" event={"ID":"b89f062e-d4fd-4c2d-97ea-3d50bb187265","Type":"ContainerDied","Data":"46c97d8160e60f885004cbbfc35a57a75548ebc69e7d358eb82d513c8a3f1b74"}
Jul 05 19:37:40.128190 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.128167    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:40.164901 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.164873    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-util\") pod \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") "
Jul 05 19:37:40.165019 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.164923    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-bundle\") pod \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") "
Jul 05 19:37:40.165019 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.164975    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7lrz\" (UniqueName: \"kubernetes.io/projected/b89f062e-d4fd-4c2d-97ea-3d50bb187265-kube-api-access-h7lrz\") pod \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\" (UID: \"b89f062e-d4fd-4c2d-97ea-3d50bb187265\") "
Jul 05 19:37:40.165646 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.165617    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-bundle" (OuterVolumeSpecName: "bundle") pod "b89f062e-d4fd-4c2d-97ea-3d50bb187265" (UID: "b89f062e-d4fd-4c2d-97ea-3d50bb187265"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:37:40.167174 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.167146    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b89f062e-d4fd-4c2d-97ea-3d50bb187265-kube-api-access-h7lrz" (OuterVolumeSpecName: "kube-api-access-h7lrz") pod "b89f062e-d4fd-4c2d-97ea-3d50bb187265" (UID: "b89f062e-d4fd-4c2d-97ea-3d50bb187265"). InnerVolumeSpecName "kube-api-access-h7lrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:37:40.169815 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.169778    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-util" (OuterVolumeSpecName: "util") pod "b89f062e-d4fd-4c2d-97ea-3d50bb187265" (UID: "b89f062e-d4fd-4c2d-97ea-3d50bb187265"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:37:40.265875 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.265786    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7lrz\" (UniqueName: \"kubernetes.io/projected/b89f062e-d4fd-4c2d-97ea-3d50bb187265-kube-api-access-h7lrz\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:40.265875 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.265830    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:40.265875 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:40.265843    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b89f062e-d4fd-4c2d-97ea-3d50bb187265-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:41.015425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:41.015387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7" event={"ID":"b89f062e-d4fd-4c2d-97ea-3d50bb187265","Type":"ContainerDied","Data":"b86368ab33f34d71025ccb1ac6b630a0d72f54a8c258628b1342a8d25846a08d"}
Jul 05 19:37:41.015425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:41.015417    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwmz7"
Jul 05 19:37:41.015647 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:41.015439    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b86368ab33f34d71025ccb1ac6b630a0d72f54a8c258628b1342a8d25846a08d"
Jul 05 19:37:46.032212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:46.032181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:47.399704 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:47.399665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:49.672816 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:49.672768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:49.763404 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:49.763370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:51.793855 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:51.793823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:51.897185 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:51.897158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:52.510182 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510147    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"]
Jul 05 19:37:52.510433 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510421    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="util"
Jul 05 19:37:52.510478 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510434    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="util"
Jul 05 19:37:52.510478 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510466    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="pull"
Jul 05 19:37:52.510478 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510471    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="pull"
Jul 05 19:37:52.510583 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510479    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="extract"
Jul 05 19:37:52.510583 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510487    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="extract"
Jul 05 19:37:52.510583 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.510526    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b89f062e-d4fd-4c2d-97ea-3d50bb187265" containerName="extract"
Jul 05 19:37:52.519135 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.519110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.521723 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.521693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"]
Jul 05 19:37:52.522012 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.521996    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 05 19:37:52.522111 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.522027    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 05 19:37:52.523315 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.523298    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4lj88\""
Jul 05 19:37:52.554349 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.554325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.554449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.554368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgb4t\" (UniqueName: \"kubernetes.io/projected/86b8bd40-7d51-4e7e-8be3-83a893522897-kube-api-access-rgb4t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.554449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.554395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.655199 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.655169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.655334 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.655212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgb4t\" (UniqueName: \"kubernetes.io/projected/86b8bd40-7d51-4e7e-8be3-83a893522897-kube-api-access-rgb4t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.655334 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.655249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.655551 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.655529    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.655621 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.655570    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.664147 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.664124    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgb4t\" (UniqueName: \"kubernetes.io/projected/86b8bd40-7d51-4e7e-8be3-83a893522897-kube-api-access-rgb4t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.829680 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.829611    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:52.954846 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:52.954715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"]
Jul 05 19:37:52.957348 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:37:52.957319    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b8bd40_7d51_4e7e_8be3_83a893522897.slice/crio-95bc630e9151fcbb0cfb86d80863a29dcbec4cfe5fc3d754c8150232772f1fff WatchSource:0}: Error finding container 95bc630e9151fcbb0cfb86d80863a29dcbec4cfe5fc3d754c8150232772f1fff: Status 404 returned error can't find the container with id 95bc630e9151fcbb0cfb86d80863a29dcbec4cfe5fc3d754c8150232772f1fff
Jul 05 19:37:53.061481 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:53.061453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerStarted","Data":"dd95b7ff71eaa8952a08fb27ebaad1782fe7a9fa01264af4f20cd6ba4238427a"}
Jul 05 19:37:53.061600 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:53.061510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerStarted","Data":"95bc630e9151fcbb0cfb86d80863a29dcbec4cfe5fc3d754c8150232772f1fff"}
Jul 05 19:37:53.062480 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:53.062464    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 19:37:53.665575 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:53.665532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:53.767136 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:53.767076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:54.068427 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:54.068388    2579 generic.go:356] "Generic (PLEG): container finished" podID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerID="dd95b7ff71eaa8952a08fb27ebaad1782fe7a9fa01264af4f20cd6ba4238427a" exitCode=0
Jul 05 19:37:54.068883 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:54.068432    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerDied","Data":"dd95b7ff71eaa8952a08fb27ebaad1782fe7a9fa01264af4f20cd6ba4238427a"}
Jul 05 19:37:54.149634 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:54.149598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:54.565930 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:54.565896    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:55.074267 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:55.074236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerStarted","Data":"76a93e469207c16bdb5f25ba656003578a252a2c513fb5427851801a9741ce48"}
Jul 05 19:37:56.079081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:56.079048    2579 generic.go:356] "Generic (PLEG): container finished" podID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerID="76a93e469207c16bdb5f25ba656003578a252a2c513fb5427851801a9741ce48" exitCode=0
Jul 05 19:37:56.079413 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:56.079138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerDied","Data":"76a93e469207c16bdb5f25ba656003578a252a2c513fb5427851801a9741ce48"}
Jul 05 19:37:56.639741 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:56.639711    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:56.697071 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:56.697045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:37:57.084917 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:57.084882    2579 generic.go:356] "Generic (PLEG): container finished" podID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerID="9ed1b876ed8e8176e9e6878ef3adeb2e3a9d2ace21d2fbd7cf90c498a0c6603f" exitCode=0
Jul 05 19:37:57.085270 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:57.084924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerDied","Data":"9ed1b876ed8e8176e9e6878ef3adeb2e3a9d2ace21d2fbd7cf90c498a0c6603f"}
Jul 05 19:37:58.208488 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.208464    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:58.300016 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.299975    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-util\") pod \"86b8bd40-7d51-4e7e-8be3-83a893522897\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") "
Jul 05 19:37:58.300212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.300048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-bundle\") pod \"86b8bd40-7d51-4e7e-8be3-83a893522897\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") "
Jul 05 19:37:58.300212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.300070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgb4t\" (UniqueName: \"kubernetes.io/projected/86b8bd40-7d51-4e7e-8be3-83a893522897-kube-api-access-rgb4t\") pod \"86b8bd40-7d51-4e7e-8be3-83a893522897\" (UID: \"86b8bd40-7d51-4e7e-8be3-83a893522897\") "
Jul 05 19:37:58.300448 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.300419    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-bundle" (OuterVolumeSpecName: "bundle") pod "86b8bd40-7d51-4e7e-8be3-83a893522897" (UID: "86b8bd40-7d51-4e7e-8be3-83a893522897"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:37:58.302182 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.302150    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b8bd40-7d51-4e7e-8be3-83a893522897-kube-api-access-rgb4t" (OuterVolumeSpecName: "kube-api-access-rgb4t") pod "86b8bd40-7d51-4e7e-8be3-83a893522897" (UID: "86b8bd40-7d51-4e7e-8be3-83a893522897"). InnerVolumeSpecName "kube-api-access-rgb4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:37:58.305745 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.305725    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-util" (OuterVolumeSpecName: "util") pod "86b8bd40-7d51-4e7e-8be3-83a893522897" (UID: "86b8bd40-7d51-4e7e-8be3-83a893522897"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:37:58.400859 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.400765    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:58.400859 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.400814    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgb4t\" (UniqueName: \"kubernetes.io/projected/86b8bd40-7d51-4e7e-8be3-83a893522897-kube-api-access-rgb4t\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:58.400859 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:58.400826    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86b8bd40-7d51-4e7e-8be3-83a893522897-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:37:59.094437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:59.094398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f" event={"ID":"86b8bd40-7d51-4e7e-8be3-83a893522897","Type":"ContainerDied","Data":"95bc630e9151fcbb0cfb86d80863a29dcbec4cfe5fc3d754c8150232772f1fff"}
Jul 05 19:37:59.094437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:59.094432    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f76s8f"
Jul 05 19:37:59.094635 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:37:59.094456    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95bc630e9151fcbb0cfb86d80863a29dcbec4cfe5fc3d754c8150232772f1fff"
Jul 05 19:38:01.554947 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:01.554910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:03.654054 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:03.654020    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:03.755942 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:03.755911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:10.140203 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:10.140167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:10.230747 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:10.230722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:12.390078 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:12.390046    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:13.109968 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.109932    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"]
Jul 05 19:38:13.110214 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110202    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="extract"
Jul 05 19:38:13.110260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110216    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="extract"
Jul 05 19:38:13.110260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110224    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="util"
Jul 05 19:38:13.110260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110230    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="util"
Jul 05 19:38:13.110260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110239    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="pull"
Jul 05 19:38:13.110260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110246    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="pull"
Jul 05 19:38:13.110400 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.110297    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b8bd40-7d51-4e7e-8be3-83a893522897" containerName="extract"
Jul 05 19:38:13.112789 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.112773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.115428 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.115404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 05 19:38:13.115560 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.115431    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4lj88\""
Jul 05 19:38:13.116638 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.116620    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 05 19:38:13.120841 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.120820    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"]
Jul 05 19:38:13.205894 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.205864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9b2f\" (UniqueName: \"kubernetes.io/projected/a3a28015-d027-49aa-8c2c-85eb9208d372-kube-api-access-w9b2f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.206015 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.205934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.206015 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.205975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.306759 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.306734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.306850 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.306771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.306940 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.306921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9b2f\" (UniqueName: \"kubernetes.io/projected/a3a28015-d027-49aa-8c2c-85eb9208d372-kube-api-access-w9b2f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.307168 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.307149    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.307213 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.307167    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.315120 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.315100    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9b2f\" (UniqueName: \"kubernetes.io/projected/a3a28015-d027-49aa-8c2c-85eb9208d372-kube-api-access-w9b2f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.422289 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.422234    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:13.540749 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:13.540725    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"]
Jul 05 19:38:13.543131 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:38:13.543102    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a28015_d027_49aa_8c2c_85eb9208d372.slice/crio-2910f571b47e9d638807d0e63c3fba6fe5b63d45416d9c6b3f76ca402111f662 WatchSource:0}: Error finding container 2910f571b47e9d638807d0e63c3fba6fe5b63d45416d9c6b3f76ca402111f662: Status 404 returned error can't find the container with id 2910f571b47e9d638807d0e63c3fba6fe5b63d45416d9c6b3f76ca402111f662
Jul 05 19:38:14.153367 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:14.153339    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerID="688c0b58f94da7a3d875ffa53f6512940f900d31fa00ecbc760f7a7ec439795a" exitCode=0
Jul 05 19:38:14.153550 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:14.153400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl" event={"ID":"a3a28015-d027-49aa-8c2c-85eb9208d372","Type":"ContainerDied","Data":"688c0b58f94da7a3d875ffa53f6512940f900d31fa00ecbc760f7a7ec439795a"}
Jul 05 19:38:14.153550 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:14.153437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl" event={"ID":"a3a28015-d027-49aa-8c2c-85eb9208d372","Type":"ContainerStarted","Data":"2910f571b47e9d638807d0e63c3fba6fe5b63d45416d9c6b3f76ca402111f662"}
Jul 05 19:38:15.158145 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:15.158112    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerID="3813ae4cae359adf633a2e21a040139563ef149628f9a635db5ba0fbbacdee31" exitCode=0
Jul 05 19:38:15.158577 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:15.158164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl" event={"ID":"a3a28015-d027-49aa-8c2c-85eb9208d372","Type":"ContainerDied","Data":"3813ae4cae359adf633a2e21a040139563ef149628f9a635db5ba0fbbacdee31"}
Jul 05 19:38:16.163688 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:16.163656    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerID="098ad18ec1ecb4c2a942141c83deae5497700b2b3432a7fad13233f6a52b0fe9" exitCode=0
Jul 05 19:38:16.164060 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:16.163738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl" event={"ID":"a3a28015-d027-49aa-8c2c-85eb9208d372","Type":"ContainerDied","Data":"098ad18ec1ecb4c2a942141c83deae5497700b2b3432a7fad13233f6a52b0fe9"}
Jul 05 19:38:17.290310 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.290287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:17.438171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.438099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9b2f\" (UniqueName: \"kubernetes.io/projected/a3a28015-d027-49aa-8c2c-85eb9208d372-kube-api-access-w9b2f\") pod \"a3a28015-d027-49aa-8c2c-85eb9208d372\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") "
Jul 05 19:38:17.438171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.438132    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-bundle\") pod \"a3a28015-d027-49aa-8c2c-85eb9208d372\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") "
Jul 05 19:38:17.438171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.438154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-util\") pod \"a3a28015-d027-49aa-8c2c-85eb9208d372\" (UID: \"a3a28015-d027-49aa-8c2c-85eb9208d372\") "
Jul 05 19:38:17.439018 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.438989    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-bundle" (OuterVolumeSpecName: "bundle") pod "a3a28015-d027-49aa-8c2c-85eb9208d372" (UID: "a3a28015-d027-49aa-8c2c-85eb9208d372"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:38:17.440099 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.440077    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a28015-d027-49aa-8c2c-85eb9208d372-kube-api-access-w9b2f" (OuterVolumeSpecName: "kube-api-access-w9b2f") pod "a3a28015-d027-49aa-8c2c-85eb9208d372" (UID: "a3a28015-d027-49aa-8c2c-85eb9208d372"). InnerVolumeSpecName "kube-api-access-w9b2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:38:17.444450 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.444429    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-util" (OuterVolumeSpecName: "util") pod "a3a28015-d027-49aa-8c2c-85eb9208d372" (UID: "a3a28015-d027-49aa-8c2c-85eb9208d372"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:38:17.538722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.538701    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9b2f\" (UniqueName: \"kubernetes.io/projected/a3a28015-d027-49aa-8c2c-85eb9208d372-kube-api-access-w9b2f\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:38:17.538722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.538721    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:38:17.538837 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:17.538732    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3a28015-d027-49aa-8c2c-85eb9208d372-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:38:18.173053 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:18.173018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl" event={"ID":"a3a28015-d027-49aa-8c2c-85eb9208d372","Type":"ContainerDied","Data":"2910f571b47e9d638807d0e63c3fba6fe5b63d45416d9c6b3f76ca402111f662"}
Jul 05 19:38:18.173053 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:18.173042    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af525vl"
Jul 05 19:38:18.173317 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:18.173067    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2910f571b47e9d638807d0e63c3fba6fe5b63d45416d9c6b3f76ca402111f662"
Jul 05 19:38:24.849641 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:24.849603    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:24.955458 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:24.955432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:25.470042 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.470007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:25.677978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.677945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:25.774045 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.774014    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:25.846537 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846510    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"]
Jul 05 19:38:25.846878 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846862    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="util"
Jul 05 19:38:25.846973 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846882    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="util"
Jul 05 19:38:25.846973 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846914    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="extract"
Jul 05 19:38:25.846973 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846924    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="extract"
Jul 05 19:38:25.846973 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846941    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="pull"
Jul 05 19:38:25.846973 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.846949    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="pull"
Jul 05 19:38:25.847206 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.847012    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a28015-d027-49aa-8c2c-85eb9208d372" containerName="extract"
Jul 05 19:38:25.850237 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.850219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:25.853830 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.853809    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gl5hl\""
Jul 05 19:38:25.854005 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.853954    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 05 19:38:25.854005 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.853793    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 05 19:38:25.854141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.854035    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 05 19:38:25.854141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.854115    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 05 19:38:25.877458 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.877432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"]
Jul 05 19:38:25.992809 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.992776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:25.998917 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.998884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db7ee14b-4652-4271-ae3a-e84be0366b2d-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:25.999032 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.998932    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db7ee14b-4652-4271-ae3a-e84be0366b2d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:25.999032 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.998997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db7ee14b-4652-4271-ae3a-e84be0366b2d-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:25.999147 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.999052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db7ee14b-4652-4271-ae3a-e84be0366b2d-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:25.999147 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:25.999113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4c9j\" (UniqueName: \"kubernetes.io/projected/db7ee14b-4652-4271-ae3a-e84be0366b2d-kube-api-access-d4c9j\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.098771 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.098708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:26.099702 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.099684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db7ee14b-4652-4271-ae3a-e84be0366b2d-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.099750 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.099734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4c9j\" (UniqueName: \"kubernetes.io/projected/db7ee14b-4652-4271-ae3a-e84be0366b2d-kube-api-access-d4c9j\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.099785 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.099774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db7ee14b-4652-4271-ae3a-e84be0366b2d-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.099836 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.099820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db7ee14b-4652-4271-ae3a-e84be0366b2d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.099880 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.099856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db7ee14b-4652-4271-ae3a-e84be0366b2d-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.100254 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.100226    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db7ee14b-4652-4271-ae3a-e84be0366b2d-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.101958 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.101925    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db7ee14b-4652-4271-ae3a-e84be0366b2d-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.102156 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.102141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db7ee14b-4652-4271-ae3a-e84be0366b2d-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.102216 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.102178    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db7ee14b-4652-4271-ae3a-e84be0366b2d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.108523 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.108503    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4c9j\" (UniqueName: \"kubernetes.io/projected/db7ee14b-4652-4271-ae3a-e84be0366b2d-kube-api-access-d4c9j\") pod \"opendatahub-operator-controller-manager-547755b757-9cq5g\" (UID: \"db7ee14b-4652-4271-ae3a-e84be0366b2d\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.160327 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.160306    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:26.194014 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.193989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:26.291413 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.291302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"]
Jul 05 19:38:26.294163 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:38:26.294133    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7ee14b_4652_4271_ae3a_e84be0366b2d.slice/crio-f3c3b09353593f860b784507aea4476c0c79f335773b7df7ace9e89f131ff818 WatchSource:0}: Error finding container f3c3b09353593f860b784507aea4476c0c79f335773b7df7ace9e89f131ff818: Status 404 returned error can't find the container with id f3c3b09353593f860b784507aea4476c0c79f335773b7df7ace9e89f131ff818
Jul 05 19:38:26.294618 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.294595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:26.368483 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.368424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:26.474057 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.474033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:26.581211 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.581190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:26.670896 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:26.670839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:27.211989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:27.211951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g" event={"ID":"db7ee14b-4652-4271-ae3a-e84be0366b2d","Type":"ContainerStarted","Data":"f3c3b09353593f860b784507aea4476c0c79f335773b7df7ace9e89f131ff818"}
Jul 05 19:38:30.226441 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:30.226395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g" event={"ID":"db7ee14b-4652-4271-ae3a-e84be0366b2d","Type":"ContainerStarted","Data":"b8523245b919ee4af3d40992fa47d9799e6cfde5d8af4e7cf767f5baafb135cc"}
Jul 05 19:38:31.232775 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:31.232739    2579 generic.go:356] "Generic (PLEG): container finished" podID="db7ee14b-4652-4271-ae3a-e84be0366b2d" containerID="b8523245b919ee4af3d40992fa47d9799e6cfde5d8af4e7cf767f5baafb135cc" exitCode=0
Jul 05 19:38:31.233260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:31.232794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g" event={"ID":"db7ee14b-4652-4271-ae3a-e84be0366b2d","Type":"ContainerDied","Data":"b8523245b919ee4af3d40992fa47d9799e6cfde5d8af4e7cf767f5baafb135cc"}
Jul 05 19:38:32.238781 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:32.238741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g" event={"ID":"db7ee14b-4652-4271-ae3a-e84be0366b2d","Type":"ContainerStarted","Data":"fe1a3b1f1d4e20d66636be66c0b60cc0e8adca472aba20f6d5c5789a597ed287"}
Jul 05 19:38:32.239262 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:32.238878    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:32.262095 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:32.262050    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g" podStartSLOduration=2.972954757 podStartE2EDuration="7.262035473s" totalImagesPullingTime="3.279247866s" totalInitContainerRuntime="1.00983285s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:32.259995567 +0000 UTC m=+357.082486274" watchObservedRunningTime="2026-07-05 19:38:32.262035473 +0000 UTC m=+357.084526155"
Jul 05 19:38:37.019026 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:37.018994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:37.107778 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:37.107731    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:41.225719 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:41.225681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:41.323782 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:41.323748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:43.206748 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.206716    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"]
Jul 05 19:38:43.214942 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.214921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.217746 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.217722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"]
Jul 05 19:38:43.219282 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.219262    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 05 19:38:43.219505 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.219275    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 05 19:38:43.219605 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.219282    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wncdm\""
Jul 05 19:38:43.219605 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.219286    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 05 19:38:43.219708 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.219332    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 05 19:38:43.219708 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.219332    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 05 19:38:43.244640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.244621    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-9cq5g"
Jul 05 19:38:43.334977 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.334946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qcn\" (UniqueName: \"kubernetes.io/projected/4126125e-3a43-4f7f-9290-28413216c691-kube-api-access-p9qcn\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.335103 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.334998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4126125e-3a43-4f7f-9290-28413216c691-manager-config\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.335103 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.335047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4126125e-3a43-4f7f-9290-28413216c691-metrics-cert\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.335103 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.335098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4126125e-3a43-4f7f-9290-28413216c691-cert\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.435821 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.435772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4126125e-3a43-4f7f-9290-28413216c691-manager-config\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.435952 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.435829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4126125e-3a43-4f7f-9290-28413216c691-metrics-cert\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.435952 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.435880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4126125e-3a43-4f7f-9290-28413216c691-cert\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.436064 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.435951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qcn\" (UniqueName: \"kubernetes.io/projected/4126125e-3a43-4f7f-9290-28413216c691-kube-api-access-p9qcn\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.436444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.436415    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4126125e-3a43-4f7f-9290-28413216c691-manager-config\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.438260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.438233    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4126125e-3a43-4f7f-9290-28413216c691-metrics-cert\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.438439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.438416    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4126125e-3a43-4f7f-9290-28413216c691-cert\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.443537 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.443511    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qcn\" (UniqueName: \"kubernetes.io/projected/4126125e-3a43-4f7f-9290-28413216c691-kube-api-access-p9qcn\") pod \"lws-controller-manager-644c79ff99-cl59k\" (UID: \"4126125e-3a43-4f7f-9290-28413216c691\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.524386 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.524366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:43.647932 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:43.647907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"]
Jul 05 19:38:43.650081 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:38:43.650053    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4126125e_3a43_4f7f_9290_28413216c691.slice/crio-01fc2d973a6162db59be54e410ee8a3160fb4c429453d7c7a3f68667e7d57726 WatchSource:0}: Error finding container 01fc2d973a6162db59be54e410ee8a3160fb4c429453d7c7a3f68667e7d57726: Status 404 returned error can't find the container with id 01fc2d973a6162db59be54e410ee8a3160fb4c429453d7c7a3f68667e7d57726
Jul 05 19:38:44.286579 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:44.286544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k" event={"ID":"4126125e-3a43-4f7f-9290-28413216c691","Type":"ContainerStarted","Data":"01fc2d973a6162db59be54e410ee8a3160fb4c429453d7c7a3f68667e7d57726"}
Jul 05 19:38:45.250784 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:45.250754    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:45.291778 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:45.291745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k" event={"ID":"4126125e-3a43-4f7f-9290-28413216c691","Type":"ContainerStarted","Data":"150239bb2b0c7f93a29b417eedf97adf165de34e13cd939b1a02eb183a06cfd8"}
Jul 05 19:38:45.292127 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:45.291834    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:45.318429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:45.318382    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k" podStartSLOduration=0.852312948 podStartE2EDuration="2.318366779s" totalImagesPullingTime="1.466053831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:45.315789512 +0000 UTC m=+370.138280204" watchObservedRunningTime="2026-07-05 19:38:45.318366779 +0000 UTC m=+370.140857460"
Jul 05 19:38:45.357377 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:45.357348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:46.066782 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:46.066743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:46.168863 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:46.168753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:46.278750 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:46.278716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:46.367705 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:46.367637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:46.623055 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:46.622982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:46.961230 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:46.961159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:56.298193 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:56.298161    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-cl59k"
Jul 05 19:38:56.628629 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:56.628548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:57.023086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:57.023053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:57.182839 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:57.182786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:57.507547 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:57.507520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:57.954417 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:57.954333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:58.410074 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:58.410038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:58.509622 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:58.509591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:58.623492 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:58.623450    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:59.305722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:59.305691    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:38:59.411949 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:38:59.411917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:00.557696 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:00.557665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:03.961819 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:03.961777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:04.028458 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.028429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:04.170528 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.170498    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"]
Jul 05 19:39:04.180429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.180409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.183399 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.183375    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 05 19:39:04.183506 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.183469    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 05 19:39:04.183624 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.183608    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p9scf\""
Jul 05 19:39:04.183694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.183651    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 05 19:39:04.186942 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.186920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"]
Jul 05 19:39:04.202851 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.202824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:04.293469 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293572 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mj4\" (UniqueName: \"kubernetes.io/projected/4a3b5088-251f-4daa-8a1e-73d2cff04040-kube-api-access-m8mj4\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293572 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293648 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293648 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293648 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293742 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3b5088-251f-4daa-8a1e-73d2cff04040-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293742 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.293742 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.293729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.302243 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.302225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:04.394755 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.394732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.394867 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.394771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mj4\" (UniqueName: \"kubernetes.io/projected/4a3b5088-251f-4daa-8a1e-73d2cff04040-kube-api-access-m8mj4\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.394867 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.394790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.394986 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.394966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395108 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3b5088-251f-4daa-8a1e-73d2cff04040-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395159 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395113    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395159 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395135    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395159 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395379 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395357    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395554 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395527    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395661 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395557    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.395876 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.395857    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3b5088-251f-4daa-8a1e-73d2cff04040-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.397150 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.397128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.397281 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.397264    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.399789 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.399766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:04.402894 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.402854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3b5088-251f-4daa-8a1e-73d2cff04040-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.403003 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.402980    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mj4\" (UniqueName: \"kubernetes.io/projected/4a3b5088-251f-4daa-8a1e-73d2cff04040-kube-api-access-m8mj4\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lf5bd\" (UID: \"4a3b5088-251f-4daa-8a1e-73d2cff04040\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.492672 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.492638    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:04.621150 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:04.621122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"]
Jul 05 19:39:04.622882 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:39:04.622858    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3b5088_251f_4daa_8a1e_73d2cff04040.slice/crio-0d5c7cb7eac8e72f16134923f51d5050f86a7554445c9d02e24a1d5ab5289b92 WatchSource:0}: Error finding container 0d5c7cb7eac8e72f16134923f51d5050f86a7554445c9d02e24a1d5ab5289b92: Status 404 returned error can't find the container with id 0d5c7cb7eac8e72f16134923f51d5050f86a7554445c9d02e24a1d5ab5289b92
Jul 05 19:39:05.373959 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:05.373919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd" event={"ID":"4a3b5088-251f-4daa-8a1e-73d2cff04040","Type":"ContainerStarted","Data":"0d5c7cb7eac8e72f16134923f51d5050f86a7554445c9d02e24a1d5ab5289b92"}
Jul 05 19:39:07.026070 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:07.026035    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:39:07.026434 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:07.026123    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:39:07.026434 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:07.026175    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:39:07.383983 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:07.383902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd" event={"ID":"4a3b5088-251f-4daa-8a1e-73d2cff04040","Type":"ContainerStarted","Data":"48dd31f03ebc0dc90c2518efb42562585bed13834e08686fe6782787d1354147"}
Jul 05 19:39:07.406135 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:07.406087    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd" podStartSLOduration=1.005286576 podStartE2EDuration="3.406072093s" totalImagesPullingTime="2.400785517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:07.404909903 +0000 UTC m=+392.227400585" watchObservedRunningTime="2026-07-05 19:39:07.406072093 +0000 UTC m=+392.228562771"
Jul 05 19:39:07.493105 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:07.493075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:08.391736 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:08.391701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:08.497312 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:08.497283    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:09.392353 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:09.392324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:09.393188 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:09.393168    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lf5bd"
Jul 05 19:39:46.724450 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.724405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:46.827544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.827515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:46.858355 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.858327    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclth"]
Jul 05 19:39:46.867606 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.867584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:46.870964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.870939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclth"]
Jul 05 19:39:46.871937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.871705    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 05 19:39:46.871937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.871735    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 05 19:39:46.872485 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.872326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2t42k\""
Jul 05 19:39:46.913419 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:46.913399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:47.015857 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.015832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk5m7\" (UniqueName: \"kubernetes.io/projected/a55b8c72-17a7-4b87-96a2-f241468004cd-kube-api-access-gk5m7\") pod \"kuadrant-operator-catalog-kclth\" (UID: \"a55b8c72-17a7-4b87-96a2-f241468004cd\") " pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:47.117057 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.117018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk5m7\" (UniqueName: \"kubernetes.io/projected/a55b8c72-17a7-4b87-96a2-f241468004cd-kube-api-access-gk5m7\") pod \"kuadrant-operator-catalog-kclth\" (UID: \"a55b8c72-17a7-4b87-96a2-f241468004cd\") " pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:47.129104 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.129077    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk5m7\" (UniqueName: \"kubernetes.io/projected/a55b8c72-17a7-4b87-96a2-f241468004cd-kube-api-access-gk5m7\") pod \"kuadrant-operator-catalog-kclth\" (UID: \"a55b8c72-17a7-4b87-96a2-f241468004cd\") " pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:47.178974 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.178953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:47.229743 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.229709    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclth"]
Jul 05 19:39:47.303019 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.302948    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclth"]
Jul 05 19:39:47.305177 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:39:47.305149    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55b8c72_17a7_4b87_96a2_f241468004cd.slice/crio-6809548ee725f445eab3fd297f7e487f311bdd30f44370258abc375924ac1d58 WatchSource:0}: Error finding container 6809548ee725f445eab3fd297f7e487f311bdd30f44370258abc375924ac1d58: Status 404 returned error can't find the container with id 6809548ee725f445eab3fd297f7e487f311bdd30f44370258abc375924ac1d58
Jul 05 19:39:47.435848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.435821    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k6lnm"]
Jul 05 19:39:47.440530 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.440514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:47.447209 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.447185    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k6lnm"]
Jul 05 19:39:47.548978 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.548949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclth" event={"ID":"a55b8c72-17a7-4b87-96a2-f241468004cd","Type":"ContainerStarted","Data":"6809548ee725f445eab3fd297f7e487f311bdd30f44370258abc375924ac1d58"}
Jul 05 19:39:47.621365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.621295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq4xw\" (UniqueName: \"kubernetes.io/projected/4f31c1fe-4669-4b74-b038-958f150ae92b-kube-api-access-rq4xw\") pod \"kuadrant-operator-catalog-k6lnm\" (UID: \"4f31c1fe-4669-4b74-b038-958f150ae92b\") " pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:47.722015 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.721979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq4xw\" (UniqueName: \"kubernetes.io/projected/4f31c1fe-4669-4b74-b038-958f150ae92b-kube-api-access-rq4xw\") pod \"kuadrant-operator-catalog-k6lnm\" (UID: \"4f31c1fe-4669-4b74-b038-958f150ae92b\") " pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:47.735155 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.735129    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq4xw\" (UniqueName: \"kubernetes.io/projected/4f31c1fe-4669-4b74-b038-958f150ae92b-kube-api-access-rq4xw\") pod \"kuadrant-operator-catalog-k6lnm\" (UID: \"4f31c1fe-4669-4b74-b038-958f150ae92b\") " pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:47.747669 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.747644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:47.750386 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.750373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:47.864765 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.864736    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:39:47.889140 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:47.889118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k6lnm"]
Jul 05 19:39:47.890691 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:39:47.890658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f31c1fe_4669_4b74_b038_958f150ae92b.slice/crio-4673b6607ac070edce3fb2077dd45e049190f54644ac96245629f3fba3e8f893 WatchSource:0}: Error finding container 4673b6607ac070edce3fb2077dd45e049190f54644ac96245629f3fba3e8f893: Status 404 returned error can't find the container with id 4673b6607ac070edce3fb2077dd45e049190f54644ac96245629f3fba3e8f893
Jul 05 19:39:48.557351 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:48.557248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm" event={"ID":"4f31c1fe-4669-4b74-b038-958f150ae92b","Type":"ContainerStarted","Data":"4673b6607ac070edce3fb2077dd45e049190f54644ac96245629f3fba3e8f893"}
Jul 05 19:39:49.563979 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.563890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclth" event={"ID":"a55b8c72-17a7-4b87-96a2-f241468004cd","Type":"ContainerStarted","Data":"4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00"}
Jul 05 19:39:49.563979 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.563955    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kclth" podUID="a55b8c72-17a7-4b87-96a2-f241468004cd" containerName="registry-server" containerID="cri-o://4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00" gracePeriod=2
Jul 05 19:39:49.565399 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.565378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm" event={"ID":"4f31c1fe-4669-4b74-b038-958f150ae92b","Type":"ContainerStarted","Data":"c97ef6c9e084e47731fb5fe680ac9b8d8e90e6247d9703eda7f7d33e08d9120c"}
Jul 05 19:39:49.581902 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.581864    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kclth" podStartSLOduration=1.646131907 podStartE2EDuration="3.581849637s" totalImagesPullingTime="1.93571773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:49.581155591 +0000 UTC m=+434.403646275" watchObservedRunningTime="2026-07-05 19:39:49.581849637 +0000 UTC m=+434.404340321"
Jul 05 19:39:49.599195 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.599158    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm" podStartSLOduration=1.248269048 podStartE2EDuration="2.599145166s" totalImagesPullingTime="1.350876118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:49.597518772 +0000 UTC m=+434.420009456" watchObservedRunningTime="2026-07-05 19:39:49.599145166 +0000 UTC m=+434.421635848"
Jul 05 19:39:49.802670 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.802646    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:49.943615 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.943538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk5m7\" (UniqueName: \"kubernetes.io/projected/a55b8c72-17a7-4b87-96a2-f241468004cd-kube-api-access-gk5m7\") pod \"a55b8c72-17a7-4b87-96a2-f241468004cd\" (UID: \"a55b8c72-17a7-4b87-96a2-f241468004cd\") "
Jul 05 19:39:49.945604 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:49.945577    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a55b8c72-17a7-4b87-96a2-f241468004cd-kube-api-access-gk5m7" (OuterVolumeSpecName: "kube-api-access-gk5m7") pod "a55b8c72-17a7-4b87-96a2-f241468004cd" (UID: "a55b8c72-17a7-4b87-96a2-f241468004cd"). InnerVolumeSpecName "kube-api-access-gk5m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:39:50.044284 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.044245    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk5m7\" (UniqueName: \"kubernetes.io/projected/a55b8c72-17a7-4b87-96a2-f241468004cd-kube-api-access-gk5m7\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:39:50.570770 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.570694    2579 generic.go:356] "Generic (PLEG): container finished" podID="a55b8c72-17a7-4b87-96a2-f241468004cd" containerID="4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00" exitCode=0
Jul 05 19:39:50.570770 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.570733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclth" event={"ID":"a55b8c72-17a7-4b87-96a2-f241468004cd","Type":"ContainerDied","Data":"4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00"}
Jul 05 19:39:50.571202 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.570788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclth" event={"ID":"a55b8c72-17a7-4b87-96a2-f241468004cd","Type":"ContainerDied","Data":"6809548ee725f445eab3fd297f7e487f311bdd30f44370258abc375924ac1d58"}
Jul 05 19:39:50.571202 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.570831    2579 scope.go:117] "RemoveContainer" containerID="4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00"
Jul 05 19:39:50.571202 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.570743    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclth"
Jul 05 19:39:50.579136 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.579111    2579 scope.go:117] "RemoveContainer" containerID="4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00"
Jul 05 19:39:50.579376 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:39:50.579358    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00\": container with ID starting with 4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00 not found: ID does not exist" containerID="4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00"
Jul 05 19:39:50.579425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.579385    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00"} err="failed to get container status \"4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00\": rpc error: code = NotFound desc = could not find container \"4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00\": container with ID starting with 4ba43fe2e6f756a37a72d52c8434e951b95152999d44b85c0f00f799689adb00 not found: ID does not exist"
Jul 05 19:39:50.591078 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.591053    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclth"]
Jul 05 19:39:50.593024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:50.593006    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclth"]
Jul 05 19:39:51.616972 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:51.616943    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a55b8c72-17a7-4b87-96a2-f241468004cd" path="/var/lib/kubelet/pods/a55b8c72-17a7-4b87-96a2-f241468004cd/volumes"
Jul 05 19:39:57.751547 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:57.751514    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:57.752120 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:57.751564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:57.773686 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:57.773664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:39:58.624677 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:39:58.624652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k6lnm"
Jul 05 19:40:02.468216 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.468173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"]
Jul 05 19:40:02.468664 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.468619    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a55b8c72-17a7-4b87-96a2-f241468004cd" containerName="registry-server"
Jul 05 19:40:02.468664 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.468638    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55b8c72-17a7-4b87-96a2-f241468004cd" containerName="registry-server"
Jul 05 19:40:02.468790 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.468727    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a55b8c72-17a7-4b87-96a2-f241468004cd" containerName="registry-server"
Jul 05 19:40:02.471786 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.471765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.474496 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.474479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kb27n\""
Jul 05 19:40:02.478584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.478563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"]
Jul 05 19:40:02.536002 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.535979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.536096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.536011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.536096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.536045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5txtb\" (UniqueName: \"kubernetes.io/projected/d0753d03-6989-4cfe-8373-27eddefdc749-kube-api-access-5txtb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.636527 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.636498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.636664 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.636538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.636664 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.636575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5txtb\" (UniqueName: \"kubernetes.io/projected/d0753d03-6989-4cfe-8373-27eddefdc749-kube-api-access-5txtb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.636877 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.636860    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.636926 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.636889    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.645048 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.645025    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5txtb\" (UniqueName: \"kubernetes.io/projected/d0753d03-6989-4cfe-8373-27eddefdc749-kube-api-access-5txtb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.781046 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.781023    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:02.903733 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:02.903708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"]
Jul 05 19:40:02.906131 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:02.906105    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0753d03_6989_4cfe_8373_27eddefdc749.slice/crio-7504c3888b65c8f3d154a8a8ba88afe0dce6aa7d47785f1e3f0abdfe3f710ccd WatchSource:0}: Error finding container 7504c3888b65c8f3d154a8a8ba88afe0dce6aa7d47785f1e3f0abdfe3f710ccd: Status 404 returned error can't find the container with id 7504c3888b65c8f3d154a8a8ba88afe0dce6aa7d47785f1e3f0abdfe3f710ccd
Jul 05 19:40:03.067782 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.067726    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"]
Jul 05 19:40:03.071095 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.071080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.079606 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.079586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"]
Jul 05 19:40:03.141216 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.141193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.141332 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.141228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jp4\" (UniqueName: \"kubernetes.io/projected/13a272e1-a136-4d52-a27c-c71f63ba7d2c-kube-api-access-q5jp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.141332 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.141248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.241818 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.241765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.241919 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.241825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jp4\" (UniqueName: \"kubernetes.io/projected/13a272e1-a136-4d52-a27c-c71f63ba7d2c-kube-api-access-q5jp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.241919 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.241849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.242111 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.242095    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.242186 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.242172    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.250315 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.250290    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jp4\" (UniqueName: \"kubernetes.io/projected/13a272e1-a136-4d52-a27c-c71f63ba7d2c-kube-api-access-q5jp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.379907 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.379858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:03.472087 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.472059    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"]
Jul 05 19:40:03.476692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.476671    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.482960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.482938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"]
Jul 05 19:40:03.510031 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.510002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"]
Jul 05 19:40:03.512154 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:03.512131    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a272e1_a136_4d52_a27c_c71f63ba7d2c.slice/crio-db665026c1d4673de9cd3370e4fca742cf7dbed07a55ef59f26091d317905f4c WatchSource:0}: Error finding container db665026c1d4673de9cd3370e4fca742cf7dbed07a55ef59f26091d317905f4c: Status 404 returned error can't find the container with id db665026c1d4673de9cd3370e4fca742cf7dbed07a55ef59f26091d317905f4c
Jul 05 19:40:03.543767 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.543746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl724\" (UniqueName: \"kubernetes.io/projected/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-kube-api-access-jl724\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.543870 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.543787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.543870 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.543825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.624754 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.624730    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0753d03-6989-4cfe-8373-27eddefdc749" containerID="43a168e00364af07deebb176c86fffd4dd2651deea4ca8e4e3a4f8661680b45c" exitCode=0
Jul 05 19:40:03.624878 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.624824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8" event={"ID":"d0753d03-6989-4cfe-8373-27eddefdc749","Type":"ContainerDied","Data":"43a168e00364af07deebb176c86fffd4dd2651deea4ca8e4e3a4f8661680b45c"}
Jul 05 19:40:03.624878 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.624867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8" event={"ID":"d0753d03-6989-4cfe-8373-27eddefdc749","Type":"ContainerStarted","Data":"7504c3888b65c8f3d154a8a8ba88afe0dce6aa7d47785f1e3f0abdfe3f710ccd"}
Jul 05 19:40:03.626283 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.626262    2579 generic.go:356] "Generic (PLEG): container finished" podID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerID="cb83205b49f8872b4aef492688a21076fa9b9b2cd25b2a210afe11e81278af35" exitCode=0
Jul 05 19:40:03.626364 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.626343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp" event={"ID":"13a272e1-a136-4d52-a27c-c71f63ba7d2c","Type":"ContainerDied","Data":"cb83205b49f8872b4aef492688a21076fa9b9b2cd25b2a210afe11e81278af35"}
Jul 05 19:40:03.626402 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.626384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp" event={"ID":"13a272e1-a136-4d52-a27c-c71f63ba7d2c","Type":"ContainerStarted","Data":"db665026c1d4673de9cd3370e4fca742cf7dbed07a55ef59f26091d317905f4c"}
Jul 05 19:40:03.644564 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.644520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl724\" (UniqueName: \"kubernetes.io/projected/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-kube-api-access-jl724\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.644564 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.644558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.644680 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.644583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.645367 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.645340    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.645455 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.645353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.652835 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.652812    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl724\" (UniqueName: \"kubernetes.io/projected/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-kube-api-access-jl724\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.788224 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.788201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:03.869400 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.869364    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"]
Jul 05 19:40:03.874332 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.874307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:03.879295 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.879271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"]
Jul 05 19:40:03.919758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.919737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"]
Jul 05 19:40:03.921907 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:03.921874    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c206bb_4053_4c92_aa06_85c7e0d9f5df.slice/crio-d16e3c5b034b0b4731b4a5858cb67cab886a8530262216eb385d32387b0a2eab WatchSource:0}: Error finding container d16e3c5b034b0b4731b4a5858cb67cab886a8530262216eb385d32387b0a2eab: Status 404 returned error can't find the container with id d16e3c5b034b0b4731b4a5858cb67cab886a8530262216eb385d32387b0a2eab
Jul 05 19:40:03.946735 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.946712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:03.946836 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.946746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:03.946836 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:03.946776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhg8w\" (UniqueName: \"kubernetes.io/projected/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-kube-api-access-dhg8w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.048173 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.048146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.048302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.048188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.048302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.048219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhg8w\" (UniqueName: \"kubernetes.io/projected/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-kube-api-access-dhg8w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.048477 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.048456    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.048544 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.048499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.058415 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.058397    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhg8w\" (UniqueName: \"kubernetes.io/projected/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-kube-api-access-dhg8w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.185257 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.185195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:04.451007 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.450977    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"]
Jul 05 19:40:04.455014 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:04.454992    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac459dd3_7f8d_4a24_8a32_0a6302b5f569.slice/crio-7a0d51c230b2f0d7ac122a9b1c382f7bb133deccb4ba28396b5f331ba1fdd8cd WatchSource:0}: Error finding container 7a0d51c230b2f0d7ac122a9b1c382f7bb133deccb4ba28396b5f331ba1fdd8cd: Status 404 returned error can't find the container with id 7a0d51c230b2f0d7ac122a9b1c382f7bb133deccb4ba28396b5f331ba1fdd8cd
Jul 05 19:40:04.633241 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.633211    2579 generic.go:356] "Generic (PLEG): container finished" podID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerID="c309bab3e270fe48768d116ad7d07c1bc97cb5fd49fd4e63ec02066fca3551fd" exitCode=0
Jul 05 19:40:04.633633 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.633303    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h" event={"ID":"c2c206bb-4053-4c92-aa06-85c7e0d9f5df","Type":"ContainerDied","Data":"c309bab3e270fe48768d116ad7d07c1bc97cb5fd49fd4e63ec02066fca3551fd"}
Jul 05 19:40:04.633633 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.633358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h" event={"ID":"c2c206bb-4053-4c92-aa06-85c7e0d9f5df","Type":"ContainerStarted","Data":"d16e3c5b034b0b4731b4a5858cb67cab886a8530262216eb385d32387b0a2eab"}
Jul 05 19:40:04.635605 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.635585    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0753d03-6989-4cfe-8373-27eddefdc749" containerID="5c097601dce3510f764017b514c6bcfabe2b90260ab87abeb60f2e3ea1c6b00c" exitCode=0
Jul 05 19:40:04.635697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.635618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8" event={"ID":"d0753d03-6989-4cfe-8373-27eddefdc749","Type":"ContainerDied","Data":"5c097601dce3510f764017b514c6bcfabe2b90260ab87abeb60f2e3ea1c6b00c"}
Jul 05 19:40:04.637782 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.637759    2579 generic.go:356] "Generic (PLEG): container finished" podID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerID="6c2b6b404c394a74cf086a06b421dece4fea248cd4581d1ef0e6c83dd01ef37e" exitCode=0
Jul 05 19:40:04.637892 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.637834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp" event={"ID":"13a272e1-a136-4d52-a27c-c71f63ba7d2c","Type":"ContainerDied","Data":"6c2b6b404c394a74cf086a06b421dece4fea248cd4581d1ef0e6c83dd01ef37e"}
Jul 05 19:40:04.639821 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.639762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb" event={"ID":"ac459dd3-7f8d-4a24-8a32-0a6302b5f569","Type":"ContainerStarted","Data":"bd22e129c79c9c8f2a9f8aedcdf2560db4dcf369cc21eaf0aba788842455b269"}
Jul 05 19:40:04.639914 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:04.639827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb" event={"ID":"ac459dd3-7f8d-4a24-8a32-0a6302b5f569","Type":"ContainerStarted","Data":"7a0d51c230b2f0d7ac122a9b1c382f7bb133deccb4ba28396b5f331ba1fdd8cd"}
Jul 05 19:40:05.646814 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.646720    2579 generic.go:356] "Generic (PLEG): container finished" podID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerID="7af9a5436997fb5968e0e2e337e98679f73c7a93f83c10f72f59e9b887ddc6d3" exitCode=0
Jul 05 19:40:05.647248 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.646819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp" event={"ID":"13a272e1-a136-4d52-a27c-c71f63ba7d2c","Type":"ContainerDied","Data":"7af9a5436997fb5968e0e2e337e98679f73c7a93f83c10f72f59e9b887ddc6d3"}
Jul 05 19:40:05.648415 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.648391    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerID="bd22e129c79c9c8f2a9f8aedcdf2560db4dcf369cc21eaf0aba788842455b269" exitCode=0
Jul 05 19:40:05.648537 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.648460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb" event={"ID":"ac459dd3-7f8d-4a24-8a32-0a6302b5f569","Type":"ContainerDied","Data":"bd22e129c79c9c8f2a9f8aedcdf2560db4dcf369cc21eaf0aba788842455b269"}
Jul 05 19:40:05.650189 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.650166    2579 generic.go:356] "Generic (PLEG): container finished" podID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerID="81cf86c30f5514ebf20a24ee0ea7ba697cf6141ead5b7452c63c92ca43349a8d" exitCode=0
Jul 05 19:40:05.650288 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.650246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h" event={"ID":"c2c206bb-4053-4c92-aa06-85c7e0d9f5df","Type":"ContainerDied","Data":"81cf86c30f5514ebf20a24ee0ea7ba697cf6141ead5b7452c63c92ca43349a8d"}
Jul 05 19:40:05.659037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.659009    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0753d03-6989-4cfe-8373-27eddefdc749" containerID="87d799d361c2987bf8ed16bdd8af264c1f4ee34c8e18e3e863a799806515098f" exitCode=0
Jul 05 19:40:05.659108 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:05.659058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8" event={"ID":"d0753d03-6989-4cfe-8373-27eddefdc749","Type":"ContainerDied","Data":"87d799d361c2987bf8ed16bdd8af264c1f4ee34c8e18e3e863a799806515098f"}
Jul 05 19:40:06.665533 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.665448    2579 generic.go:356] "Generic (PLEG): container finished" podID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerID="58fbe8ecf8e22a8b8ec97b142a2540c87982fd6624f0c0528bc4cb8bc439e21a" exitCode=0
Jul 05 19:40:06.665533 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.665518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h" event={"ID":"c2c206bb-4053-4c92-aa06-85c7e0d9f5df","Type":"ContainerDied","Data":"58fbe8ecf8e22a8b8ec97b142a2540c87982fd6624f0c0528bc4cb8bc439e21a"}
Jul 05 19:40:06.667299 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.667281    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerID="12375474656bbe11da75dccc637cc32df373b8a447a6408ca2b735e796bbf769" exitCode=0
Jul 05 19:40:06.667376 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.667310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb" event={"ID":"ac459dd3-7f8d-4a24-8a32-0a6302b5f569","Type":"ContainerDied","Data":"12375474656bbe11da75dccc637cc32df373b8a447a6408ca2b735e796bbf769"}
Jul 05 19:40:06.872955 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.872933    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:06.885356 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.885338    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:06.972970 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.972883    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-bundle\") pod \"d0753d03-6989-4cfe-8373-27eddefdc749\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") "
Jul 05 19:40:06.972970 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.972924    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5jp4\" (UniqueName: \"kubernetes.io/projected/13a272e1-a136-4d52-a27c-c71f63ba7d2c-kube-api-access-q5jp4\") pod \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") "
Jul 05 19:40:06.972970 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.972951    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-util\") pod \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") "
Jul 05 19:40:06.973217 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.972996    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-util\") pod \"d0753d03-6989-4cfe-8373-27eddefdc749\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") "
Jul 05 19:40:06.973217 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.973022    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-bundle\") pod \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\" (UID: \"13a272e1-a136-4d52-a27c-c71f63ba7d2c\") "
Jul 05 19:40:06.973217 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.973098    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5txtb\" (UniqueName: \"kubernetes.io/projected/d0753d03-6989-4cfe-8373-27eddefdc749-kube-api-access-5txtb\") pod \"d0753d03-6989-4cfe-8373-27eddefdc749\" (UID: \"d0753d03-6989-4cfe-8373-27eddefdc749\") "
Jul 05 19:40:06.973640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.973613    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-bundle" (OuterVolumeSpecName: "bundle") pod "d0753d03-6989-4cfe-8373-27eddefdc749" (UID: "d0753d03-6989-4cfe-8373-27eddefdc749"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:06.973758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.973649    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-bundle" (OuterVolumeSpecName: "bundle") pod "13a272e1-a136-4d52-a27c-c71f63ba7d2c" (UID: "13a272e1-a136-4d52-a27c-c71f63ba7d2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:06.975096 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.975071    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a272e1-a136-4d52-a27c-c71f63ba7d2c-kube-api-access-q5jp4" (OuterVolumeSpecName: "kube-api-access-q5jp4") pod "13a272e1-a136-4d52-a27c-c71f63ba7d2c" (UID: "13a272e1-a136-4d52-a27c-c71f63ba7d2c"). InnerVolumeSpecName "kube-api-access-q5jp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:06.975557 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.975539    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0753d03-6989-4cfe-8373-27eddefdc749-kube-api-access-5txtb" (OuterVolumeSpecName: "kube-api-access-5txtb") pod "d0753d03-6989-4cfe-8373-27eddefdc749" (UID: "d0753d03-6989-4cfe-8373-27eddefdc749"). InnerVolumeSpecName "kube-api-access-5txtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:06.979004 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.978982    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-util" (OuterVolumeSpecName: "util") pod "13a272e1-a136-4d52-a27c-c71f63ba7d2c" (UID: "13a272e1-a136-4d52-a27c-c71f63ba7d2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:06.981756 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:06.981731    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-util" (OuterVolumeSpecName: "util") pod "d0753d03-6989-4cfe-8373-27eddefdc749" (UID: "d0753d03-6989-4cfe-8373-27eddefdc749"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:07.074111 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.074084    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.074111 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.074110    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5jp4\" (UniqueName: \"kubernetes.io/projected/13a272e1-a136-4d52-a27c-c71f63ba7d2c-kube-api-access-q5jp4\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.074229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.074121    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.074229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.074135    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0753d03-6989-4cfe-8373-27eddefdc749-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.074229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.074144    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13a272e1-a136-4d52-a27c-c71f63ba7d2c-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.074229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.074151    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5txtb\" (UniqueName: \"kubernetes.io/projected/d0753d03-6989-4cfe-8373-27eddefdc749-kube-api-access-5txtb\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.674296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.674274    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8"
Jul 05 19:40:07.674296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.674278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8" event={"ID":"d0753d03-6989-4cfe-8373-27eddefdc749","Type":"ContainerDied","Data":"7504c3888b65c8f3d154a8a8ba88afe0dce6aa7d47785f1e3f0abdfe3f710ccd"}
Jul 05 19:40:07.674694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.674317    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7504c3888b65c8f3d154a8a8ba88afe0dce6aa7d47785f1e3f0abdfe3f710ccd"
Jul 05 19:40:07.676601 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.676576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp" event={"ID":"13a272e1-a136-4d52-a27c-c71f63ba7d2c","Type":"ContainerDied","Data":"db665026c1d4673de9cd3370e4fca742cf7dbed07a55ef59f26091d317905f4c"}
Jul 05 19:40:07.676718 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.676611    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db665026c1d4673de9cd3370e4fca742cf7dbed07a55ef59f26091d317905f4c"
Jul 05 19:40:07.676718 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.676685    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp"
Jul 05 19:40:07.678910 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.678891    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerID="76b6b3e47973aaa15a848ee43d8e4b1e59f1141ee3ad91d9153b81421cdca295" exitCode=0
Jul 05 19:40:07.679005 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.678954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb" event={"ID":"ac459dd3-7f8d-4a24-8a32-0a6302b5f569","Type":"ContainerDied","Data":"76b6b3e47973aaa15a848ee43d8e4b1e59f1141ee3ad91d9153b81421cdca295"}
Jul 05 19:40:07.798330 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.798306    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:07.879752 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.879684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-util\") pod \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") "
Jul 05 19:40:07.879752 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.879738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-bundle\") pod \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") "
Jul 05 19:40:07.879917 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.879760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl724\" (UniqueName: \"kubernetes.io/projected/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-kube-api-access-jl724\") pod \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\" (UID: \"c2c206bb-4053-4c92-aa06-85c7e0d9f5df\") "
Jul 05 19:40:07.880276 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.880254    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-bundle" (OuterVolumeSpecName: "bundle") pod "c2c206bb-4053-4c92-aa06-85c7e0d9f5df" (UID: "c2c206bb-4053-4c92-aa06-85c7e0d9f5df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:07.881864 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.881826    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-kube-api-access-jl724" (OuterVolumeSpecName: "kube-api-access-jl724") pod "c2c206bb-4053-4c92-aa06-85c7e0d9f5df" (UID: "c2c206bb-4053-4c92-aa06-85c7e0d9f5df"). InnerVolumeSpecName "kube-api-access-jl724". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:07.885194 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.885157    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-util" (OuterVolumeSpecName: "util") pod "c2c206bb-4053-4c92-aa06-85c7e0d9f5df" (UID: "c2c206bb-4053-4c92-aa06-85c7e0d9f5df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:07.980857 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.980832    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.980857 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.980854    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:07.980857 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:07.980862    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl724\" (UniqueName: \"kubernetes.io/projected/c2c206bb-4053-4c92-aa06-85c7e0d9f5df-kube-api-access-jl724\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:08.685276 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.685249    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h"
Jul 05 19:40:08.685642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.685275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h" event={"ID":"c2c206bb-4053-4c92-aa06-85c7e0d9f5df","Type":"ContainerDied","Data":"d16e3c5b034b0b4731b4a5858cb67cab886a8530262216eb385d32387b0a2eab"}
Jul 05 19:40:08.685642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.685315    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d16e3c5b034b0b4731b4a5858cb67cab886a8530262216eb385d32387b0a2eab"
Jul 05 19:40:08.807913 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.807889    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:08.887818 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.887774    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-bundle\") pod \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") "
Jul 05 19:40:08.887958 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.887833    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-util\") pod \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") "
Jul 05 19:40:08.887958 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.887897    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhg8w\" (UniqueName: \"kubernetes.io/projected/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-kube-api-access-dhg8w\") pod \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\" (UID: \"ac459dd3-7f8d-4a24-8a32-0a6302b5f569\") "
Jul 05 19:40:08.888264 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.888242    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-bundle" (OuterVolumeSpecName: "bundle") pod "ac459dd3-7f8d-4a24-8a32-0a6302b5f569" (UID: "ac459dd3-7f8d-4a24-8a32-0a6302b5f569"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:08.889902 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.889875    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-kube-api-access-dhg8w" (OuterVolumeSpecName: "kube-api-access-dhg8w") pod "ac459dd3-7f8d-4a24-8a32-0a6302b5f569" (UID: "ac459dd3-7f8d-4a24-8a32-0a6302b5f569"). InnerVolumeSpecName "kube-api-access-dhg8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:08.896214 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.896190    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-util" (OuterVolumeSpecName: "util") pod "ac459dd3-7f8d-4a24-8a32-0a6302b5f569" (UID: "ac459dd3-7f8d-4a24-8a32-0a6302b5f569"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:08.989169 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.989145    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhg8w\" (UniqueName: \"kubernetes.io/projected/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-kube-api-access-dhg8w\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:08.989244 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.989169    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:08.989244 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:08.989178    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac459dd3-7f8d-4a24-8a32-0a6302b5f569-util\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:09.691099 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:09.691077    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb"
Jul 05 19:40:09.691099 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:09.691081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb" event={"ID":"ac459dd3-7f8d-4a24-8a32-0a6302b5f569","Type":"ContainerDied","Data":"7a0d51c230b2f0d7ac122a9b1c382f7bb133deccb4ba28396b5f331ba1fdd8cd"}
Jul 05 19:40:09.691456 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:09.691120    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a0d51c230b2f0d7ac122a9b1c382f7bb133deccb4ba28396b5f331ba1fdd8cd"
Jul 05 19:40:15.883945 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:15.883866    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:18.301266 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301227    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"]
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301645    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="util"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301662    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="util"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301672    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="pull"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301679    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="pull"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301700    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="util"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301708    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="util"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301717    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="util"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301725    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="util"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301735    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="extract"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301742    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="extract"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301751    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="extract"
Jul 05 19:40:18.301758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301760    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301780    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301788    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301820    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="pull"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301830    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="pull"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301838    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="util"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301846    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="util"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301860    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="pull"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301868    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="pull"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301877    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="pull"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301886    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="pull"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301895    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301903    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301984    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0753d03-6989-4cfe-8373-27eddefdc749" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.301995    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a272e1-a136-4d52-a27c-c71f63ba7d2c" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.302005    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac459dd3-7f8d-4a24-8a32-0a6302b5f569" containerName="extract"
Jul 05 19:40:18.302343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.302015    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2c206bb-4053-4c92-aa06-85c7e0d9f5df" containerName="extract"
Jul 05 19:40:18.308119 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.308098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:18.310946 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.310924    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 05 19:40:18.311054 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.310961    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nqmr9\""
Jul 05 19:40:18.317139 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.317115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"]
Jul 05 19:40:18.366345 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.366309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6cm6\" (UniqueName: \"kubernetes.io/projected/22544d28-e424-4104-8399-28db8385bc07-kube-api-access-l6cm6\") pod \"dns-operator-controller-manager-864dd78c4c-4rvff\" (UID: \"22544d28-e424-4104-8399-28db8385bc07\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:18.466722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.466690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6cm6\" (UniqueName: \"kubernetes.io/projected/22544d28-e424-4104-8399-28db8385bc07-kube-api-access-l6cm6\") pod \"dns-operator-controller-manager-864dd78c4c-4rvff\" (UID: \"22544d28-e424-4104-8399-28db8385bc07\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:18.480025 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.479999    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6cm6\" (UniqueName: \"kubernetes.io/projected/22544d28-e424-4104-8399-28db8385bc07-kube-api-access-l6cm6\") pod \"dns-operator-controller-manager-864dd78c4c-4rvff\" (UID: \"22544d28-e424-4104-8399-28db8385bc07\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:18.619089 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.619026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:18.749272 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:18.749251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"]
Jul 05 19:40:18.751276 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:18.751255    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22544d28_e424_4104_8399_28db8385bc07.slice/crio-10da04aa184547ffb0fdf3790403204f89b869e55523dd3149a4c4dbd5dac747 WatchSource:0}: Error finding container 10da04aa184547ffb0fdf3790403204f89b869e55523dd3149a4c4dbd5dac747: Status 404 returned error can't find the container with id 10da04aa184547ffb0fdf3790403204f89b869e55523dd3149a4c4dbd5dac747
Jul 05 19:40:19.120567 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:19.120537    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:19.738543 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:19.738505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff" event={"ID":"22544d28-e424-4104-8399-28db8385bc07","Type":"ContainerStarted","Data":"10da04aa184547ffb0fdf3790403204f89b869e55523dd3149a4c4dbd5dac747"}
Jul 05 19:40:21.749456 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:21.749419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff" event={"ID":"22544d28-e424-4104-8399-28db8385bc07","Type":"ContainerStarted","Data":"ac29b7d420a6060dd740411da6362a3a00e67eaeaea3c94a9b07732a4abf96b0"}
Jul 05 19:40:21.749845 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:21.749561    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:21.768372 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:21.768322    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff" podStartSLOduration=1.7906923369999999 podStartE2EDuration="3.768307372s" totalImagesPullingTime="1.977615035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:21.766864893 +0000 UTC m=+466.589355576" watchObservedRunningTime="2026-07-05 19:40:21.768307372 +0000 UTC m=+466.590798053"
Jul 05 19:40:23.544088 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.544055    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"]
Jul 05 19:40:23.550199 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.550182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.553175 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.553154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f6tz9\""
Jul 05 19:40:23.559911 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.559890    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"]
Jul 05 19:40:23.613903 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.613876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047db77f-6956-4515-9ca2-e9fb98fe8eb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.613992 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.613915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd82c\" (UniqueName: \"kubernetes.io/projected/047db77f-6956-4515-9ca2-e9fb98fe8eb3-kube-api-access-fd82c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.714607 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.714572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047db77f-6956-4515-9ca2-e9fb98fe8eb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.714743 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.714630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd82c\" (UniqueName: \"kubernetes.io/projected/047db77f-6956-4515-9ca2-e9fb98fe8eb3-kube-api-access-fd82c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.715047 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.715025    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047db77f-6956-4515-9ca2-e9fb98fe8eb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.727597 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.727574    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd82c\" (UniqueName: \"kubernetes.io/projected/047db77f-6956-4515-9ca2-e9fb98fe8eb3-kube-api-access-fd82c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.860601 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.860537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:23.994888 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:23.994864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"]
Jul 05 19:40:23.996717 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:23.996685    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047db77f_6956_4515_9ca2_e9fb98fe8eb3.slice/crio-790b745d5fbabe9b8cc197452241beae44c6393bd89ccca20b2c809bd3a405bf WatchSource:0}: Error finding container 790b745d5fbabe9b8cc197452241beae44c6393bd89ccca20b2c809bd3a405bf: Status 404 returned error can't find the container with id 790b745d5fbabe9b8cc197452241beae44c6393bd89ccca20b2c809bd3a405bf
Jul 05 19:40:24.487446 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:24.487411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:24.763972 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:24.763860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9" event={"ID":"047db77f-6956-4515-9ca2-e9fb98fe8eb3","Type":"ContainerStarted","Data":"790b745d5fbabe9b8cc197452241beae44c6393bd89ccca20b2c809bd3a405bf"}
Jul 05 19:40:25.788365 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.788335    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c899977f6-g2kjj"]
Jul 05 19:40:25.792228 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.792211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.807973 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.807947    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c899977f6-g2kjj"]
Jul 05 19:40:25.849937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.849903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:25.933015 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.932984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-trusted-ca-bundle\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.933124 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.933018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-service-ca\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.933124 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.933042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpcx\" (UniqueName: \"kubernetes.io/projected/c970216e-d9ff-4ff6-ac9a-0905a29019e6-kube-api-access-twpcx\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.933198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.933142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-oauth-config\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.933198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.933169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-config\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.933263 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.933208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-serving-cert\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.933263 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.933248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-oauth-serving-cert\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:25.949181 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:25.949146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:26.033725 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.033699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-oauth-config\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.033989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.033736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-config\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.033989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.033773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-serving-cert\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.033989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.033845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-oauth-serving-cert\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.033989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.033881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-trusted-ca-bundle\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.033989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.033909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-service-ca\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.034250 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.034061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twpcx\" (UniqueName: \"kubernetes.io/projected/c970216e-d9ff-4ff6-ac9a-0905a29019e6-kube-api-access-twpcx\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.034571 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.034551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-service-ca\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.034637 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.034575    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-config\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.034637 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.034595    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-oauth-serving-cert\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.034871 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.034847    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c970216e-d9ff-4ff6-ac9a-0905a29019e6-trusted-ca-bundle\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.035967 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.035948    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-oauth-config\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.036364 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.036348    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c970216e-d9ff-4ff6-ac9a-0905a29019e6-console-serving-cert\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.041647 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.041585    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpcx\" (UniqueName: \"kubernetes.io/projected/c970216e-d9ff-4ff6-ac9a-0905a29019e6-kube-api-access-twpcx\") pod \"console-6c899977f6-g2kjj\" (UID: \"c970216e-d9ff-4ff6-ac9a-0905a29019e6\") " pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.102120 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.102098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:26.244758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.244732    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c899977f6-g2kjj"]
Jul 05 19:40:26.246997 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:26.246966    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc970216e_d9ff_4ff6_ac9a_0905a29019e6.slice/crio-86aa13d60359798353a42d09e9ec276ea8f91051438f8afb23936d347098bc07 WatchSource:0}: Error finding container 86aa13d60359798353a42d09e9ec276ea8f91051438f8afb23936d347098bc07: Status 404 returned error can't find the container with id 86aa13d60359798353a42d09e9ec276ea8f91051438f8afb23936d347098bc07
Jul 05 19:40:26.433616 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.433584    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"]
Jul 05 19:40:26.437564 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.437536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:26.440285 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.440261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qsjhl\""
Jul 05 19:40:26.448194 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.448119    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"]
Jul 05 19:40:26.539090 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.539053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75mh\" (UniqueName: \"kubernetes.io/projected/e0a46688-8892-4076-8d8a-73405a97aad0-kube-api-access-m75mh\") pod \"limitador-operator-controller-manager-859d7b78bd-pjtck\" (UID: \"e0a46688-8892-4076-8d8a-73405a97aad0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:26.639985 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.639900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m75mh\" (UniqueName: \"kubernetes.io/projected/e0a46688-8892-4076-8d8a-73405a97aad0-kube-api-access-m75mh\") pod \"limitador-operator-controller-manager-859d7b78bd-pjtck\" (UID: \"e0a46688-8892-4076-8d8a-73405a97aad0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:26.652716 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.652688    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75mh\" (UniqueName: \"kubernetes.io/projected/e0a46688-8892-4076-8d8a-73405a97aad0-kube-api-access-m75mh\") pod \"limitador-operator-controller-manager-859d7b78bd-pjtck\" (UID: \"e0a46688-8892-4076-8d8a-73405a97aad0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:26.722784 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.722750    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:26.749843 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.749821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:26.776642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.776610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c899977f6-g2kjj" event={"ID":"c970216e-d9ff-4ff6-ac9a-0905a29019e6","Type":"ContainerStarted","Data":"c6c938becc6fa954ba38fe19e3d46175f68d986f456c8d70505f04f5d62a467f"}
Jul 05 19:40:26.776771 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.776664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c899977f6-g2kjj" event={"ID":"c970216e-d9ff-4ff6-ac9a-0905a29019e6","Type":"ContainerStarted","Data":"86aa13d60359798353a42d09e9ec276ea8f91051438f8afb23936d347098bc07"}
Jul 05 19:40:26.801012 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.800961    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c899977f6-g2kjj" podStartSLOduration=1.800944925 podStartE2EDuration="1.800944925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:26.798204392 +0000 UTC m=+471.620695075" watchObservedRunningTime="2026-07-05 19:40:26.800944925 +0000 UTC m=+471.623435666"
Jul 05 19:40:26.878490 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.878447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:26.895495 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:26.895471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"]
Jul 05 19:40:27.664024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:27.663990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:28.026786 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:28.026754    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a46688_8892_4076_8d8a_73405a97aad0.slice/crio-ecb80a7835ff70e7717d8f1f9bfe76cdca57e43f1b812149d33b712e3b4f913d WatchSource:0}: Error finding container ecb80a7835ff70e7717d8f1f9bfe76cdca57e43f1b812149d33b712e3b4f913d: Status 404 returned error can't find the container with id ecb80a7835ff70e7717d8f1f9bfe76cdca57e43f1b812149d33b712e3b4f913d
Jul 05 19:40:28.209116 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:28.209091    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:28.792054 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:28.792007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck" event={"ID":"e0a46688-8892-4076-8d8a-73405a97aad0","Type":"ContainerStarted","Data":"ecb80a7835ff70e7717d8f1f9bfe76cdca57e43f1b812149d33b712e3b4f913d"}
Jul 05 19:40:28.793766 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:28.793738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9" event={"ID":"047db77f-6956-4515-9ca2-e9fb98fe8eb3","Type":"ContainerStarted","Data":"0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb"}
Jul 05 19:40:28.794007 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:28.793980    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:28.820995 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:28.820939    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9" podStartSLOduration=1.735990153 podStartE2EDuration="5.820920703s" totalImagesPullingTime="4.08493055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:28.817253562 +0000 UTC m=+473.639744255" watchObservedRunningTime="2026-07-05 19:40:28.820920703 +0000 UTC m=+473.643411433"
Jul 05 19:40:29.801415 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:29.801379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck" event={"ID":"e0a46688-8892-4076-8d8a-73405a97aad0","Type":"ContainerStarted","Data":"5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae"}
Jul 05 19:40:29.801791 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:29.801579    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:29.819806 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:29.819759    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck" podStartSLOduration=2.210910153 podStartE2EDuration="3.81974424s" totalImagesPullingTime="1.608834087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:29.818492292 +0000 UTC m=+474.640982974" watchObservedRunningTime="2026-07-05 19:40:29.81974424 +0000 UTC m=+474.642234922"
Jul 05 19:40:29.916337 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:29.916258    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:30.947206 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:30.947173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:31.549710 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:31.549674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:32.503774 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:32.503748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:32.674955 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:32.674925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:32.756361 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:32.756296    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4rvff"
Jul 05 19:40:32.775148 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:32.775118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:35.327447 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:35.327402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:35.428807 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:35.428779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:36.102737 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.102691    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:36.102949 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.102756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:36.107687 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.107663    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:36.844574 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.844545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c899977f6-g2kjj"
Jul 05 19:40:36.893345 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.893316    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd54bb9d8-8b4ht"]
Jul 05 19:40:36.895123 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.895099    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:36.990040 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:36.990011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:37.091599 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:37.091568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:37.199377 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:37.199305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:39.803530 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:39.803501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:40.808007 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:40.807978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.362974 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.362937    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:41.462339 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.462308    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:41.575819 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.575774    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"]
Jul 05 19:40:41.575983 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.575957    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9" podUID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" containerName="manager" containerID="cri-o://0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb" gracePeriod=2
Jul 05 19:40:41.590343 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.590315    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"]
Jul 05 19:40:41.597629 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.597591    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"047db77f-6956-4515-9ca2-e9fb98fe8eb3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:41.600033 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.600009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"]
Jul 05 19:40:41.600332 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.600316    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" containerName="manager"
Jul 05 19:40:41.600414 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.600333    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" containerName="manager"
Jul 05 19:40:41.600472 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.600425    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" containerName="manager"
Jul 05 19:40:41.603695 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.603673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.610549 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.610529    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"]
Jul 05 19:40:41.610706 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.610687    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" containerName="manager" containerID="cri-o://5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae" gracePeriod=2
Jul 05 19:40:41.621247 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.621134    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"]
Jul 05 19:40:41.627422 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.627389    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"]
Jul 05 19:40:41.643190 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.643169    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"]
Jul 05 19:40:41.643611 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.643592    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" containerName="manager"
Jul 05 19:40:41.643691 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.643614    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" containerName="manager"
Jul 05 19:40:41.643749 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.643712    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" containerName="manager"
Jul 05 19:40:41.647198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.647179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:41.648463 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.648440    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rvwl9\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:41.651460 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.651438    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.657426 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.657400    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"]
Jul 05 19:40:41.762237 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.762202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2ffx\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.762402 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.762279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv275\" (UniqueName: \"kubernetes.io/projected/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-kube-api-access-kv275\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2ffx\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.762402 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.762298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r74lx\" (UniqueName: \"kubernetes.io/projected/0652f4d8-2a53-468d-9344-f001130addad-kube-api-access-r74lx\") pod \"limitador-operator-controller-manager-859d7b78bd-pgs8w\" (UID: \"0652f4d8-2a53-468d-9344-f001130addad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:41.843108 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.843086    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:41.845676 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.845648    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.845774 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.845713    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.848370 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.848345    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.862817 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.862777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2ffx\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.862911 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.862894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv275\" (UniqueName: \"kubernetes.io/projected/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-kube-api-access-kv275\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2ffx\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.862961 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.862929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r74lx\" (UniqueName: \"kubernetes.io/projected/0652f4d8-2a53-468d-9344-f001130addad-kube-api-access-r74lx\") pod \"limitador-operator-controller-manager-859d7b78bd-pgs8w\" (UID: \"0652f4d8-2a53-468d-9344-f001130addad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:41.863145 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.863128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2ffx\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.866031 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.866010    2579 generic.go:356] "Generic (PLEG): container finished" podID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" containerID="0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb" exitCode=0
Jul 05 19:40:41.866095 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.866042    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rvwl9"
Jul 05 19:40:41.866138 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.866106    2579 scope.go:117] "RemoveContainer" containerID="0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb"
Jul 05 19:40:41.867503 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.867480    2579 generic.go:356] "Generic (PLEG): container finished" podID="e0a46688-8892-4076-8d8a-73405a97aad0" containerID="5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae" exitCode=0
Jul 05 19:40:41.867584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.867512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.868689 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.868671    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.871821 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.871744    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:41.873614 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.873592    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74lx\" (UniqueName: \"kubernetes.io/projected/0652f4d8-2a53-468d-9344-f001130addad-kube-api-access-r74lx\") pod \"limitador-operator-controller-manager-859d7b78bd-pgs8w\" (UID: \"0652f4d8-2a53-468d-9344-f001130addad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:41.873930 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.873794    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv275\" (UniqueName: \"kubernetes.io/projected/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-kube-api-access-kv275\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2ffx\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.874543 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.874527    2579 scope.go:117] "RemoveContainer" containerID="0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb"
Jul 05 19:40:41.874841 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.874824    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb\": container with ID starting with 0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb not found: ID does not exist" containerID="0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb"
Jul 05 19:40:41.874900 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.874849    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb"} err="failed to get container status \"0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb\": rpc error: code = NotFound desc = could not find container \"0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb\": container with ID starting with 0f83a91f6b48973e1bd563ad507d00b55bf96381dfb43945c9d035e0e298fdcb not found: ID does not exist"
Jul 05 19:40:41.874900 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.874866    2579 scope.go:117] "RemoveContainer" containerID="5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae"
Jul 05 19:40:41.883992 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.883975    2579 scope.go:117] "RemoveContainer" containerID="5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae"
Jul 05 19:40:41.884215 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:41.884200    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae\": container with ID starting with 5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae not found: ID does not exist" containerID="5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae"
Jul 05 19:40:41.884260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.884219    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae"} err="failed to get container status \"5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae\": rpc error: code = NotFound desc = could not find container \"5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae\": container with ID starting with 5796ee2cbc494839758a8cc636a0c15a799ba20103363eca5e70f239eb5252ae not found: ID does not exist"
Jul 05 19:40:41.963961 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.963926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m75mh\" (UniqueName: \"kubernetes.io/projected/e0a46688-8892-4076-8d8a-73405a97aad0-kube-api-access-m75mh\") pod \"e0a46688-8892-4076-8d8a-73405a97aad0\" (UID: \"e0a46688-8892-4076-8d8a-73405a97aad0\") "
Jul 05 19:40:41.964061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.963987    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd82c\" (UniqueName: \"kubernetes.io/projected/047db77f-6956-4515-9ca2-e9fb98fe8eb3-kube-api-access-fd82c\") pod \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") "
Jul 05 19:40:41.964061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.964024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047db77f-6956-4515-9ca2-e9fb98fe8eb3-extensions-socket-volume\") pod \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\" (UID: \"047db77f-6956-4515-9ca2-e9fb98fe8eb3\") "
Jul 05 19:40:41.964419 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.964396    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047db77f-6956-4515-9ca2-e9fb98fe8eb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "047db77f-6956-4515-9ca2-e9fb98fe8eb3" (UID: "047db77f-6956-4515-9ca2-e9fb98fe8eb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:41.965857 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.965833    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a46688-8892-4076-8d8a-73405a97aad0-kube-api-access-m75mh" (OuterVolumeSpecName: "kube-api-access-m75mh") pod "e0a46688-8892-4076-8d8a-73405a97aad0" (UID: "e0a46688-8892-4076-8d8a-73405a97aad0"). InnerVolumeSpecName "kube-api-access-m75mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:41.965919 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.965841    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047db77f-6956-4515-9ca2-e9fb98fe8eb3-kube-api-access-fd82c" (OuterVolumeSpecName: "kube-api-access-fd82c") pod "047db77f-6956-4515-9ca2-e9fb98fe8eb3" (UID: "047db77f-6956-4515-9ca2-e9fb98fe8eb3"). InnerVolumeSpecName "kube-api-access-fd82c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:41.994131 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.994111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:41.999257 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:41.999244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:42.065439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.065363    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m75mh\" (UniqueName: \"kubernetes.io/projected/e0a46688-8892-4076-8d8a-73405a97aad0-kube-api-access-m75mh\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:42.065439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.065397    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd82c\" (UniqueName: \"kubernetes.io/projected/047db77f-6956-4515-9ca2-e9fb98fe8eb3-kube-api-access-fd82c\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:42.065439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.065413    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047db77f-6956-4515-9ca2-e9fb98fe8eb3-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:42.155406 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.155382    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"]
Jul 05 19:40:42.156572 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:42.156544    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c52cf5b_7511_47f8_a4b3_061f0ccdfb38.slice/crio-8e0f23b7539c0453c4dc68b384db5cc7435304ce011b9a1e7c940db72192c831 WatchSource:0}: Error finding container 8e0f23b7539c0453c4dc68b384db5cc7435304ce011b9a1e7c940db72192c831: Status 404 returned error can't find the container with id 8e0f23b7539c0453c4dc68b384db5cc7435304ce011b9a1e7c940db72192c831
Jul 05 19:40:42.167100 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.167074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"]
Jul 05 19:40:42.169706 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:40:42.169681    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0652f4d8_2a53_468d_9344_f001130addad.slice/crio-3cdbbdbee802c2bf8593695959bcc8ac689d165dd1706a03058180ae698a7613 WatchSource:0}: Error finding container 3cdbbdbee802c2bf8593695959bcc8ac689d165dd1706a03058180ae698a7613: Status 404 returned error can't find the container with id 3cdbbdbee802c2bf8593695959bcc8ac689d165dd1706a03058180ae698a7613
Jul 05 19:40:42.185481 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:42.185453    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:42.188076 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:42.188053    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:42.876284 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.876208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w" event={"ID":"0652f4d8-2a53-468d-9344-f001130addad","Type":"ContainerStarted","Data":"0332a87b89d31314c56f1b9e5fadfbbec974da994bc6c1476b0d5d2700800320"}
Jul 05 19:40:42.876640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.876284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w" event={"ID":"0652f4d8-2a53-468d-9344-f001130addad","Type":"ContainerStarted","Data":"3cdbbdbee802c2bf8593695959bcc8ac689d165dd1706a03058180ae698a7613"}
Jul 05 19:40:42.876640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.876322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:42.877948 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.877922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx" event={"ID":"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38","Type":"ContainerStarted","Data":"6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976"}
Jul 05 19:40:42.878068 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.877958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx" event={"ID":"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38","Type":"ContainerStarted","Data":"8e0f23b7539c0453c4dc68b384db5cc7435304ce011b9a1e7c940db72192c831"}
Jul 05 19:40:42.878068 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.877977    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:42.878680 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:42.878649    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:42.897787 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.897746    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w" podStartSLOduration=1.897735789 podStartE2EDuration="1.897735789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:42.896925187 +0000 UTC m=+487.719415871" watchObservedRunningTime="2026-07-05 19:40:42.897735789 +0000 UTC m=+487.720226471"
Jul 05 19:40:42.916867 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:42.916826    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx" podStartSLOduration=1.91681319 podStartE2EDuration="1.91681319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:42.914840468 +0000 UTC m=+487.737331151" watchObservedRunningTime="2026-07-05 19:40:42.91681319 +0000 UTC m=+487.739303863"
Jul 05 19:40:42.917139 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:42.917117    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pjtck\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjtck"
Jul 05 19:40:43.617050 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:43.617019    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="047db77f-6956-4515-9ca2-e9fb98fe8eb3" path="/var/lib/kubelet/pods/047db77f-6956-4515-9ca2-e9fb98fe8eb3/volumes"
Jul 05 19:40:43.617337 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:43.617324    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a46688-8892-4076-8d8a-73405a97aad0" path="/var/lib/kubelet/pods/e0a46688-8892-4076-8d8a-73405a97aad0/volumes"
Jul 05 19:40:43.900508 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:43.900437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:44.003113 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:44.003083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:48.738358 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:48.738326    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:48.835206 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:48.835174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:48.943020 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:48.942992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:51.174116 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:51.174085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:51.274296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:51.274239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:53.885018 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:53.884986    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pgs8w"
Jul 05 19:40:53.885393 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:53.885057    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:54.542750 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:54.542715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:54.651560 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:54.651524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:40:58.258018 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.257985    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"]
Jul 05 19:40:58.258380 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.258177    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx" podUID="9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" containerName="manager" containerID="cri-o://6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976" gracePeriod=10
Jul 05 19:40:58.510199 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.510140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:58.693210 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.693185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-extensions-socket-volume\") pod \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") "
Jul 05 19:40:58.693387 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.693264    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv275\" (UniqueName: \"kubernetes.io/projected/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-kube-api-access-kv275\") pod \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\" (UID: \"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38\") "
Jul 05 19:40:58.693540 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.693516    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" (UID: "9c52cf5b-7511-47f8-a4b3-061f0ccdfb38"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:40:58.695151 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.695128    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-kube-api-access-kv275" (OuterVolumeSpecName: "kube-api-access-kv275") pod "9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" (UID: "9c52cf5b-7511-47f8-a4b3-061f0ccdfb38"). InnerVolumeSpecName "kube-api-access-kv275". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:40:58.794410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.794357    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv275\" (UniqueName: \"kubernetes.io/projected/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-kube-api-access-kv275\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:58.794410 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.794379    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:40:58.958432 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.958402    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" containerID="6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976" exitCode=0
Jul 05 19:40:58.958579 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.958448    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"
Jul 05 19:40:58.958579 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.958449    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx" event={"ID":"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38","Type":"ContainerDied","Data":"6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976"}
Jul 05 19:40:58.958682 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.958583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx" event={"ID":"9c52cf5b-7511-47f8-a4b3-061f0ccdfb38","Type":"ContainerDied","Data":"8e0f23b7539c0453c4dc68b384db5cc7435304ce011b9a1e7c940db72192c831"}
Jul 05 19:40:58.958682 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.958617    2579 scope.go:117] "RemoveContainer" containerID="6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976"
Jul 05 19:40:58.967852 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.967837    2579 scope.go:117] "RemoveContainer" containerID="6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976"
Jul 05 19:40:58.968108 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:40:58.968091    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976\": container with ID starting with 6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976 not found: ID does not exist" containerID="6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976"
Jul 05 19:40:58.968160 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.968117    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976"} err="failed to get container status \"6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976\": rpc error: code = NotFound desc = could not find container \"6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976\": container with ID starting with 6582f586147cbfb9df356e7660731d7b04bebc347afc61998f2bf5d76f7f4976 not found: ID does not exist"
Jul 05 19:40:58.980208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.980186    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"]
Jul 05 19:40:58.987006 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:58.986987    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2ffx"]
Jul 05 19:40:59.623061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:40:59.623029    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" path="/var/lib/kubelet/pods/9c52cf5b-7511-47f8-a4b3-061f0ccdfb38/volumes"
Jul 05 19:41:01.565562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:01.565530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:01.668496 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:01.668454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:01.919412 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:01.919335    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bd54bb9d8-8b4ht" podUID="a7687006-248c-4ae3-81de-df9a823e1f89" containerName="console" containerID="cri-o://e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33" gracePeriod=15
Jul 05 19:41:02.161616 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.161589    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:41:02.322651 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322624    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-service-ca\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.322860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-trusted-ca-bundle\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.322860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwq42\" (UniqueName: \"kubernetes.io/projected/a7687006-248c-4ae3-81de-df9a823e1f89-kube-api-access-zwq42\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.322860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322722    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-oauth-serving-cert\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.322860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322837    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-oauth-config\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.323042 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322907    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-console-config\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.323042 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.322964    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-serving-cert\") pod \"a7687006-248c-4ae3-81de-df9a823e1f89\" (UID: \"a7687006-248c-4ae3-81de-df9a823e1f89\") "
Jul 05 19:41:02.323226 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.323122    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:41:02.323226 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.323220    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:41:02.323373 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.323306    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-console-config" (OuterVolumeSpecName: "console-config") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:41:02.323437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.323414    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:41:02.325017 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.324993    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:41:02.325086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.325011    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:41:02.325086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.325040    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7687006-248c-4ae3-81de-df9a823e1f89-kube-api-access-zwq42" (OuterVolumeSpecName: "kube-api-access-zwq42") pod "a7687006-248c-4ae3-81de-df9a823e1f89" (UID: "a7687006-248c-4ae3-81de-df9a823e1f89"). InnerVolumeSpecName "kube-api-access-zwq42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:41:02.424465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424429    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-oauth-serving-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.424465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424463    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-oauth-config\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.424465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424473    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-console-config\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.424645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424482    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7687006-248c-4ae3-81de-df9a823e1f89-console-serving-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.424645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424490    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.424645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424498    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7687006-248c-4ae3-81de-df9a823e1f89-trusted-ca-bundle\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.424645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.424507    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwq42\" (UniqueName: \"kubernetes.io/projected/a7687006-248c-4ae3-81de-df9a823e1f89-kube-api-access-zwq42\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:02.979996 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.979962    2579 generic.go:356] "Generic (PLEG): container finished" podID="a7687006-248c-4ae3-81de-df9a823e1f89" containerID="e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33" exitCode=0
Jul 05 19:41:02.980403 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.980007    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd54bb9d8-8b4ht"
Jul 05 19:41:02.980403 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.980034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd54bb9d8-8b4ht" event={"ID":"a7687006-248c-4ae3-81de-df9a823e1f89","Type":"ContainerDied","Data":"e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33"}
Jul 05 19:41:02.980403 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.980081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd54bb9d8-8b4ht" event={"ID":"a7687006-248c-4ae3-81de-df9a823e1f89","Type":"ContainerDied","Data":"d53b9d3550d3bc820ff3b6039dda47ecb1c629cde20bf61a1050a4ad40bb2302"}
Jul 05 19:41:02.980403 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.980101    2579 scope.go:117] "RemoveContainer" containerID="e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33"
Jul 05 19:41:02.989061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.989045    2579 scope.go:117] "RemoveContainer" containerID="e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33"
Jul 05 19:41:02.989313 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:41:02.989295    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33\": container with ID starting with e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33 not found: ID does not exist" containerID="e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33"
Jul 05 19:41:02.989378 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:02.989326    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33"} err="failed to get container status \"e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33\": rpc error: code = NotFound desc = could not find container \"e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33\": container with ID starting with e9a041fd74c3c761c236b9bd1747a0b29022f9b718fb6c806bdc406c5b5fdf33 not found: ID does not exist"
Jul 05 19:41:03.000687 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:03.000666    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd54bb9d8-8b4ht"]
Jul 05 19:41:03.005108 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:03.005088    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd54bb9d8-8b4ht"]
Jul 05 19:41:03.617531 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:03.617490    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7687006-248c-4ae3-81de-df9a823e1f89" path="/var/lib/kubelet/pods/a7687006-248c-4ae3-81de-df9a823e1f89/volumes"
Jul 05 19:41:06.063902 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:06.063859    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:06.376170 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:06.376082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:06.477168 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:06.477119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:08.978384 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:08.978353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:09.080009 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:09.079979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:12.570550 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:12.570517    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:12.625424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:12.625383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:14.544962 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.544927    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"]
Jul 05 19:41:14.545381 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.545367    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7687006-248c-4ae3-81de-df9a823e1f89" containerName="console"
Jul 05 19:41:14.545429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.545384    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7687006-248c-4ae3-81de-df9a823e1f89" containerName="console"
Jul 05 19:41:14.545429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.545418    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" containerName="manager"
Jul 05 19:41:14.545429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.545426    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" containerName="manager"
Jul 05 19:41:14.545517 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.545500    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c52cf5b-7511-47f8-a4b3-061f0ccdfb38" containerName="manager"
Jul 05 19:41:14.545517 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.545513    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7687006-248c-4ae3-81de-df9a823e1f89" containerName="console"
Jul 05 19:41:14.550281 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.550260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.553210 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.553194    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4t9f4\""
Jul 05 19:41:14.559887 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.559863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"]
Jul 05 19:41:14.576116 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.576095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:14.619447 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7wz8\" (UniqueName: \"kubernetes.io/projected/f37e863c-27a5-4596-aaf5-fafac05cb182-kube-api-access-d7wz8\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619841 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37e863c-27a5-4596-aaf5-fafac05cb182-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619841 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.619841 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.619609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.720702 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.720869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.720869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37e863c-27a5-4596-aaf5-fafac05cb182-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.720869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721025 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721025 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721025 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.720971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721224 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721121    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7wz8\" (UniqueName: \"kubernetes.io/projected/f37e863c-27a5-4596-aaf5-fafac05cb182-kube-api-access-d7wz8\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721359 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721341    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721414 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721414 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721390    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721513 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721444    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.721561 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.721537    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37e863c-27a5-4596-aaf5-fafac05cb182-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.723352 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.723328    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.723587 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.723566    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.729869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.729834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37e863c-27a5-4596-aaf5-fafac05cb182-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.730387 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.730369    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7wz8\" (UniqueName: \"kubernetes.io/projected/f37e863c-27a5-4596-aaf5-fafac05cb182-kube-api-access-d7wz8\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7ppqs\" (UID: \"f37e863c-27a5-4596-aaf5-fafac05cb182\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.779116 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.779094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:14.861279 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.861227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:14.993393 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.993366    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"]
Jul 05 19:41:14.994887 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:41:14.994859    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37e863c_27a5_4596_aaf5_fafac05cb182.slice/crio-7ef05c0eec23fbe4a1784c43a5cdf3b25eda4a5c1b2e67435a0de04d6f95326e WatchSource:0}: Error finding container 7ef05c0eec23fbe4a1784c43a5cdf3b25eda4a5c1b2e67435a0de04d6f95326e: Status 404 returned error can't find the container with id 7ef05c0eec23fbe4a1784c43a5cdf3b25eda4a5c1b2e67435a0de04d6f95326e
Jul 05 19:41:14.997080 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.997050    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:41:14.997170 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.997112    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:41:14.997170 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:14.997140    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:41:15.050533 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:15.050510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" event={"ID":"f37e863c-27a5-4596-aaf5-fafac05cb182","Type":"ContainerStarted","Data":"7ef05c0eec23fbe4a1784c43a5cdf3b25eda4a5c1b2e67435a0de04d6f95326e"}
Jul 05 19:41:16.057080 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:16.057051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" event={"ID":"f37e863c-27a5-4596-aaf5-fafac05cb182","Type":"ContainerStarted","Data":"c3056b91796da7f6068934e3b5f488a01e3858ecc97f0d8d3af95131ff3de3e7"}
Jul 05 19:41:16.078161 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:16.078113    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" podStartSLOduration=2.078098437 podStartE2EDuration="2.078098437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:16.075877018 +0000 UTC m=+520.898367701" watchObservedRunningTime="2026-07-05 19:41:16.078098437 +0000 UTC m=+520.900589119"
Jul 05 19:41:16.861375 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:16.861347    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:16.866916 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:16.866892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:17.037402 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.037370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:17.041821 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.041784    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:17.044868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.044852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.047538 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.047519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 05 19:41:17.047648 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.047538    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kb27n\""
Jul 05 19:41:17.055045 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.055022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:17.064558 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.064537    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:17.067429 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.067411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:41:17.140104 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.140030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:17.142171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.142145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-config-file\") pod \"limitador-limitador-64c94fd64f-zmwbd\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.142318 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.142209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8sh\" (UniqueName: \"kubernetes.io/projected/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-kube-api-access-7t8sh\") pod \"limitador-limitador-64c94fd64f-zmwbd\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.161119 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.161094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:17.214297 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.214270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:17.243549 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.243527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-config-file\") pod \"limitador-limitador-64c94fd64f-zmwbd\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.243689 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.243560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8sh\" (UniqueName: \"kubernetes.io/projected/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-kube-api-access-7t8sh\") pod \"limitador-limitador-64c94fd64f-zmwbd\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.244156 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.244135    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-config-file\") pod \"limitador-limitador-64c94fd64f-zmwbd\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.251936 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.251916    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8sh\" (UniqueName: \"kubernetes.io/projected/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-kube-api-access-7t8sh\") pod \"limitador-limitador-64c94fd64f-zmwbd\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.356002 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.355975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:17.503959 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.503936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:17.505847 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:41:17.505825    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a9171b_2ef0_42ab_8bff_62bbd08d418f.slice/crio-c3d6f4534ae6a21331450c170b8ae81725270bafa576db106d8b50a8b8fc38ef WatchSource:0}: Error finding container c3d6f4534ae6a21331450c170b8ae81725270bafa576db106d8b50a8b8fc38ef: Status 404 returned error can't find the container with id c3d6f4534ae6a21331450c170b8ae81725270bafa576db106d8b50a8b8fc38ef
Jul 05 19:41:17.941869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.941832    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g8v9v"]
Jul 05 19:41:17.946419 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.946397    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:17.949194 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.949175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l2jgn\""
Jul 05 19:41:17.954974 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.954947    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8v9v"]
Jul 05 19:41:17.991277 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:17.991255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:18.059688 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.059662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrb5p\" (UniqueName: \"kubernetes.io/projected/e6c58386-1b63-4f4d-9734-d34f7ac92cda-kube-api-access-nrb5p\") pod \"authorino-58cd955675-g8v9v\" (UID: \"e6c58386-1b63-4f4d-9734-d34f7ac92cda\") " pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:18.068955 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.068925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd" event={"ID":"e1a9171b-2ef0-42ab-8bff-62bbd08d418f","Type":"ContainerStarted","Data":"c3d6f4534ae6a21331450c170b8ae81725270bafa576db106d8b50a8b8fc38ef"}
Jul 05 19:41:18.090301 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.090278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:18.149275 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.149244    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dlx5g"]
Jul 05 19:41:18.152838 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.152816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:18.159312 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.159290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dlx5g"]
Jul 05 19:41:18.160579 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.160545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrb5p\" (UniqueName: \"kubernetes.io/projected/e6c58386-1b63-4f4d-9734-d34f7ac92cda-kube-api-access-nrb5p\") pod \"authorino-58cd955675-g8v9v\" (UID: \"e6c58386-1b63-4f4d-9734-d34f7ac92cda\") " pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:18.171726 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.171280    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrb5p\" (UniqueName: \"kubernetes.io/projected/e6c58386-1b63-4f4d-9734-d34f7ac92cda-kube-api-access-nrb5p\") pod \"authorino-58cd955675-g8v9v\" (UID: \"e6c58386-1b63-4f4d-9734-d34f7ac92cda\") " pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:18.256834 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.256606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:18.262014 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.261947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrq8\" (UniqueName: \"kubernetes.io/projected/d1805157-b211-4cfd-a4fa-eae78630f81f-kube-api-access-glrq8\") pod \"authorino-75d556bd77-dlx5g\" (UID: \"d1805157-b211-4cfd-a4fa-eae78630f81f\") " pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:18.363448 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.362568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrq8\" (UniqueName: \"kubernetes.io/projected/d1805157-b211-4cfd-a4fa-eae78630f81f-kube-api-access-glrq8\") pod \"authorino-75d556bd77-dlx5g\" (UID: \"d1805157-b211-4cfd-a4fa-eae78630f81f\") " pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:18.381042 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.376977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrq8\" (UniqueName: \"kubernetes.io/projected/d1805157-b211-4cfd-a4fa-eae78630f81f-kube-api-access-glrq8\") pod \"authorino-75d556bd77-dlx5g\" (UID: \"d1805157-b211-4cfd-a4fa-eae78630f81f\") " pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:18.421616 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.421582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8v9v"]
Jul 05 19:41:18.424263 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:41:18.424229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6c58386_1b63_4f4d_9734_d34f7ac92cda.slice/crio-ccdcfabb21728aa64d08e8c7d5be3793517356579521a603937d66bd9f9a8af2 WatchSource:0}: Error finding container ccdcfabb21728aa64d08e8c7d5be3793517356579521a603937d66bd9f9a8af2: Status 404 returned error can't find the container with id ccdcfabb21728aa64d08e8c7d5be3793517356579521a603937d66bd9f9a8af2
Jul 05 19:41:18.464205 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.464158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:18.614936 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:18.614908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dlx5g"]
Jul 05 19:41:18.617002 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:41:18.616972    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1805157_b211_4cfd_a4fa_eae78630f81f.slice/crio-fa32ded2eb7103ed3315d675ba8b4a16947e041e1d6decee4195d6a784689853 WatchSource:0}: Error finding container fa32ded2eb7103ed3315d675ba8b4a16947e041e1d6decee4195d6a784689853: Status 404 returned error can't find the container with id fa32ded2eb7103ed3315d675ba8b4a16947e041e1d6decee4195d6a784689853
Jul 05 19:41:19.076437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:19.076398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dlx5g" event={"ID":"d1805157-b211-4cfd-a4fa-eae78630f81f","Type":"ContainerStarted","Data":"fa32ded2eb7103ed3315d675ba8b4a16947e041e1d6decee4195d6a784689853"}
Jul 05 19:41:19.077766 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:19.077732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8v9v" event={"ID":"e6c58386-1b63-4f4d-9734-d34f7ac92cda","Type":"ContainerStarted","Data":"ccdcfabb21728aa64d08e8c7d5be3793517356579521a603937d66bd9f9a8af2"}
Jul 05 19:41:20.976271 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:20.976149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:21.078015 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:21.077987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:21.095566 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:21.095536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd" event={"ID":"e1a9171b-2ef0-42ab-8bff-62bbd08d418f","Type":"ContainerStarted","Data":"f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff"}
Jul 05 19:41:21.095728 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:21.095657    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:21.114537 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:21.114483    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd" podStartSLOduration=0.911401562 podStartE2EDuration="4.114462373s" totalImagesPullingTime="3.203060811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:21.111001947 +0000 UTC m=+525.933492654" watchObservedRunningTime="2026-07-05 19:41:21.114462373 +0000 UTC m=+525.936953057"
Jul 05 19:41:23.108205 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:23.108168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dlx5g" event={"ID":"d1805157-b211-4cfd-a4fa-eae78630f81f","Type":"ContainerStarted","Data":"eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e"}
Jul 05 19:41:23.109625 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:23.109602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8v9v" event={"ID":"e6c58386-1b63-4f4d-9734-d34f7ac92cda","Type":"ContainerStarted","Data":"935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552"}
Jul 05 19:41:23.125929 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:23.125887    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dlx5g" podStartSLOduration=1.056946927 podStartE2EDuration="5.125873706s" totalImagesPullingTime="4.068926779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:23.12452666 +0000 UTC m=+527.947017365" watchObservedRunningTime="2026-07-05 19:41:23.125873706 +0000 UTC m=+527.948364388"
Jul 05 19:41:23.140869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:23.140825    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g8v9v" podStartSLOduration=1.891195613 podStartE2EDuration="6.140792735s" totalImagesPullingTime="4.249597122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:23.140386851 +0000 UTC m=+527.962877533" watchObservedRunningTime="2026-07-05 19:41:23.140792735 +0000 UTC m=+527.963283418"
Jul 05 19:41:23.171296 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:23.171269    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8v9v"]
Jul 05 19:41:25.119390 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:25.119352    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g8v9v" podUID="e6c58386-1b63-4f4d-9734-d34f7ac92cda" containerName="authorino" containerID="cri-o://935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552" gracePeriod=30
Jul 05 19:41:25.353684 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:25.353661    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:25.424202 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:25.424135    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrb5p\" (UniqueName: \"kubernetes.io/projected/e6c58386-1b63-4f4d-9734-d34f7ac92cda-kube-api-access-nrb5p\") pod \"e6c58386-1b63-4f4d-9734-d34f7ac92cda\" (UID: \"e6c58386-1b63-4f4d-9734-d34f7ac92cda\") "
Jul 05 19:41:25.426103 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:25.426075    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c58386-1b63-4f4d-9734-d34f7ac92cda-kube-api-access-nrb5p" (OuterVolumeSpecName: "kube-api-access-nrb5p") pod "e6c58386-1b63-4f4d-9734-d34f7ac92cda" (UID: "e6c58386-1b63-4f4d-9734-d34f7ac92cda"). InnerVolumeSpecName "kube-api-access-nrb5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:41:25.525091 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:25.525067    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrb5p\" (UniqueName: \"kubernetes.io/projected/e6c58386-1b63-4f4d-9734-d34f7ac92cda-kube-api-access-nrb5p\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:26.125041 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.125003    2579 generic.go:356] "Generic (PLEG): container finished" podID="e6c58386-1b63-4f4d-9734-d34f7ac92cda" containerID="935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552" exitCode=0
Jul 05 19:41:26.125376 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.125046    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8v9v"
Jul 05 19:41:26.125376 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.125088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8v9v" event={"ID":"e6c58386-1b63-4f4d-9734-d34f7ac92cda","Type":"ContainerDied","Data":"935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552"}
Jul 05 19:41:26.125376 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.125134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8v9v" event={"ID":"e6c58386-1b63-4f4d-9734-d34f7ac92cda","Type":"ContainerDied","Data":"ccdcfabb21728aa64d08e8c7d5be3793517356579521a603937d66bd9f9a8af2"}
Jul 05 19:41:26.125376 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.125154    2579 scope.go:117] "RemoveContainer" containerID="935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552"
Jul 05 19:41:26.133390 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.133375    2579 scope.go:117] "RemoveContainer" containerID="935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552"
Jul 05 19:41:26.133655 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:41:26.133636    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552\": container with ID starting with 935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552 not found: ID does not exist" containerID="935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552"
Jul 05 19:41:26.133707 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.133664    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552"} err="failed to get container status \"935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552\": rpc error: code = NotFound desc = could not find container \"935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552\": container with ID starting with 935665b4e340da2761365598a6f082c39edeb0db97b3fa3fb8b26862d1a88552 not found: ID does not exist"
Jul 05 19:41:26.150777 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.150754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8v9v"]
Jul 05 19:41:26.153006 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.152987    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8v9v"]
Jul 05 19:41:26.176144 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.176119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:26.227327 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.227298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:26.787418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.787388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:26.887704 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:26.887674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:27.617185 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:27.617144    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6c58386-1b63-4f4d-9734-d34f7ac92cda" path="/var/lib/kubelet/pods/e6c58386-1b63-4f4d-9734-d34f7ac92cda/volumes"
Jul 05 19:41:32.102013 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:32.101985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:32.422303 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:32.422221    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:32.422442 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:32.422416    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd" podUID="e1a9171b-2ef0-42ab-8bff-62bbd08d418f" containerName="limitador" containerID="cri-o://f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff" gracePeriod=30
Jul 05 19:41:32.955974 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:32.955948    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:33.082722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.082684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t8sh\" (UniqueName: \"kubernetes.io/projected/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-kube-api-access-7t8sh\") pod \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") "
Jul 05 19:41:33.082915 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.082734    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-config-file\") pod \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\" (UID: \"e1a9171b-2ef0-42ab-8bff-62bbd08d418f\") "
Jul 05 19:41:33.083120 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.083090    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-config-file" (OuterVolumeSpecName: "config-file") pod "e1a9171b-2ef0-42ab-8bff-62bbd08d418f" (UID: "e1a9171b-2ef0-42ab-8bff-62bbd08d418f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:41:33.084848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.084772    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-kube-api-access-7t8sh" (OuterVolumeSpecName: "kube-api-access-7t8sh") pod "e1a9171b-2ef0-42ab-8bff-62bbd08d418f" (UID: "e1a9171b-2ef0-42ab-8bff-62bbd08d418f"). InnerVolumeSpecName "kube-api-access-7t8sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:41:33.160761 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.160733    2579 generic.go:356] "Generic (PLEG): container finished" podID="e1a9171b-2ef0-42ab-8bff-62bbd08d418f" containerID="f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff" exitCode=0
Jul 05 19:41:33.161164 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.160773    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"
Jul 05 19:41:33.161164 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.160836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd" event={"ID":"e1a9171b-2ef0-42ab-8bff-62bbd08d418f","Type":"ContainerDied","Data":"f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff"}
Jul 05 19:41:33.161164 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.160897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zmwbd" event={"ID":"e1a9171b-2ef0-42ab-8bff-62bbd08d418f","Type":"ContainerDied","Data":"c3d6f4534ae6a21331450c170b8ae81725270bafa576db106d8b50a8b8fc38ef"}
Jul 05 19:41:33.161164 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.160929    2579 scope.go:117] "RemoveContainer" containerID="f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff"
Jul 05 19:41:33.172425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.170225    2579 scope.go:117] "RemoveContainer" containerID="f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff"
Jul 05 19:41:33.172425 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:41:33.170538    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff\": container with ID starting with f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff not found: ID does not exist" containerID="f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff"
Jul 05 19:41:33.172425 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.170580    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff"} err="failed to get container status \"f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff\": rpc error: code = NotFound desc = could not find container \"f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff\": container with ID starting with f5a5bf54f1fcd5d80b97ec9b27821cde4121fda319003fe47aa2332680b398ff not found: ID does not exist"
Jul 05 19:41:33.184177 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.184157    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-config-file\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:33.184264 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.184179    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t8sh\" (UniqueName: \"kubernetes.io/projected/e1a9171b-2ef0-42ab-8bff-62bbd08d418f-kube-api-access-7t8sh\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:33.187922 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.187902    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:33.191692 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.191673    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zmwbd"]
Jul 05 19:41:33.617095 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:33.617067    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a9171b-2ef0-42ab-8bff-62bbd08d418f" path="/var/lib/kubelet/pods/e1a9171b-2ef0-42ab-8bff-62bbd08d418f/volumes"
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.595581    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-5n4bv"]
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.596441    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a9171b-2ef0-42ab-8bff-62bbd08d418f" containerName="limitador"
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.596460    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a9171b-2ef0-42ab-8bff-62bbd08d418f" containerName="limitador"
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.596499    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c58386-1b63-4f4d-9734-d34f7ac92cda" containerName="authorino"
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.596508    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c58386-1b63-4f4d-9734-d34f7ac92cda" containerName="authorino"
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.596651    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a9171b-2ef0-42ab-8bff-62bbd08d418f" containerName="limitador"
Jul 05 19:41:38.598242 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.596665    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c58386-1b63-4f4d-9734-d34f7ac92cda" containerName="authorino"
Jul 05 19:41:38.602469 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.602443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.605503 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.605482    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 05 19:41:38.605695 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.605567    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xjdlq\""
Jul 05 19:41:38.606428 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.606403    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5n4bv"]
Jul 05 19:41:38.630980 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.630956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:38.724304 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.724277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szhjp\" (UniqueName: \"kubernetes.io/projected/e44b0bf9-f327-463e-a86c-2d08a056d996-kube-api-access-szhjp\") pod \"postgres-69fb4594cf-5n4bv\" (UID: \"e44b0bf9-f327-463e-a86c-2d08a056d996\") " pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.724439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.724330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e44b0bf9-f327-463e-a86c-2d08a056d996-data\") pod \"postgres-69fb4594cf-5n4bv\" (UID: \"e44b0bf9-f327-463e-a86c-2d08a056d996\") " pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.825109 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.825079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szhjp\" (UniqueName: \"kubernetes.io/projected/e44b0bf9-f327-463e-a86c-2d08a056d996-kube-api-access-szhjp\") pod \"postgres-69fb4594cf-5n4bv\" (UID: \"e44b0bf9-f327-463e-a86c-2d08a056d996\") " pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.825250 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.825114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e44b0bf9-f327-463e-a86c-2d08a056d996-data\") pod \"postgres-69fb4594cf-5n4bv\" (UID: \"e44b0bf9-f327-463e-a86c-2d08a056d996\") " pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.825414 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.825399    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e44b0bf9-f327-463e-a86c-2d08a056d996-data\") pod \"postgres-69fb4594cf-5n4bv\" (UID: \"e44b0bf9-f327-463e-a86c-2d08a056d996\") " pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.833267 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.833241    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szhjp\" (UniqueName: \"kubernetes.io/projected/e44b0bf9-f327-463e-a86c-2d08a056d996-kube-api-access-szhjp\") pod \"postgres-69fb4594cf-5n4bv\" (UID: \"e44b0bf9-f327-463e-a86c-2d08a056d996\") " pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:38.917982 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:38.917921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:39.044370 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:39.044348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5n4bv"]
Jul 05 19:41:39.046267 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:41:39.046237    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44b0bf9_f327_463e_a86c_2d08a056d996.slice/crio-87248c07e0c893f9bdce5ed153efebe1ccd607808d6ecffdcafbcc4b4022ab1d WatchSource:0}: Error finding container 87248c07e0c893f9bdce5ed153efebe1ccd607808d6ecffdcafbcc4b4022ab1d: Status 404 returned error can't find the container with id 87248c07e0c893f9bdce5ed153efebe1ccd607808d6ecffdcafbcc4b4022ab1d
Jul 05 19:41:39.191990 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:39.191926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5n4bv" event={"ID":"e44b0bf9-f327-463e-a86c-2d08a056d996","Type":"ContainerStarted","Data":"87248c07e0c893f9bdce5ed153efebe1ccd607808d6ecffdcafbcc4b4022ab1d"}
Jul 05 19:41:47.235093 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:47.235053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5n4bv" event={"ID":"e44b0bf9-f327-463e-a86c-2d08a056d996","Type":"ContainerStarted","Data":"9945d906a5cd6b99ce703e419e33141d85cc33c46ffc1b2177f4882152797718"}
Jul 05 19:41:47.235576 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:47.235249    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:47.251481 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:47.251438    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-5n4bv" podStartSLOduration=1.495377901 podStartE2EDuration="9.251423098s" totalImagesPullingTime="7.756045197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:47.250299048 +0000 UTC m=+552.072789831" watchObservedRunningTime="2026-07-05 19:41:47.251423098 +0000 UTC m=+552.073913797"
Jul 05 19:41:53.268777 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.268750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-5n4bv"
Jul 05 19:41:53.571202 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.571110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:53.670820 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.670775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:41:53.786970 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.786935    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p786g"]
Jul 05 19:41:53.795141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.795113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:53.797338 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.797312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p786g"]
Jul 05 19:41:53.953918 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:53.953846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvhk\" (UniqueName: \"kubernetes.io/projected/8db8487d-6549-444e-bc17-02c94fb18f15-kube-api-access-mfvhk\") pod \"authorino-5d4b67c446-p786g\" (UID: \"8db8487d-6549-444e-bc17-02c94fb18f15\") " pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:54.009484 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.009453    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p786g"]
Jul 05 19:41:54.009712 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:41:54.009694    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mfvhk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-p786g" podUID="8db8487d-6549-444e-bc17-02c94fb18f15"
Jul 05 19:41:54.033023 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.032996    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5978f96dd6-mdtqr"]
Jul 05 19:41:54.055267 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.055245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvhk\" (UniqueName: \"kubernetes.io/projected/8db8487d-6549-444e-bc17-02c94fb18f15-kube-api-access-mfvhk\") pod \"authorino-5d4b67c446-p786g\" (UID: \"8db8487d-6549-444e-bc17-02c94fb18f15\") " pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:54.063673 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.063644    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvhk\" (UniqueName: \"kubernetes.io/projected/8db8487d-6549-444e-bc17-02c94fb18f15-kube-api-access-mfvhk\") pod \"authorino-5d4b67c446-p786g\" (UID: \"8db8487d-6549-444e-bc17-02c94fb18f15\") " pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:54.065275 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.065256    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5978f96dd6-mdtqr"]
Jul 05 19:41:54.065369 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.065352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:54.257180 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.257156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blmkw\" (UniqueName: \"kubernetes.io/projected/9afb028e-1955-40d5-af4d-b46416f684cd-kube-api-access-blmkw\") pod \"authorino-5978f96dd6-mdtqr\" (UID: \"9afb028e-1955-40d5-af4d-b46416f684cd\") " pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:54.271280 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.271257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:54.307029 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.307007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:54.320834 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.320814    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5978f96dd6-mdtqr"]
Jul 05 19:41:54.321032 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:41:54.321015    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-blmkw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5978f96dd6-mdtqr" podUID="9afb028e-1955-40d5-af4d-b46416f684cd"
Jul 05 19:41:54.350878 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.350856    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56cfc9dddb-flls5"]
Jul 05 19:41:54.357825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.357789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blmkw\" (UniqueName: \"kubernetes.io/projected/9afb028e-1955-40d5-af4d-b46416f684cd-kube-api-access-blmkw\") pod \"authorino-5978f96dd6-mdtqr\" (UID: \"9afb028e-1955-40d5-af4d-b46416f684cd\") " pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:54.364763 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.364747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cfc9dddb-flls5"]
Jul 05 19:41:54.364861 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.364848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.366384 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.366366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blmkw\" (UniqueName: \"kubernetes.io/projected/9afb028e-1955-40d5-af4d-b46416f684cd-kube-api-access-blmkw\") pod \"authorino-5978f96dd6-mdtqr\" (UID: \"9afb028e-1955-40d5-af4d-b46416f684cd\") " pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:54.367432 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.367417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 05 19:41:54.458442 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.458419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfvhk\" (UniqueName: \"kubernetes.io/projected/8db8487d-6549-444e-bc17-02c94fb18f15-kube-api-access-mfvhk\") pod \"8db8487d-6549-444e-bc17-02c94fb18f15\" (UID: \"8db8487d-6549-444e-bc17-02c94fb18f15\") "
Jul 05 19:41:54.460487 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.460464    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db8487d-6549-444e-bc17-02c94fb18f15-kube-api-access-mfvhk" (OuterVolumeSpecName: "kube-api-access-mfvhk") pod "8db8487d-6549-444e-bc17-02c94fb18f15" (UID: "8db8487d-6549-444e-bc17-02c94fb18f15"). InnerVolumeSpecName "kube-api-access-mfvhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:41:54.559813 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.559731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9bs\" (UniqueName: \"kubernetes.io/projected/6906d47d-b1e7-4294-8d02-b640e431f9e7-kube-api-access-mv9bs\") pod \"authorino-56cfc9dddb-flls5\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") " pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.559929 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.559870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6906d47d-b1e7-4294-8d02-b640e431f9e7-tls-cert\") pod \"authorino-56cfc9dddb-flls5\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") " pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.559929 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.559922    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfvhk\" (UniqueName: \"kubernetes.io/projected/8db8487d-6549-444e-bc17-02c94fb18f15-kube-api-access-mfvhk\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:54.660480 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.660456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6906d47d-b1e7-4294-8d02-b640e431f9e7-tls-cert\") pod \"authorino-56cfc9dddb-flls5\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") " pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.660583 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.660488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9bs\" (UniqueName: \"kubernetes.io/projected/6906d47d-b1e7-4294-8d02-b640e431f9e7-kube-api-access-mv9bs\") pod \"authorino-56cfc9dddb-flls5\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") " pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.662975 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.662952    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6906d47d-b1e7-4294-8d02-b640e431f9e7-tls-cert\") pod \"authorino-56cfc9dddb-flls5\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") " pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.668485 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.668464    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9bs\" (UniqueName: \"kubernetes.io/projected/6906d47d-b1e7-4294-8d02-b640e431f9e7-kube-api-access-mv9bs\") pod \"authorino-56cfc9dddb-flls5\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") " pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.685709 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.685688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:41:54.842087 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:54.842065    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cfc9dddb-flls5"]
Jul 05 19:41:54.843384 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:41:54.843355    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6906d47d_b1e7_4294_8d02_b640e431f9e7.slice/crio-fff35853fc287e9e3d2d842c02e212ab202a3a6530e562683dc06aeb11cd680c WatchSource:0}: Error finding container fff35853fc287e9e3d2d842c02e212ab202a3a6530e562683dc06aeb11cd680c: Status 404 returned error can't find the container with id fff35853fc287e9e3d2d842c02e212ab202a3a6530e562683dc06aeb11cd680c
Jul 05 19:41:55.277192 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.277162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfc9dddb-flls5" event={"ID":"6906d47d-b1e7-4294-8d02-b640e431f9e7","Type":"ContainerStarted","Data":"fff35853fc287e9e3d2d842c02e212ab202a3a6530e562683dc06aeb11cd680c"}
Jul 05 19:41:55.277533 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.277234    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:55.277533 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.277263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p786g"
Jul 05 19:41:55.305302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.305280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:55.327581 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.327551    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p786g"]
Jul 05 19:41:55.329522 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.329503    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p786g"]
Jul 05 19:41:55.466864 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.466841    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blmkw\" (UniqueName: \"kubernetes.io/projected/9afb028e-1955-40d5-af4d-b46416f684cd-kube-api-access-blmkw\") pod \"9afb028e-1955-40d5-af4d-b46416f684cd\" (UID: \"9afb028e-1955-40d5-af4d-b46416f684cd\") "
Jul 05 19:41:55.468708 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.468679    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afb028e-1955-40d5-af4d-b46416f684cd-kube-api-access-blmkw" (OuterVolumeSpecName: "kube-api-access-blmkw") pod "9afb028e-1955-40d5-af4d-b46416f684cd" (UID: "9afb028e-1955-40d5-af4d-b46416f684cd"). InnerVolumeSpecName "kube-api-access-blmkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:41:55.568271 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.568205    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blmkw\" (UniqueName: \"kubernetes.io/projected/9afb028e-1955-40d5-af4d-b46416f684cd-kube-api-access-blmkw\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:55.618007 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:55.617978    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8db8487d-6549-444e-bc17-02c94fb18f15" path="/var/lib/kubelet/pods/8db8487d-6549-444e-bc17-02c94fb18f15/volumes"
Jul 05 19:41:56.283464 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.283426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfc9dddb-flls5" event={"ID":"6906d47d-b1e7-4294-8d02-b640e431f9e7","Type":"ContainerStarted","Data":"fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5"}
Jul 05 19:41:56.283818 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.283589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5978f96dd6-mdtqr"
Jul 05 19:41:56.300992 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.300947    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56cfc9dddb-flls5" podStartSLOduration=1.7565669069999998 podStartE2EDuration="2.300931095s" totalImagesPullingTime="544.364188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:56.299444996 +0000 UTC m=+561.121935678" watchObservedRunningTime="2026-07-05 19:41:56.300931095 +0000 UTC m=+561.123421778"
Jul 05 19:41:56.327341 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.327314    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5978f96dd6-mdtqr"]
Jul 05 19:41:56.330530 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.330508    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dlx5g"]
Jul 05 19:41:56.330708 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.330688    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dlx5g" podUID="d1805157-b211-4cfd-a4fa-eae78630f81f" containerName="authorino" containerID="cri-o://eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e" gracePeriod=30
Jul 05 19:41:56.334645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.334577    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5978f96dd6-mdtqr"]
Jul 05 19:41:56.574197 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.574175    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:56.576559 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.576542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glrq8\" (UniqueName: \"kubernetes.io/projected/d1805157-b211-4cfd-a4fa-eae78630f81f-kube-api-access-glrq8\") pod \"d1805157-b211-4cfd-a4fa-eae78630f81f\" (UID: \"d1805157-b211-4cfd-a4fa-eae78630f81f\") "
Jul 05 19:41:56.578519 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.578497    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1805157-b211-4cfd-a4fa-eae78630f81f-kube-api-access-glrq8" (OuterVolumeSpecName: "kube-api-access-glrq8") pod "d1805157-b211-4cfd-a4fa-eae78630f81f" (UID: "d1805157-b211-4cfd-a4fa-eae78630f81f"). InnerVolumeSpecName "kube-api-access-glrq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:41:56.678085 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:56.678050    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glrq8\" (UniqueName: \"kubernetes.io/projected/d1805157-b211-4cfd-a4fa-eae78630f81f-kube-api-access-glrq8\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:41:57.289241 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.289205    2579 generic.go:356] "Generic (PLEG): container finished" podID="d1805157-b211-4cfd-a4fa-eae78630f81f" containerID="eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e" exitCode=0
Jul 05 19:41:57.289241 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.289244    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dlx5g"
Jul 05 19:41:57.289735 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.289292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dlx5g" event={"ID":"d1805157-b211-4cfd-a4fa-eae78630f81f","Type":"ContainerDied","Data":"eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e"}
Jul 05 19:41:57.289735 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.289342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dlx5g" event={"ID":"d1805157-b211-4cfd-a4fa-eae78630f81f","Type":"ContainerDied","Data":"fa32ded2eb7103ed3315d675ba8b4a16947e041e1d6decee4195d6a784689853"}
Jul 05 19:41:57.289735 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.289367    2579 scope.go:117] "RemoveContainer" containerID="eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e"
Jul 05 19:41:57.298181 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.298165    2579 scope.go:117] "RemoveContainer" containerID="eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e"
Jul 05 19:41:57.298438 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:41:57.298419    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e\": container with ID starting with eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e not found: ID does not exist" containerID="eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e"
Jul 05 19:41:57.298499 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.298445    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e"} err="failed to get container status \"eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e\": rpc error: code = NotFound desc = could not find container \"eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e\": container with ID starting with eadfcdc7ddcded1ddc03627c2ce12956a660c2f640d6e5bfb0ec38a42a31405e not found: ID does not exist"
Jul 05 19:41:57.310716 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.310696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dlx5g"]
Jul 05 19:41:57.312541 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.312523    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dlx5g"]
Jul 05 19:41:57.617862 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.617767    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9afb028e-1955-40d5-af4d-b46416f684cd" path="/var/lib/kubelet/pods/9afb028e-1955-40d5-af4d-b46416f684cd/volumes"
Jul 05 19:41:57.618103 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:41:57.618084    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1805157-b211-4cfd-a4fa-eae78630f81f" path="/var/lib/kubelet/pods/d1805157-b211-4cfd-a4fa-eae78630f81f/volumes"
Jul 05 19:42:00.557680 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.557644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:00.569687 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.569663    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff96b9bc-m65jz"]
Jul 05 19:42:00.570022 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.570009    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1805157-b211-4cfd-a4fa-eae78630f81f" containerName="authorino"
Jul 05 19:42:00.570072 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.570024    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1805157-b211-4cfd-a4fa-eae78630f81f" containerName="authorino"
Jul 05 19:42:00.570109 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.570075    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1805157-b211-4cfd-a4fa-eae78630f81f" containerName="authorino"
Jul 05 19:42:00.573019 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.573004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.576179 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.576157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 05 19:42:00.576283 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.576265    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 05 19:42:00.576455 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.576437    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7n9c6\""
Jul 05 19:42:00.583983 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.583965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff96b9bc-m65jz"]
Jul 05 19:42:00.609182 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.609158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnsq\" (UniqueName: \"kubernetes.io/projected/31368728-660d-4af2-bbbb-044d02d33624-kube-api-access-fmnsq\") pod \"maas-controller-ff96b9bc-m65jz\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") " pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.609267 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.609230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31368728-660d-4af2-bbbb-044d02d33624-webhook-cert\") pod \"maas-controller-ff96b9bc-m65jz\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") " pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.636004 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.635984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:00.687431 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.687406    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:00.709831 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.709789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnsq\" (UniqueName: \"kubernetes.io/projected/31368728-660d-4af2-bbbb-044d02d33624-kube-api-access-fmnsq\") pod \"maas-controller-ff96b9bc-m65jz\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") " pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.709917 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.709890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31368728-660d-4af2-bbbb-044d02d33624-webhook-cert\") pod \"maas-controller-ff96b9bc-m65jz\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") " pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.712282 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.712259    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31368728-660d-4af2-bbbb-044d02d33624-webhook-cert\") pod \"maas-controller-ff96b9bc-m65jz\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") " pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.719135 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.719115    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnsq\" (UniqueName: \"kubernetes.io/projected/31368728-660d-4af2-bbbb-044d02d33624-kube-api-access-fmnsq\") pod \"maas-controller-ff96b9bc-m65jz\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") " pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.731614 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.731590    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-9frfx"]
Jul 05 19:42:00.735037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.735023    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:00.742698 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.742679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-9frfx"]
Jul 05 19:42:00.747261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.747243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:00.810780 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.810714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-webhook-cert\") pod \"maas-controller-6d47c8d5b4-9frfx\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") " pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:00.810780 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.810752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph8cc\" (UniqueName: \"kubernetes.io/projected/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-kube-api-access-ph8cc\") pod \"maas-controller-6d47c8d5b4-9frfx\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") " pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:00.884036 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.884007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:00.911499 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.911471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-webhook-cert\") pod \"maas-controller-6d47c8d5b4-9frfx\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") " pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:00.911619 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.911514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph8cc\" (UniqueName: \"kubernetes.io/projected/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-kube-api-access-ph8cc\") pod \"maas-controller-6d47c8d5b4-9frfx\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") " pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:00.913759 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.913738    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-webhook-cert\") pod \"maas-controller-6d47c8d5b4-9frfx\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") " pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:00.919930 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:00.919907    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph8cc\" (UniqueName: \"kubernetes.io/projected/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-kube-api-access-ph8cc\") pod \"maas-controller-6d47c8d5b4-9frfx\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") " pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:01.013149 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:01.013122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff96b9bc-m65jz"]
Jul 05 19:42:01.014615 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:42:01.014582    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31368728_660d_4af2_bbbb_044d02d33624.slice/crio-f101c538c650d4dbd623407c3080f2c0ff1fc981a73feb5c53d9204f30e5f4ea WatchSource:0}: Error finding container f101c538c650d4dbd623407c3080f2c0ff1fc981a73feb5c53d9204f30e5f4ea: Status 404 returned error can't find the container with id f101c538c650d4dbd623407c3080f2c0ff1fc981a73feb5c53d9204f30e5f4ea
Jul 05 19:42:01.045325 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:01.045303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:01.173215 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:01.173189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-9frfx"]
Jul 05 19:42:01.174314 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:42:01.174289    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90113f98_fddc_41e9_8dc5_8ec0e4b8e595.slice/crio-2d20c4037c07b74036319dd35d29e1cad978a1ca9146109e02bc38f553a4014c WatchSource:0}: Error finding container 2d20c4037c07b74036319dd35d29e1cad978a1ca9146109e02bc38f553a4014c: Status 404 returned error can't find the container with id 2d20c4037c07b74036319dd35d29e1cad978a1ca9146109e02bc38f553a4014c
Jul 05 19:42:01.316181 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:01.316151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff96b9bc-m65jz" event={"ID":"31368728-660d-4af2-bbbb-044d02d33624","Type":"ContainerStarted","Data":"f101c538c650d4dbd623407c3080f2c0ff1fc981a73feb5c53d9204f30e5f4ea"}
Jul 05 19:42:01.317256 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:01.317229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx" event={"ID":"90113f98-fddc-41e9-8dc5-8ec0e4b8e595","Type":"ContainerStarted","Data":"2d20c4037c07b74036319dd35d29e1cad978a1ca9146109e02bc38f553a4014c"}
Jul 05 19:42:03.334497 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.334452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff96b9bc-m65jz" event={"ID":"31368728-660d-4af2-bbbb-044d02d33624","Type":"ContainerStarted","Data":"93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8"}
Jul 05 19:42:03.334960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.334558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:03.336109 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.336083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx" event={"ID":"90113f98-fddc-41e9-8dc5-8ec0e4b8e595","Type":"ContainerStarted","Data":"45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9"}
Jul 05 19:42:03.336265 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.336205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:03.357887 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.357839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ff96b9bc-m65jz" podStartSLOduration=1.213196299 podStartE2EDuration="3.357824174s" totalImagesPullingTime="2.144627875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:42:03.356816298 +0000 UTC m=+568.179306972" watchObservedRunningTime="2026-07-05 19:42:03.357824174 +0000 UTC m=+568.180314851"
Jul 05 19:42:03.409704 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.409638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:03.490140 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:03.490114    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:14.345784 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.345751    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:14.346266 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.346192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:42:14.367250 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.367207    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx" podStartSLOduration=12.38972518 podStartE2EDuration="14.367193529s" totalImagesPullingTime="1.977468349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:42:03.384885406 +0000 UTC m=+568.207376087" watchObservedRunningTime="2026-07-05 19:42:14.367193529 +0000 UTC m=+579.189684210"
Jul 05 19:42:14.412154 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.412123    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff96b9bc-m65jz"]
Jul 05 19:42:14.412354 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.412295    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-ff96b9bc-m65jz" podUID="31368728-660d-4af2-bbbb-044d02d33624" containerName="manager" containerID="cri-o://93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8" gracePeriod=30
Jul 05 19:42:14.649457 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.649430    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:14.712099 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.712076    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmnsq\" (UniqueName: \"kubernetes.io/projected/31368728-660d-4af2-bbbb-044d02d33624-kube-api-access-fmnsq\") pod \"31368728-660d-4af2-bbbb-044d02d33624\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") "
Jul 05 19:42:14.712234 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.712152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31368728-660d-4af2-bbbb-044d02d33624-webhook-cert\") pod \"31368728-660d-4af2-bbbb-044d02d33624\" (UID: \"31368728-660d-4af2-bbbb-044d02d33624\") "
Jul 05 19:42:14.714201 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.714175    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31368728-660d-4af2-bbbb-044d02d33624-kube-api-access-fmnsq" (OuterVolumeSpecName: "kube-api-access-fmnsq") pod "31368728-660d-4af2-bbbb-044d02d33624" (UID: "31368728-660d-4af2-bbbb-044d02d33624"). InnerVolumeSpecName "kube-api-access-fmnsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:42:14.714269 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.714194    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31368728-660d-4af2-bbbb-044d02d33624-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "31368728-660d-4af2-bbbb-044d02d33624" (UID: "31368728-660d-4af2-bbbb-044d02d33624"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:42:14.813540 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.813513    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmnsq\" (UniqueName: \"kubernetes.io/projected/31368728-660d-4af2-bbbb-044d02d33624-kube-api-access-fmnsq\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:42:14.813540 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:14.813537    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31368728-660d-4af2-bbbb-044d02d33624-webhook-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:42:15.397964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.397935    2579 generic.go:356] "Generic (PLEG): container finished" podID="31368728-660d-4af2-bbbb-044d02d33624" containerID="93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8" exitCode=0
Jul 05 19:42:15.398344 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.397978    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff96b9bc-m65jz"
Jul 05 19:42:15.398344 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.397979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff96b9bc-m65jz" event={"ID":"31368728-660d-4af2-bbbb-044d02d33624","Type":"ContainerDied","Data":"93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8"}
Jul 05 19:42:15.398344 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.398084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff96b9bc-m65jz" event={"ID":"31368728-660d-4af2-bbbb-044d02d33624","Type":"ContainerDied","Data":"f101c538c650d4dbd623407c3080f2c0ff1fc981a73feb5c53d9204f30e5f4ea"}
Jul 05 19:42:15.398344 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.398106    2579 scope.go:117] "RemoveContainer" containerID="93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8"
Jul 05 19:42:15.407121 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.407101    2579 scope.go:117] "RemoveContainer" containerID="93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8"
Jul 05 19:42:15.407383 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:42:15.407365    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8\": container with ID starting with 93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8 not found: ID does not exist" containerID="93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8"
Jul 05 19:42:15.407450 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.407396    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8"} err="failed to get container status \"93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8\": rpc error: code = NotFound desc = could not find container \"93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8\": container with ID starting with 93a2426fe053c5e5b32d8d6638f90749e45402937b05f3e718e640ba9b8ca1f8 not found: ID does not exist"
Jul 05 19:42:15.421250 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.421228    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff96b9bc-m65jz"]
Jul 05 19:42:15.423213 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.423193    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ff96b9bc-m65jz"]
Jul 05 19:42:15.622341 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:15.622308    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31368728-660d-4af2-bbbb-044d02d33624" path="/var/lib/kubelet/pods/31368728-660d-4af2-bbbb-044d02d33624/volumes"
Jul 05 19:42:23.376178 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:23.376146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:30.985338 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:30.985304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:31.038998 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:31.038960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:35.782428 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:35.782397    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:36.409681 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.409641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:36.457928 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.457902    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-868fb55c58-xhrrh"]
Jul 05 19:42:36.458264 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.458251    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31368728-660d-4af2-bbbb-044d02d33624" containerName="manager"
Jul 05 19:42:36.458264 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.458265    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31368728-660d-4af2-bbbb-044d02d33624" containerName="manager"
Jul 05 19:42:36.458354 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.458314    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31368728-660d-4af2-bbbb-044d02d33624" containerName="manager"
Jul 05 19:42:36.464667 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.464650    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.468887 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.468867    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\""
Jul 05 19:42:36.469087 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.469072    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 05 19:42:36.479974 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.479953    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-868fb55c58-xhrrh"]
Jul 05 19:42:36.526311 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.526287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:36.582261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.582227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af357c79-2298-4856-bca9-95120a3c6cab-maas-api-tls\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.582261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.582263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af357c79-2298-4856-bca9-95120a3c6cab-openshift-service-ca\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.582434 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.582322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgls\" (UniqueName: \"kubernetes.io/projected/af357c79-2298-4856-bca9-95120a3c6cab-kube-api-access-jsgls\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.683721 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.683634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af357c79-2298-4856-bca9-95120a3c6cab-maas-api-tls\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.683721 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.683669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af357c79-2298-4856-bca9-95120a3c6cab-openshift-service-ca\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.683721 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.683716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgls\" (UniqueName: \"kubernetes.io/projected/af357c79-2298-4856-bca9-95120a3c6cab-kube-api-access-jsgls\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.684577 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.684543    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af357c79-2298-4856-bca9-95120a3c6cab-openshift-service-ca\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.686578 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.686556    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af357c79-2298-4856-bca9-95120a3c6cab-maas-api-tls\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.691870 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.691844    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgls\" (UniqueName: \"kubernetes.io/projected/af357c79-2298-4856-bca9-95120a3c6cab-kube-api-access-jsgls\") pod \"maas-api-868fb55c58-xhrrh\" (UID: \"af357c79-2298-4856-bca9-95120a3c6cab\") " pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.774904 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.774876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:36.836300 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.836272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:36.923339 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.923313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-868fb55c58-xhrrh"]
Jul 05 19:42:36.924404 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.924359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:36.924491 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:42:36.924435    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf357c79_2298_4856_bca9_95120a3c6cab.slice/crio-db1ed6794807a0408f46952a57f14d1a64e88b007767ea415ad5e66977297ce6 WatchSource:0}: Error finding container db1ed6794807a0408f46952a57f14d1a64e88b007767ea415ad5e66977297ce6: Status 404 returned error can't find the container with id db1ed6794807a0408f46952a57f14d1a64e88b007767ea415ad5e66977297ce6
Jul 05 19:42:36.950991 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.950928    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-dfg79"]
Jul 05 19:42:36.956781 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.956762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:36.960187 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.960167    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 05 19:42:36.960297 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.960174    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vf8f9\""
Jul 05 19:42:36.966154 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.966133    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-dfg79"]
Jul 05 19:42:36.981535 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.981511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mxbvl"]
Jul 05 19:42:36.985644 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.985628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:36.995765 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:36.995742    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mxbvl"]
Jul 05 19:42:37.087044 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.087005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpq4\" (UniqueName: \"kubernetes.io/projected/b0c2ccd6-a0df-4753-8401-534ddc467f26-kube-api-access-nxpq4\") pod \"payload-pre-processing-7964457696-dfg79\" (UID: \"b0c2ccd6-a0df-4753-8401-534ddc467f26\") " pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.087208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.087069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/525d16b5-426e-4591-8f25-a01402bd913f-plugins-config-volume\") pod \"payload-processing-58f86c7798-mxbvl\" (UID: \"525d16b5-426e-4591-8f25-a01402bd913f\") " pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.087208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.087115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0c2ccd6-a0df-4753-8401-534ddc467f26-plugins-config-volume\") pod \"payload-pre-processing-7964457696-dfg79\" (UID: \"b0c2ccd6-a0df-4753-8401-534ddc467f26\") " pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.087208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.087139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9zvh\" (UniqueName: \"kubernetes.io/projected/525d16b5-426e-4591-8f25-a01402bd913f-kube-api-access-t9zvh\") pod \"payload-processing-58f86c7798-mxbvl\" (UID: \"525d16b5-426e-4591-8f25-a01402bd913f\") " pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.188450 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.188405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpq4\" (UniqueName: \"kubernetes.io/projected/b0c2ccd6-a0df-4753-8401-534ddc467f26-kube-api-access-nxpq4\") pod \"payload-pre-processing-7964457696-dfg79\" (UID: \"b0c2ccd6-a0df-4753-8401-534ddc467f26\") " pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.188608 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.188498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/525d16b5-426e-4591-8f25-a01402bd913f-plugins-config-volume\") pod \"payload-processing-58f86c7798-mxbvl\" (UID: \"525d16b5-426e-4591-8f25-a01402bd913f\") " pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.188608 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.188538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0c2ccd6-a0df-4753-8401-534ddc467f26-plugins-config-volume\") pod \"payload-pre-processing-7964457696-dfg79\" (UID: \"b0c2ccd6-a0df-4753-8401-534ddc467f26\") " pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.188608 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.188570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9zvh\" (UniqueName: \"kubernetes.io/projected/525d16b5-426e-4591-8f25-a01402bd913f-kube-api-access-t9zvh\") pod \"payload-processing-58f86c7798-mxbvl\" (UID: \"525d16b5-426e-4591-8f25-a01402bd913f\") " pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.189302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.189270    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0c2ccd6-a0df-4753-8401-534ddc467f26-plugins-config-volume\") pod \"payload-pre-processing-7964457696-dfg79\" (UID: \"b0c2ccd6-a0df-4753-8401-534ddc467f26\") " pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.189424 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.189313    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/525d16b5-426e-4591-8f25-a01402bd913f-plugins-config-volume\") pod \"payload-processing-58f86c7798-mxbvl\" (UID: \"525d16b5-426e-4591-8f25-a01402bd913f\") " pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.196501 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.196473    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpq4\" (UniqueName: \"kubernetes.io/projected/b0c2ccd6-a0df-4753-8401-534ddc467f26-kube-api-access-nxpq4\") pod \"payload-pre-processing-7964457696-dfg79\" (UID: \"b0c2ccd6-a0df-4753-8401-534ddc467f26\") " pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.196990 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.196967    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9zvh\" (UniqueName: \"kubernetes.io/projected/525d16b5-426e-4591-8f25-a01402bd913f-kube-api-access-t9zvh\") pod \"payload-processing-58f86c7798-mxbvl\" (UID: \"525d16b5-426e-4591-8f25-a01402bd913f\") " pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.268674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.268647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:37.295913 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.295889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:37.441677 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.441651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-dfg79"]
Jul 05 19:42:37.443558 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:42:37.443529    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c2ccd6_a0df_4753_8401_534ddc467f26.slice/crio-d5173370a790d7067cba22a69784eebf5a0757f20f9c15b4aa934c264dcf2428 WatchSource:0}: Error finding container d5173370a790d7067cba22a69784eebf5a0757f20f9c15b4aa934c264dcf2428: Status 404 returned error can't find the container with id d5173370a790d7067cba22a69784eebf5a0757f20f9c15b4aa934c264dcf2428
Jul 05 19:42:37.457789 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.457768    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mxbvl"]
Jul 05 19:42:37.459019 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:42:37.458996    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525d16b5_426e_4591_8f25_a01402bd913f.slice/crio-e75a47decf8db0dcc94555b78a187a6fb6bd9f62e5184359d84ed342c6260b6d WatchSource:0}: Error finding container e75a47decf8db0dcc94555b78a187a6fb6bd9f62e5184359d84ed342c6260b6d: Status 404 returned error can't find the container with id e75a47decf8db0dcc94555b78a187a6fb6bd9f62e5184359d84ed342c6260b6d
Jul 05 19:42:37.507908 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.507880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-868fb55c58-xhrrh" event={"ID":"af357c79-2298-4856-bca9-95120a3c6cab","Type":"ContainerStarted","Data":"db1ed6794807a0408f46952a57f14d1a64e88b007767ea415ad5e66977297ce6"}
Jul 05 19:42:37.509088 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.509061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl" event={"ID":"525d16b5-426e-4591-8f25-a01402bd913f","Type":"ContainerStarted","Data":"e75a47decf8db0dcc94555b78a187a6fb6bd9f62e5184359d84ed342c6260b6d"}
Jul 05 19:42:37.510234 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:37.510213    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79" event={"ID":"b0c2ccd6-a0df-4753-8401-534ddc467f26","Type":"ContainerStarted","Data":"d5173370a790d7067cba22a69784eebf5a0757f20f9c15b4aa934c264dcf2428"}
Jul 05 19:42:39.526873 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.526830    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-868fb55c58-xhrrh" event={"ID":"af357c79-2298-4856-bca9-95120a3c6cab","Type":"ContainerStarted","Data":"1b9496b1233cac6d4ebe741df4697d2bcf0fd7e6549d73bc9083415e47de446b"}
Jul 05 19:42:39.527633 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.527606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:39.530197 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.530168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl" event={"ID":"525d16b5-426e-4591-8f25-a01402bd913f","Type":"ContainerStarted","Data":"342878cc71a629f2a860d8d5554524389e98eb1f9b0e95e4a3be0223b5845e2b"}
Jul 05 19:42:39.530298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.530219    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:39.531899 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.531872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79" event={"ID":"b0c2ccd6-a0df-4753-8401-534ddc467f26","Type":"ContainerStarted","Data":"6294c57b4bccd86ac080dce42f47b2a4501cf0e1d01eb8d80df8d1bba8286817"}
Jul 05 19:42:39.532314 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.532290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:42:39.553070 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.553009    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-868fb55c58-xhrrh" podStartSLOduration=1.359705868 podStartE2EDuration="3.552989681s" totalImagesPullingTime="2.193283813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:42:39.55205786 +0000 UTC m=+604.374548545" watchObservedRunningTime="2026-07-05 19:42:39.552989681 +0000 UTC m=+604.375480368"
Jul 05 19:42:39.571260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.571216    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl" podStartSLOduration=1.910165299 podStartE2EDuration="3.571199486s" totalImagesPullingTime="1.661034187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:42:39.568447396 +0000 UTC m=+604.390938091" watchObservedRunningTime="2026-07-05 19:42:39.571199486 +0000 UTC m=+604.393690170"
Jul 05 19:42:39.584471 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:39.584431    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79" podStartSLOduration=1.910739972 podStartE2EDuration="3.584417352s" totalImagesPullingTime="1.67367738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:42:39.583848727 +0000 UTC m=+604.406339410" watchObservedRunningTime="2026-07-05 19:42:39.584417352 +0000 UTC m=+604.406908035"
Jul 05 19:42:44.562035 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:44.562012    2579 generic.go:356] "Generic (PLEG): container finished" podID="f37e863c-27a5-4596-aaf5-fafac05cb182" containerID="c3056b91796da7f6068934e3b5f488a01e3858ecc97f0d8d3af95131ff3de3e7" exitCode=0
Jul 05 19:42:44.562437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:44.562091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" event={"ID":"f37e863c-27a5-4596-aaf5-fafac05cb182","Type":"ContainerDied","Data":"c3056b91796da7f6068934e3b5f488a01e3858ecc97f0d8d3af95131ff3de3e7"}
Jul 05 19:42:44.562559 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:44.562542    2579 scope.go:117] "RemoveContainer" containerID="c3056b91796da7f6068934e3b5f488a01e3858ecc97f0d8d3af95131ff3de3e7"
Jul 05 19:42:44.563506 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:44.563481    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:42:44.563596 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:44.563544    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:42:44.563596 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:44.563574    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:42:45.569261 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:45.569227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" event={"ID":"f37e863c-27a5-4596-aaf5-fafac05cb182","Type":"ContainerStarted","Data":"38df2434bae04788bb3cdf8a69c3d40d6275c24e8b9e79693857ba110ec4beeb"}
Jul 05 19:42:45.862488 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:45.862388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:42:45.863656 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:45.863618    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7ppqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 05 19:42:45.863782 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:45.863691    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" podUID="f37e863c-27a5-4596-aaf5-fafac05cb182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 05 19:42:46.552606 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:46.552571    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-868fb55c58-xhrrh"
Jul 05 19:42:46.862020 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:46.861940    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7ppqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 05 19:42:46.862020 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:46.861999    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" podUID="f37e863c-27a5-4596-aaf5-fafac05cb182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 05 19:42:47.064598 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:47.064563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:42:47.519293 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:47.519263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:47.862592 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:47.862509    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7ppqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 05 19:42:47.862592 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:47.862572    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" podUID="f37e863c-27a5-4596-aaf5-fafac05cb182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 05 19:42:48.834575 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:48.834543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:48.862405 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:48.862372    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7ppqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 05 19:42:48.862567 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:48.862428    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs" podUID="f37e863c-27a5-4596-aaf5-fafac05cb182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 05 19:42:49.865024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:49.864996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:42:49.865966 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:49.865944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7ppqs"
Jul 05 19:42:50.541791 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:50.541763    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-mxbvl"
Jul 05 19:42:51.547187 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:51.547143    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79" podUID="b0c2ccd6-a0df-4753-8401-534ddc467f26" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.47:9004: connect: connection refused"
Jul 05 19:42:58.072221 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.072129    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"]
Jul 05 19:42:58.076852 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.076832    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.080171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.080123    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 05 19:42:58.080171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.080123    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 05 19:42:58.080171 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.080125    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 05 19:42:58.081252 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.081235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nd7wp\""
Jul 05 19:42:58.087374 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.087340    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"]
Jul 05 19:42:58.106977 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.106953    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:42:58.176039 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.176018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.176158 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.176048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7ea43b-97e1-42b7-9957-224c69f758e8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.176158 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.176069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.176158 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.176087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.176158 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.176124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcq97\" (UniqueName: \"kubernetes.io/projected/7e7ea43b-97e1-42b7-9957-224c69f758e8-kube-api-access-lcq97\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.176158 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.176154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.276847 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.276793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.276860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7ea43b-97e1-42b7-9957-224c69f758e8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.276892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.276914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.276939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcq97\" (UniqueName: \"kubernetes.io/projected/7e7ea43b-97e1-42b7-9957-224c69f758e8-kube-api-access-lcq97\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277037 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.276985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277326 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.277308    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277414 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.277394    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.277476 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.277400    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.279133 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.279111    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e7ea43b-97e1-42b7-9957-224c69f758e8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.279787 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.279765    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7ea43b-97e1-42b7-9957-224c69f758e8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.284465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.284441    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcq97\" (UniqueName: \"kubernetes.io/projected/7e7ea43b-97e1-42b7-9957-224c69f758e8-kube-api-access-lcq97\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv\" (UID: \"7e7ea43b-97e1-42b7-9957-224c69f758e8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.388947 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.388860    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:42:58.525519 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.525487    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"]
Jul 05 19:42:58.526010 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:42:58.525982    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7ea43b_97e1_42b7_9957_224c69f758e8.slice/crio-15cc53ca5d3751f6af1bb278e19d81e96281626c80000ba3287799ad91791231 WatchSource:0}: Error finding container 15cc53ca5d3751f6af1bb278e19d81e96281626c80000ba3287799ad91791231: Status 404 returned error can't find the container with id 15cc53ca5d3751f6af1bb278e19d81e96281626c80000ba3287799ad91791231
Jul 05 19:42:58.527751 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.527730    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 19:42:58.636357 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:42:58.636323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv" event={"ID":"7e7ea43b-97e1-42b7-9957-224c69f758e8","Type":"ContainerStarted","Data":"15cc53ca5d3751f6af1bb278e19d81e96281626c80000ba3287799ad91791231"}
Jul 05 19:43:00.655161 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:00.655122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv" event={"ID":"7e7ea43b-97e1-42b7-9957-224c69f758e8","Type":"ContainerStarted","Data":"f29d7ba66a01472051a554f19500d41015e4b09c44ba51943adfc8be3202a0d1"}
Jul 05 19:43:00.671822 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:00.671743    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv" podStartSLOduration=1.5704208149999999 podStartE2EDuration="2.671729029s" totalImagesPullingTime="1.101308214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:43:00.670784576 +0000 UTC m=+625.493275263" watchObservedRunningTime="2026-07-05 19:43:00.671729029 +0000 UTC m=+625.494219710"
Jul 05 19:43:01.547260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:01.547230    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-dfg79"
Jul 05 19:43:06.693971 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:06.693941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:43:08.388980 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:08.388931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:43:08.389404 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:08.389007    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:43:08.401664 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:08.401642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:43:08.708516 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:08.708438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv"
Jul 05 19:43:15.728226 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.728193    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"]
Jul 05 19:43:15.733843 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.733819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.737783 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.737755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 05 19:43:15.744108 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.744087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"]
Jul 05 19:43:15.782550 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.782514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:43:15.818550 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.818527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskl4\" (UniqueName: \"kubernetes.io/projected/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-kube-api-access-mskl4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.818663 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.818561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.818663 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.818587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.818663 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.818626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.818771 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.818665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.818771 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.818725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919486 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919486 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919486 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskl4\" (UniqueName: \"kubernetes.io/projected/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-kube-api-access-mskl4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.919960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.920279 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.919966    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.920279 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.920062    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.921772 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.921751    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.922070 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.922054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:15.927522 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:15.927505    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskl4\" (UniqueName: \"kubernetes.io/projected/8d4746d2-1f3b-4d6c-87f0-bd223fe5e600-kube-api-access-mskl4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zqpwr\" (UID: \"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:16.046011 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:16.045984    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:16.175585 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:16.175556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"]
Jul 05 19:43:16.179302 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:43:16.179237    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4746d2_1f3b_4d6c_87f0_bd223fe5e600.slice/crio-5984da024ed07adfb5a4616f721d596cfb238ab40c0f3169fb02ee361b630b25 WatchSource:0}: Error finding container 5984da024ed07adfb5a4616f721d596cfb238ab40c0f3169fb02ee361b630b25: Status 404 returned error can't find the container with id 5984da024ed07adfb5a4616f721d596cfb238ab40c0f3169fb02ee361b630b25
Jul 05 19:43:16.737219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:16.737165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr" event={"ID":"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600","Type":"ContainerStarted","Data":"cac956a2d0e0ce9236c944608d64d132b3c64048b7829909302196bcf66285cc"}
Jul 05 19:43:16.737219 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:16.737216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr" event={"ID":"8d4746d2-1f3b-4d6c-87f0-bd223fe5e600","Type":"ContainerStarted","Data":"5984da024ed07adfb5a4616f721d596cfb238ab40c0f3169fb02ee361b630b25"}
Jul 05 19:43:16.755336 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:16.755293    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr" podStartSLOduration=1.5840312349999999 podStartE2EDuration="1.755277979s" totalImagesPullingTime="171.246744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:43:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:43:16.753911509 +0000 UTC m=+641.576402191" watchObservedRunningTime="2026-07-05 19:43:16.755277979 +0000 UTC m=+641.577768660"
Jul 05 19:43:26.047048 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:26.047019    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:26.047423 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:26.047082    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:26.059085 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:26.059062    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:26.798845 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:26.798816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zqpwr"
Jul 05 19:43:32.120363 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:32.120328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:43:48.888538 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:48.888490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:43:48.939317 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:48.939284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:43:54.614941 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:43:54.614906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:44:01.905645 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:01.905606    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:44:53.913007 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:53.912930    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c7d669ff5-pzm9m"]
Jul 05 19:44:53.916449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:53.916430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:53.925640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:53.925609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c7d669ff5-pzm9m"]
Jul 05 19:44:54.014418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.014391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9nhp\" (UniqueName: \"kubernetes.io/projected/81816504-cc9a-4dbb-a605-618e06b84f71-kube-api-access-l9nhp\") pod \"authorino-5c7d669ff5-pzm9m\" (UID: \"81816504-cc9a-4dbb-a605-618e06b84f71\") " pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.014546 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.014436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81816504-cc9a-4dbb-a605-618e06b84f71-tls-cert\") pod \"authorino-5c7d669ff5-pzm9m\" (UID: \"81816504-cc9a-4dbb-a605-618e06b84f71\") " pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.115212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.115182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9nhp\" (UniqueName: \"kubernetes.io/projected/81816504-cc9a-4dbb-a605-618e06b84f71-kube-api-access-l9nhp\") pod \"authorino-5c7d669ff5-pzm9m\" (UID: \"81816504-cc9a-4dbb-a605-618e06b84f71\") " pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.115326 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.115234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81816504-cc9a-4dbb-a605-618e06b84f71-tls-cert\") pod \"authorino-5c7d669ff5-pzm9m\" (UID: \"81816504-cc9a-4dbb-a605-618e06b84f71\") " pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.117819 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.117769    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81816504-cc9a-4dbb-a605-618e06b84f71-tls-cert\") pod \"authorino-5c7d669ff5-pzm9m\" (UID: \"81816504-cc9a-4dbb-a605-618e06b84f71\") " pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.124444 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.124411    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9nhp\" (UniqueName: \"kubernetes.io/projected/81816504-cc9a-4dbb-a605-618e06b84f71-kube-api-access-l9nhp\") pod \"authorino-5c7d669ff5-pzm9m\" (UID: \"81816504-cc9a-4dbb-a605-618e06b84f71\") " pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.226266 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.226215    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7d669ff5-pzm9m"
Jul 05 19:44:54.354372 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.354327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:44:54.363004 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.362932    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c7d669ff5-pzm9m"]
Jul 05 19:44:54.365113 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:44:54.365079    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81816504_cc9a_4dbb_a605_618e06b84f71.slice/crio-e2eb6052b03ef405c0fc77893cbb18c4b12ba2b453d4b4968d35e4af5b196179 WatchSource:0}: Error finding container e2eb6052b03ef405c0fc77893cbb18c4b12ba2b453d4b4968d35e4af5b196179: Status 404 returned error can't find the container with id e2eb6052b03ef405c0fc77893cbb18c4b12ba2b453d4b4968d35e4af5b196179
Jul 05 19:44:54.453080 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:54.453054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:44:55.225053 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.225014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7d669ff5-pzm9m" event={"ID":"81816504-cc9a-4dbb-a605-618e06b84f71","Type":"ContainerStarted","Data":"ee36b68d45069def874141a324398bffae87a1608b1228c77789c7e0de96abc2"}
Jul 05 19:44:55.225506 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.225064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7d669ff5-pzm9m" event={"ID":"81816504-cc9a-4dbb-a605-618e06b84f71","Type":"ContainerStarted","Data":"e2eb6052b03ef405c0fc77893cbb18c4b12ba2b453d4b4968d35e4af5b196179"}
Jul 05 19:44:55.247464 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.247396    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c7d669ff5-pzm9m" podStartSLOduration=1.906524077 podStartE2EDuration="2.247375549s" totalImagesPullingTime="340.851472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:44:55.243877255 +0000 UTC m=+740.066367938" watchObservedRunningTime="2026-07-05 19:44:55.247375549 +0000 UTC m=+740.069866235"
Jul 05 19:44:55.285669 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.285632    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cfc9dddb-flls5"]
Jul 05 19:44:55.286143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.286110    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56cfc9dddb-flls5" podUID="6906d47d-b1e7-4294-8d02-b640e431f9e7" containerName="authorino" containerID="cri-o://fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5" gracePeriod=30
Jul 05 19:44:55.458668 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.458633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:44:55.541674 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.541646    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:44:55.563504 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.563436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:44:55.730453 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.730419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6906d47d-b1e7-4294-8d02-b640e431f9e7-tls-cert\") pod \"6906d47d-b1e7-4294-8d02-b640e431f9e7\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") "
Jul 05 19:44:55.730637 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.730554    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv9bs\" (UniqueName: \"kubernetes.io/projected/6906d47d-b1e7-4294-8d02-b640e431f9e7-kube-api-access-mv9bs\") pod \"6906d47d-b1e7-4294-8d02-b640e431f9e7\" (UID: \"6906d47d-b1e7-4294-8d02-b640e431f9e7\") "
Jul 05 19:44:55.732552 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.732517    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6906d47d-b1e7-4294-8d02-b640e431f9e7-kube-api-access-mv9bs" (OuterVolumeSpecName: "kube-api-access-mv9bs") pod "6906d47d-b1e7-4294-8d02-b640e431f9e7" (UID: "6906d47d-b1e7-4294-8d02-b640e431f9e7"). InnerVolumeSpecName "kube-api-access-mv9bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:44:55.740772 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.740745    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6906d47d-b1e7-4294-8d02-b640e431f9e7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6906d47d-b1e7-4294-8d02-b640e431f9e7" (UID: "6906d47d-b1e7-4294-8d02-b640e431f9e7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:44:55.831853 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.831761    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6906d47d-b1e7-4294-8d02-b640e431f9e7-tls-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:44:55.831853 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:55.831791    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9bs\" (UniqueName: \"kubernetes.io/projected/6906d47d-b1e7-4294-8d02-b640e431f9e7-kube-api-access-mv9bs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:44:56.232906 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.232868    2579 generic.go:356] "Generic (PLEG): container finished" podID="6906d47d-b1e7-4294-8d02-b640e431f9e7" containerID="fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5" exitCode=0
Jul 05 19:44:56.233335 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.232912    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfc9dddb-flls5"
Jul 05 19:44:56.233335 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.232960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfc9dddb-flls5" event={"ID":"6906d47d-b1e7-4294-8d02-b640e431f9e7","Type":"ContainerDied","Data":"fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5"}
Jul 05 19:44:56.233335 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.233000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfc9dddb-flls5" event={"ID":"6906d47d-b1e7-4294-8d02-b640e431f9e7","Type":"ContainerDied","Data":"fff35853fc287e9e3d2d842c02e212ab202a3a6530e562683dc06aeb11cd680c"}
Jul 05 19:44:56.233335 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.233024    2579 scope.go:117] "RemoveContainer" containerID="fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5"
Jul 05 19:44:56.243235 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.243220    2579 scope.go:117] "RemoveContainer" containerID="fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5"
Jul 05 19:44:56.243511 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:44:56.243489    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5\": container with ID starting with fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5 not found: ID does not exist" containerID="fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5"
Jul 05 19:44:56.243584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.243521    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5"} err="failed to get container status \"fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5\": rpc error: code = NotFound desc = could not find container \"fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5\": container with ID starting with fc9884178542596e345da4b1b8e8f00e396b6db16ca58ba40cd75553151334a5 not found: ID does not exist"
Jul 05 19:44:56.257322 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.257297    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cfc9dddb-flls5"]
Jul 05 19:44:56.267728 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:56.267696    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56cfc9dddb-flls5"]
Jul 05 19:44:57.617447 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:44:57.617407    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6906d47d-b1e7-4294-8d02-b640e431f9e7" path="/var/lib/kubelet/pods/6906d47d-b1e7-4294-8d02-b640e431f9e7/volumes"
Jul 05 19:45:04.046183 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:45:04.046151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:45:04.145405 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:45:04.145372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:45:25.510078 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:45:25.510050    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:05.047986 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.047909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:05.158458 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.158426    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-9frfx"]
Jul 05 19:46:05.158694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.158657    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx" podUID="90113f98-fddc-41e9-8dc5-8ec0e4b8e595" containerName="manager" containerID="cri-o://45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9" gracePeriod=30
Jul 05 19:46:05.402428 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.402402    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:46:05.516441 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.516411    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-webhook-cert\") pod \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") "
Jul 05 19:46:05.516630 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.516488    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph8cc\" (UniqueName: \"kubernetes.io/projected/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-kube-api-access-ph8cc\") pod \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\" (UID: \"90113f98-fddc-41e9-8dc5-8ec0e4b8e595\") "
Jul 05 19:46:05.518499 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.518470    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-kube-api-access-ph8cc" (OuterVolumeSpecName: "kube-api-access-ph8cc") pod "90113f98-fddc-41e9-8dc5-8ec0e4b8e595" (UID: "90113f98-fddc-41e9-8dc5-8ec0e4b8e595"). InnerVolumeSpecName "kube-api-access-ph8cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:46:05.518499 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.518484    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90113f98-fddc-41e9-8dc5-8ec0e4b8e595" (UID: "90113f98-fddc-41e9-8dc5-8ec0e4b8e595"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:46:05.582860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.582775    2579 generic.go:356] "Generic (PLEG): container finished" podID="90113f98-fddc-41e9-8dc5-8ec0e4b8e595" containerID="45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9" exitCode=0
Jul 05 19:46:05.582860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.582829    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx"
Jul 05 19:46:05.582860 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.582832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx" event={"ID":"90113f98-fddc-41e9-8dc5-8ec0e4b8e595","Type":"ContainerDied","Data":"45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9"}
Jul 05 19:46:05.583044 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.582887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d47c8d5b4-9frfx" event={"ID":"90113f98-fddc-41e9-8dc5-8ec0e4b8e595","Type":"ContainerDied","Data":"2d20c4037c07b74036319dd35d29e1cad978a1ca9146109e02bc38f553a4014c"}
Jul 05 19:46:05.583044 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.582909    2579 scope.go:117] "RemoveContainer" containerID="45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9"
Jul 05 19:46:05.592455 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.592438    2579 scope.go:117] "RemoveContainer" containerID="45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9"
Jul 05 19:46:05.592693 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:46:05.592677    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9\": container with ID starting with 45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9 not found: ID does not exist" containerID="45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9"
Jul 05 19:46:05.592738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.592701    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9"} err="failed to get container status \"45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9\": rpc error: code = NotFound desc = could not find container \"45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9\": container with ID starting with 45d1e984039ce9b2f8842371390a0b1c107b5e542f7e13e87af3743ec8fae0c9 not found: ID does not exist"
Jul 05 19:46:05.604562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.604539    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-9frfx"]
Jul 05 19:46:05.608112 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.608091    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-9frfx"]
Jul 05 19:46:05.619192 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.619165    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-webhook-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:46:05.619303 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.619198    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph8cc\" (UniqueName: \"kubernetes.io/projected/90113f98-fddc-41e9-8dc5-8ec0e4b8e595-kube-api-access-ph8cc\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:46:05.622255 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:05.622233    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90113f98-fddc-41e9-8dc5-8ec0e4b8e595" path="/var/lib/kubelet/pods/90113f98-fddc-41e9-8dc5-8ec0e4b8e595/volumes"
Jul 05 19:46:06.244767 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.244732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:06.356750 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.356722    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-h9x6r"]
Jul 05 19:46:06.357090 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.357078    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6906d47d-b1e7-4294-8d02-b640e431f9e7" containerName="authorino"
Jul 05 19:46:06.357141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.357092    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6906d47d-b1e7-4294-8d02-b640e431f9e7" containerName="authorino"
Jul 05 19:46:06.357141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.357112    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90113f98-fddc-41e9-8dc5-8ec0e4b8e595" containerName="manager"
Jul 05 19:46:06.357141 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.357117    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90113f98-fddc-41e9-8dc5-8ec0e4b8e595" containerName="manager"
Jul 05 19:46:06.357230 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.357199    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6906d47d-b1e7-4294-8d02-b640e431f9e7" containerName="authorino"
Jul 05 19:46:06.357230 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.357209    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90113f98-fddc-41e9-8dc5-8ec0e4b8e595" containerName="manager"
Jul 05 19:46:06.361584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.361568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.365780 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.365761    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 05 19:46:06.365907 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.365816    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7n9c6\""
Jul 05 19:46:06.365907 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.365824    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 05 19:46:06.370843 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.370824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-h9x6r"]
Jul 05 19:46:06.427609 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.427583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kmpm\" (UniqueName: \"kubernetes.io/projected/7b48b231-dabf-4a88-9e3b-6e8464d10c41-kube-api-access-7kmpm\") pod \"maas-controller-6d47c8d5b4-h9x6r\" (UID: \"7b48b231-dabf-4a88-9e3b-6e8464d10c41\") " pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.427716 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.427625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b48b231-dabf-4a88-9e3b-6e8464d10c41-webhook-cert\") pod \"maas-controller-6d47c8d5b4-h9x6r\" (UID: \"7b48b231-dabf-4a88-9e3b-6e8464d10c41\") " pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.529013 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.528950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kmpm\" (UniqueName: \"kubernetes.io/projected/7b48b231-dabf-4a88-9e3b-6e8464d10c41-kube-api-access-7kmpm\") pod \"maas-controller-6d47c8d5b4-h9x6r\" (UID: \"7b48b231-dabf-4a88-9e3b-6e8464d10c41\") " pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.529013 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.528993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b48b231-dabf-4a88-9e3b-6e8464d10c41-webhook-cert\") pod \"maas-controller-6d47c8d5b4-h9x6r\" (UID: \"7b48b231-dabf-4a88-9e3b-6e8464d10c41\") " pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.531301 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.531273    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b48b231-dabf-4a88-9e3b-6e8464d10c41-webhook-cert\") pod \"maas-controller-6d47c8d5b4-h9x6r\" (UID: \"7b48b231-dabf-4a88-9e3b-6e8464d10c41\") " pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.536970 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.536948    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kmpm\" (UniqueName: \"kubernetes.io/projected/7b48b231-dabf-4a88-9e3b-6e8464d10c41-kube-api-access-7kmpm\") pod \"maas-controller-6d47c8d5b4-h9x6r\" (UID: \"7b48b231-dabf-4a88-9e3b-6e8464d10c41\") " pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.673372 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.673340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:06.802755 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:06.802733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d47c8d5b4-h9x6r"]
Jul 05 19:46:06.804438 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:46:06.804396    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b48b231_dabf_4a88_9e3b_6e8464d10c41.slice/crio-00ba57cd45a6fbf8ed611114989c937d73f9e0b68129fbccb9f13617f8541fc3 WatchSource:0}: Error finding container 00ba57cd45a6fbf8ed611114989c937d73f9e0b68129fbccb9f13617f8541fc3: Status 404 returned error can't find the container with id 00ba57cd45a6fbf8ed611114989c937d73f9e0b68129fbccb9f13617f8541fc3
Jul 05 19:46:07.595091 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:07.595056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r" event={"ID":"7b48b231-dabf-4a88-9e3b-6e8464d10c41","Type":"ContainerStarted","Data":"0b5f9c605343304fc5ddfa2301415545ec045292f6c2ff191b6efb0347dbbe1a"}
Jul 05 19:46:07.595447 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:07.595107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r" event={"ID":"7b48b231-dabf-4a88-9e3b-6e8464d10c41","Type":"ContainerStarted","Data":"00ba57cd45a6fbf8ed611114989c937d73f9e0b68129fbccb9f13617f8541fc3"}
Jul 05 19:46:07.595447 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:07.595129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:07.613273 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:07.613229    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r" podStartSLOduration=1.25825301 podStartE2EDuration="1.613213379s" totalImagesPullingTime="354.960369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:46:07.611850496 +0000 UTC m=+812.434341174" watchObservedRunningTime="2026-07-05 19:46:07.613213379 +0000 UTC m=+812.435704197"
Jul 05 19:46:18.606125 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:18.606097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d47c8d5b4-h9x6r"
Jul 05 19:46:48.749648 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:48.749612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:48.845226 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:48.845193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:48.967497 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:48.967465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:54.491722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:54.491692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:54.596475 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:54.596447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:54.692464 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:54.692435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:46:54.829180 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:46:54.829111    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:47:00.501114 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:47:00.501078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:47:00.601598 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:47:00.601565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:49:20.819074 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:49:20.819041    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:49:21.909199 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:49:21.909159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:50:22.591119 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:50:22.591081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:54:09.154212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:54:09.154183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:32.180510 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:32.180462    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:40.907282 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:40.907248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:44.968070 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:44.968017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:45.068514 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:45.068487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:49.178324 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:49.178281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:54.254124 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:54.254089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:57.070941 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:57.070905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:57.191725 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:57.191690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:57:57.559024 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:57:57.558985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:03.343889 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.343862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:03.396980 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.396950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:03.521744 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.521713    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"]
Jul 05 19:58:03.526649 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.526627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.529905 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.529886    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-da958447-openshift-default-dockercfg-p67j4\""
Jul 05 19:58:03.548466 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-credential-socket\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548580 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-envoy\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548580 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-certs\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548580 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-socket\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548580 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-data\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548580 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"]
Jul 05 19:58:03.548886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-istio-token\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72f705b2-1faf-4d28-8f91-7092401d4396-istio-podinfo\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72f705b2-1faf-4d28-8f91-7092401d4396-istiod-ca-cert\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.548886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.548756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9c5r\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-kube-api-access-q9c5r\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.561437 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.561405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:03.629071 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.629004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:03.649200 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-istio-token\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649318 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72f705b2-1faf-4d28-8f91-7092401d4396-istio-podinfo\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649405 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72f705b2-1faf-4d28-8f91-7092401d4396-istiod-ca-cert\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9c5r\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-kube-api-access-q9c5r\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649531 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-credential-socket\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649626 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-envoy\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649703 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-certs\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649762 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-socket\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649762 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-data\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.649925 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.649903    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-credential-socket\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.650134 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.650100    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-socket\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.650134 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.650120    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72f705b2-1faf-4d28-8f91-7092401d4396-istiod-ca-cert\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.650229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.650128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-certs\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.650229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.650142    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-data\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.652094 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.652070    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-envoy\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.652310 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.652290    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72f705b2-1faf-4d28-8f91-7092401d4396-istio-podinfo\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.657654 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.657627    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9c5r\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-kube-api-access-q9c5r\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.657869 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.657851    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-istio-token\") pod \"e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") " pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.836724 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.836686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:03.970878 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.970852    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"]
Jul 05 19:58:03.972654 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:58:03.972618    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f705b2_1faf_4d28_8f91_7092401d4396.slice/crio-46ea96596e4ceecf0ca7f1dea473cf5e8ba5e3feb66684279b59e591e28ebd3b WatchSource:0}: Error finding container 46ea96596e4ceecf0ca7f1dea473cf5e8ba5e3feb66684279b59e591e28ebd3b: Status 404 returned error can't find the container with id 46ea96596e4ceecf0ca7f1dea473cf5e8ba5e3feb66684279b59e591e28ebd3b
Jul 05 19:58:03.974769 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.974739    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:03.974886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.974820    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:03.974886 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:03.974855    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:04.231690 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.231608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw" event={"ID":"72f705b2-1faf-4d28-8f91-7092401d4396","Type":"ContainerStarted","Data":"ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d"}
Jul 05 19:58:04.231690 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.231662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw" event={"ID":"72f705b2-1faf-4d28-8f91-7092401d4396","Type":"ContainerStarted","Data":"46ea96596e4ceecf0ca7f1dea473cf5e8ba5e3feb66684279b59e591e28ebd3b"}
Jul 05 19:58:04.253308 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.253258    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw" podStartSLOduration=1.253243802 podStartE2EDuration="1.253243802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:04.250141257 +0000 UTC m=+1529.072631970" watchObservedRunningTime="2026-07-05 19:58:04.253243802 +0000 UTC m=+1529.075734485"
Jul 05 19:58:04.736896 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.736861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:04.836810 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.836769    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:04.838279 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.838256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:04.931611 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:04.931585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:05.187362 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:05.187277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:05.396212 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:05.396181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:05.493968 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:05.493945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:05.843034 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:05.842958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:06.242005 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:06.241975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:06.243006 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:06.242984    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:07.008290 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:07.008262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:09.869431 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:09.869397    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:10.032812 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:10.032769    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"]
Jul 05 19:58:10.032989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:10.032967    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw" podUID="72f705b2-1faf-4d28-8f91-7092401d4396" containerName="istio-proxy" containerID="cri-o://ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d" gracePeriod=30
Jul 05 19:58:10.056967 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:10.056937    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:10.156216 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:10.156143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:10.214463 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:10.214434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:13.158739 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:13.158708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:15.282887 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.282859    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:15.286938 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.286912    2579 generic.go:356] "Generic (PLEG): container finished" podID="72f705b2-1faf-4d28-8f91-7092401d4396" containerID="ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d" exitCode=0
Jul 05 19:58:15.287044 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.286952    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"
Jul 05 19:58:15.287044 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.286992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw" event={"ID":"72f705b2-1faf-4d28-8f91-7092401d4396","Type":"ContainerDied","Data":"ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d"}
Jul 05 19:58:15.287143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.287043    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw" event={"ID":"72f705b2-1faf-4d28-8f91-7092401d4396","Type":"ContainerDied","Data":"46ea96596e4ceecf0ca7f1dea473cf5e8ba5e3feb66684279b59e591e28ebd3b"}
Jul 05 19:58:15.287143 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.287069    2579 scope.go:117] "RemoveContainer" containerID="ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d"
Jul 05 19:58:15.295481 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.295466    2579 scope.go:117] "RemoveContainer" containerID="ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d"
Jul 05 19:58:15.295738 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:58:15.295720    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d\": container with ID starting with ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d not found: ID does not exist" containerID="ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d"
Jul 05 19:58:15.295840 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.295753    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d"} err="failed to get container status \"ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d\": rpc error: code = NotFound desc = could not find container \"ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d\": container with ID starting with ae8a0ae25c70b212de2fdd8c4f6545a6b26946511409f64726413c13f0b2e23d not found: ID does not exist"
Jul 05 19:58:15.347523 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347485    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-credential-socket\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347638 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347594    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-certs\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347638 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-socket\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347730 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347658    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9c5r\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-kube-api-access-q9c5r\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347730 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347689    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-envoy\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347730 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-data\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347730 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347718    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:15.347964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347768    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72f705b2-1faf-4d28-8f91-7092401d4396-istiod-ca-cert\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-istio-token\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347882    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72f705b2-1faf-4d28-8f91-7092401d4396-istio-podinfo\") pod \"72f705b2-1faf-4d28-8f91-7092401d4396\" (UID: \"72f705b2-1faf-4d28-8f91-7092401d4396\") "
Jul 05 19:58:15.347964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347925    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:15.347964 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.347938    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:15.348223 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348054    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-data" (OuterVolumeSpecName: "istio-data") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:15.348223 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348142    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72f705b2-1faf-4d28-8f91-7092401d4396-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:58:15.348223 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348208    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.348383 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348227    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.348383 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348240    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.348383 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348253    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.348383 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.348262    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72f705b2-1faf-4d28-8f91-7092401d4396-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.349956 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.349924    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:15.350061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.349974    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72f705b2-1faf-4d28-8f91-7092401d4396-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 19:58:15.350061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.349985    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-kube-api-access-q9c5r" (OuterVolumeSpecName: "kube-api-access-q9c5r") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "kube-api-access-q9c5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:58:15.350061 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.350015    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-istio-token" (OuterVolumeSpecName: "istio-token") pod "72f705b2-1faf-4d28-8f91-7092401d4396" (UID: "72f705b2-1faf-4d28-8f91-7092401d4396"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:58:15.448701 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.448659    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.448701 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.448679    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72f705b2-1faf-4d28-8f91-7092401d4396-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.448701 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.448688    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9c5r\" (UniqueName: \"kubernetes.io/projected/72f705b2-1faf-4d28-8f91-7092401d4396-kube-api-access-q9c5r\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.448701 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.448697    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72f705b2-1faf-4d28-8f91-7092401d4396-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:15.610110 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.610081    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"]
Jul 05 19:58:15.617019 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.617001    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-da958447-openshift-default-6ddf4f9687-v6kfw"]
Jul 05 19:58:15.853656 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.853582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:15.917165 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:15.917145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:16.012721 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.012688    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"]
Jul 05 19:58:16.013180 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.013159    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72f705b2-1faf-4d28-8f91-7092401d4396" containerName="istio-proxy"
Jul 05 19:58:16.013180 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.013179    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="72f705b2-1faf-4d28-8f91-7092401d4396" containerName="istio-proxy"
Jul 05 19:58:16.013355 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.013275    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="72f705b2-1faf-4d28-8f91-7092401d4396" containerName="istio-proxy"
Jul 05 19:58:16.018029 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.018005    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.020963 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.020941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bc72bde8-openshift-default-dockercfg-lm6wv\""
Jul 05 19:58:16.031469 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.031446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"]
Jul 05 19:58:16.054996 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.054968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-envoy\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055110 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-certs\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055174 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-socket\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055174 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgqw\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-kube-api-access-6cgqw\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055277 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-podinfo\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055277 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-token\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055350 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istiod-ca-cert\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055398 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-credential-socket\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.055398 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.055370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-data\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.058334 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.058307    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:16.119496 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.119435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:16.156375 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-certs\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156489 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-socket\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156489 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgqw\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-kube-api-access-6cgqw\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-podinfo\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-token\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156584 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istiod-ca-cert\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-credential-socket\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-data\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156738 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-envoy\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156914 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156767    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-certs\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.156971 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156919    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-socket\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.157031 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.156979    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-credential-socket\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.157073 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.157040    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-data\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.157330 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.157302    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istiod-ca-cert\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.158943 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.158927    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-envoy\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.159351 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.159330    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-podinfo\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.163874 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.163854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-token\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.164112 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.164097    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgqw\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-kube-api-access-6cgqw\") pod \"e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") " pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.330979 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.330945    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:16.464041 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.464019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"]
Jul 05 19:58:16.465206 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:58:16.465175    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2d01bc_b3e0_43c2_ae0e_abaa2f1a5cb6.slice/crio-a416eb496a9a55c86b0a5224ea822569763d51def99fbf2eb9364a0f1840b798 WatchSource:0}: Error finding container a416eb496a9a55c86b0a5224ea822569763d51def99fbf2eb9364a0f1840b798: Status 404 returned error can't find the container with id a416eb496a9a55c86b0a5224ea822569763d51def99fbf2eb9364a0f1840b798
Jul 05 19:58:16.467478 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.467448    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:16.467546 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.467508    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:16.467546 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:16.467536    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:17.255691 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.255642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:17.300214 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.300186    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" event={"ID":"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6","Type":"ContainerStarted","Data":"c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"}
Jul 05 19:58:17.300363 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.300238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" event={"ID":"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6","Type":"ContainerStarted","Data":"a416eb496a9a55c86b0a5224ea822569763d51def99fbf2eb9364a0f1840b798"}
Jul 05 19:58:17.323791 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.323744    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" podStartSLOduration=2.323727152 podStartE2EDuration="2.323727152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:17.321899027 +0000 UTC m=+1542.144389715" watchObservedRunningTime="2026-07-05 19:58:17.323727152 +0000 UTC m=+1542.146217902"
Jul 05 19:58:17.326505 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.326479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:17.331455 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.331435    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:17.337136 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.337117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:17.512747 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.512670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:17.619758 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.619730    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72f705b2-1faf-4d28-8f91-7092401d4396" path="/var/lib/kubelet/pods/72f705b2-1faf-4d28-8f91-7092401d4396/volumes"
Jul 05 19:58:17.704715 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.704689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:17.983673 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:17.983648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:18.084868 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:18.084835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:18.305881 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:18.305784    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:18.306866 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:18.306846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:19.168028 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:19.167992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:22.335226 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:22.335190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:22.666119 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:22.666042    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:28.372896 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.372864    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerID="c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af" exitCode=0
Jul 05 19:58:28.373337 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.372932    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" event={"ID":"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6","Type":"ContainerDied","Data":"c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"}
Jul 05 19:58:28.373337 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.373294    2579 scope.go:117] "RemoveContainer" containerID="c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"
Jul 05 19:58:28.374263 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.374234    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:28.374316 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.374301    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:28.374363 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.374333    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:28.628853 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.628761    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"]
Jul 05 19:58:28.650380 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.650351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:28.750471 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:28.750437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:29.380543 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:29.380493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" event={"ID":"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6","Type":"ContainerStarted","Data":"6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39"}
Jul 05 19:58:29.380988 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:29.380519    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy" containerID="cri-o://6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39" gracePeriod=30
Jul 05 19:58:33.306691 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:33.306662    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:34.334936 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.334898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:34.437167 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.437143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:34.507891 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.507866    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"]
Jul 05 19:58:34.511469 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.511450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.514190 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.514165    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b6596a5d-openshift-default-dockercfg-778q2\""
Jul 05 19:58:34.524208 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.524136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"]
Jul 05 19:58:34.544068 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.544039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:34.616441 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-socket\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616441 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-data\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616675 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-token\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616675 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-credential-socket\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616675 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-certs\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616675 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-podinfo\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616675 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czkp\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-kube-api-access-6czkp\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616977 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-envoy\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.616977 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.616715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istiod-ca-cert\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.644011 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.643980    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:34.717357 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717327    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-credential-socket\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717524 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-data\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717524 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717393    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-token\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717524 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717444    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-socket\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717524 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-podinfo\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717524 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717523    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-certs\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cgqw\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-kube-api-access-6cgqw\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istiod-ca-cert\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-envoy\") pod \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\" (UID: \"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6\") "
Jul 05 19:58:34.717694 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-envoy\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.717848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istiod-ca-cert\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.717848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-socket\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.717848 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-data\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.717990 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-token\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.717990 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-credential-socket\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.717990 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.717983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-certs\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.718086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.718023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-podinfo\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.718086 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.718053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czkp\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-kube-api-access-6czkp\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.718439 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.718404    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-socket\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.718572 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.718522    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istiod-ca-cert\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.718853 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.718788    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-data\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.718969 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.718868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-credential-socket\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.719062 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.719042    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:34.719134 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.719120    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-certs\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.719198 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.719169    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:34.719846 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.719772    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:58:34.719957 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.719898    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:34.720106 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.720075    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:34.721168 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.721143    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-envoy\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.721392 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.721367    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-podinfo\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.721471 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.721415    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 19:58:34.721471 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.721423    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:58:34.721602 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.721583    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-kube-api-access-6cgqw" (OuterVolumeSpecName: "kube-api-access-6cgqw") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "kube-api-access-6cgqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:58:34.721722 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.721705    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" (UID: "fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:34.726299 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.726279    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-token\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.726519 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.726502    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czkp\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-kube-api-access-6czkp\") pod \"e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") " pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.818928 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818905    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cgqw\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-kube-api-access-6cgqw\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.818928 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818926    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818935    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818943    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818951    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818959    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818967    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818974    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.819063 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.818982    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:34.823741 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.823718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:34.984672 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.984648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"]
Jul 05 19:58:34.985461 ip-10-0-134-29 kubenswrapper[2579]: W0705 19:58:34.985438    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f8a8d3_dc8b_4cc9_97fb_004a745d33a5.slice/crio-eaf667398103e74145c4ed3607bcf2c7a9237a726d7682a86689616626b7eef2 WatchSource:0}: Error finding container eaf667398103e74145c4ed3607bcf2c7a9237a726d7682a86689616626b7eef2: Status 404 returned error can't find the container with id eaf667398103e74145c4ed3607bcf2c7a9237a726d7682a86689616626b7eef2
Jul 05 19:58:34.987553 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.987521    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:34.987620 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.987588    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:34.987658 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:34.987621    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 19:58:35.416534 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.416503    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerID="6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39" exitCode=0
Jul 05 19:58:35.416937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.416550    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"
Jul 05 19:58:35.416937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.416577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" event={"ID":"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6","Type":"ContainerDied","Data":"6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39"}
Jul 05 19:58:35.416937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.416646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx" event={"ID":"fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6","Type":"ContainerDied","Data":"a416eb496a9a55c86b0a5224ea822569763d51def99fbf2eb9364a0f1840b798"}
Jul 05 19:58:35.416937 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.416677    2579 scope.go:117] "RemoveContainer" containerID="6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39"
Jul 05 19:58:35.418560 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.418534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87" event={"ID":"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5","Type":"ContainerStarted","Data":"0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342"}
Jul 05 19:58:35.418689 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.418586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87" event={"ID":"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5","Type":"ContainerStarted","Data":"eaf667398103e74145c4ed3607bcf2c7a9237a726d7682a86689616626b7eef2"}
Jul 05 19:58:35.427642 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.427622    2579 scope.go:117] "RemoveContainer" containerID="c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"
Jul 05 19:58:35.428049 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.428029    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:35.437227 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.437207    2579 scope.go:117] "RemoveContainer" containerID="6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39"
Jul 05 19:58:35.437466 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:58:35.437439    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39\": container with ID starting with 6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39 not found: ID does not exist" containerID="6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39"
Jul 05 19:58:35.437541 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.437470    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39"} err="failed to get container status \"6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39\": rpc error: code = NotFound desc = could not find container \"6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39\": container with ID starting with 6c38357bebac8a9995202c6c41fc431d082948200167efc9ed6156d43e25fe39 not found: ID does not exist"
Jul 05 19:58:35.437541 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.437495    2579 scope.go:117] "RemoveContainer" containerID="c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"
Jul 05 19:58:35.437735 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:58:35.437718    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af\": container with ID starting with c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af not found: ID does not exist" containerID="c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"
Jul 05 19:58:35.437777 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.437740    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af"} err="failed to get container status \"c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af\": rpc error: code = NotFound desc = could not find container \"c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af\": container with ID starting with c180a5c73129c1b238f014235ed77f748ab307e2f2145866b4ca2a731318e7af not found: ID does not exist"
Jul 05 19:58:35.442481 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.442440    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87" podStartSLOduration=1.442427307 podStartE2EDuration="1.442427307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:35.440699595 +0000 UTC m=+1560.263190278" watchObservedRunningTime="2026-07-05 19:58:35.442427307 +0000 UTC m=+1560.264917985"
Jul 05 19:58:35.457958 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.457933    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"]
Jul 05 19:58:35.462562 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.462540    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bc72bde8-openshift-default-5cc6d5f597-7jqgx"]
Jul 05 19:58:35.484825 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.484790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:35.621240 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.621207    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" path="/var/lib/kubelet/pods/fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6/volumes"
Jul 05 19:58:35.738465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.738441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:35.823877 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.823847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:35.828149 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.828123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:35.887461 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:35.887434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:36.403697 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:36.403657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:36.508449 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:36.508422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:36.617055 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:36.617028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:36.829229 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:36.829203    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:37.429104 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:37.429079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:37.429919 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:37.429899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:38.605861 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:38.605762    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:40.175729 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:40.175702    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:40.341301 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:40.341269    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"]
Jul 05 19:58:40.364234 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:40.364206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:40.446638 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:40.446538    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87" podUID="a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" containerName="istio-proxy" containerID="cri-o://0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342" gracePeriod=30
Jul 05 19:58:40.468017 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:40.467980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:40.565215 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:40.565127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:42.878276 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:42.878249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:45.991543 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:45.991511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:46.091922 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:46.091893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:46.463465 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:46.463393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:46.562749 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:46.562719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:46.664619 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:46.664592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:47.306201 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.306179    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:47.343260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343206    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6czkp\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-kube-api-access-6czkp\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343260 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343235    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-token\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343400 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343287    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istiod-ca-cert\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343455 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343434    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-credential-socket\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343495 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-data\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343539 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343515    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-podinfo\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343585 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343549    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-envoy\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343640 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-certs\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343695 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343642    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-socket\") pod \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\" (UID: \"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5\") "
Jul 05 19:58:47.343824 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343716    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:58:47.343824 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.343711    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:47.344081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.344011    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.344081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.344037    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.344081 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.344011    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:47.344329 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.344301    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:47.344493 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.344470    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:47.345556 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.345534    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:58:47.345909 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.345890    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-kube-api-access-6czkp" (OuterVolumeSpecName: "kube-api-access-6czkp") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "kube-api-access-6czkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:58:47.346055 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.346031    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:58:47.346190 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.346166    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" (UID: "a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 19:58:47.445165 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445144    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.445165 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445164    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6czkp\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-kube-api-access-6czkp\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.445298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445175    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.445298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445183    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.445298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445191    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.445298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445200    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.445298 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.445207    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 19:58:47.485305 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.485276    2579 generic.go:356] "Generic (PLEG): container finished" podID="a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" containerID="0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342" exitCode=0
Jul 05 19:58:47.485418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.485320    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"
Jul 05 19:58:47.485418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.485359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87" event={"ID":"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5","Type":"ContainerDied","Data":"0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342"}
Jul 05 19:58:47.485418 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.485411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87" event={"ID":"a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5","Type":"ContainerDied","Data":"eaf667398103e74145c4ed3607bcf2c7a9237a726d7682a86689616626b7eef2"}
Jul 05 19:58:47.485550 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.485436    2579 scope.go:117] "RemoveContainer" containerID="0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342"
Jul 05 19:58:47.494984 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.494970    2579 scope.go:117] "RemoveContainer" containerID="0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342"
Jul 05 19:58:47.495232 ip-10-0-134-29 kubenswrapper[2579]: E0705 19:58:47.495217    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342\": container with ID starting with 0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342 not found: ID does not exist" containerID="0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342"
Jul 05 19:58:47.495281 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.495238    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342"} err="failed to get container status \"0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342\": rpc error: code = NotFound desc = could not find container \"0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342\": container with ID starting with 0dbe1c3029a2b47c364c0de60af5c3222ca399ca1e5e12232b93fa8537129342 not found: ID does not exist"
Jul 05 19:58:47.508204 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.508183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"]
Jul 05 19:58:47.512466 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.512447    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b6596a5d-openshift-default-75fbc6fbbc-twx87"]
Jul 05 19:58:47.618547 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:47.618476    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" path="/var/lib/kubelet/pods/a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5/volumes"
Jul 05 19:58:48.051456 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:48.051429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:53.662966 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:53.662934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:53.768305 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:53.768276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:53.863100 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:53.863065    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:53.963320 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:53.963243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:58:54.371989 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:58:54.371961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:08.627998 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:08.627964    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:08.680883 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:08.680791    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:20.311440 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:20.311407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:25.833624 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:25.833591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:25.887460 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:25.887432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:25.957960 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:25.957902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:26.057685 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:26.057659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:41.919502 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:41.919465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:47.784467 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:47.784431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:47.887088 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:47.887056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:47.984371 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:47.984341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:58.494085 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:58.494053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 19:59:59.314302 ip-10-0-134-29 kubenswrapper[2579]: I0705 19:59:59.314270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:05.045958 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:05.045923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:05.145897 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:05.145870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:05.268737 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:05.268708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:05.982475 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:05.982435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:06.081697 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:06.081666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:06.184460 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:06.184428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:07.767505 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:07.767466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:13.340732 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:13.340700    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:13.440981 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:13.440947    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:14.020067 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:14.020038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:19.690611 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:19.690581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:19.790331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:19.790301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:19.923965 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:19.923931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:20.213109 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213079    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"]
Jul 05 20:00:20.213511 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213494    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy"
Jul 05 20:00:20.213600 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213513    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy"
Jul 05 20:00:20.213600 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213523    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" containerName="istio-proxy"
Jul 05 20:00:20.213600 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213531    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" containerName="istio-proxy"
Jul 05 20:00:20.214036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213635    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f8a8d3-dc8b-4cc9-97fb-004a745d33a5" containerName="istio-proxy"
Jul 05 20:00:20.214036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.213653    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy"
Jul 05 20:00:20.216773 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.216752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.219591 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.219569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3e263149-openshift-default-dockercfg-qwcfs\""
Jul 05 20:00:20.228581 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.228563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"]
Jul 05 20:00:20.240929 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.240903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:20.305036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.304998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-certs\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305153 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-podinfo\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305202 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-credential-socket\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305238 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-envoy\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305238 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc8bd\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-kube-api-access-xc8bd\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305316 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8b19-bede-441f-a2df-bcb445f460c9-istiod-ca-cert\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305316 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-socket\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305419 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-data\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.305476 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.305453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-token\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406140 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-certs\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406140 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-podinfo\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-credential-socket\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-envoy\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc8bd\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-kube-api-access-xc8bd\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8b19-bede-441f-a2df-bcb445f460c9-istiod-ca-cert\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-socket\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-data\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406372 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-token\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406824 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406677    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-certs\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406824 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406653    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-credential-socket\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.406986 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.406924    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-socket\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.407285 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.407059    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-data\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.407381 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.407135    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8b19-bede-441f-a2df-bcb445f460c9-istiod-ca-cert\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.408702 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.408682    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-envoy\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.409010 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.408992    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-podinfo\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.415052 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.415024    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-token\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.415205 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.415188    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc8bd\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-kube-api-access-xc8bd\") pod \"e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") " pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.451785 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.451759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:20.527923 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.527900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:20.667926 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.667899    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"]
Jul 05 20:00:20.668411 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:00:20.668387    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea8b19_bede_441f_a2df_bcb445f460c9.slice/crio-16794c0fc06587b089c823fb3d4d0ffb9b90fe0d38b7ce43a7039bb65cba1bd4 WatchSource:0}: Error finding container 16794c0fc06587b089c823fb3d4d0ffb9b90fe0d38b7ce43a7039bb65cba1bd4: Status 404 returned error can't find the container with id 16794c0fc06587b089c823fb3d4d0ffb9b90fe0d38b7ce43a7039bb65cba1bd4
Jul 05 20:00:20.673620 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.673587    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:00:20.673687 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.673666    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:00:20.673734 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.673705    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:00:20.950690 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.950612    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" event={"ID":"05ea8b19-bede-441f-a2df-bcb445f460c9","Type":"ContainerStarted","Data":"9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"}
Jul 05 20:00:20.950690 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.950663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" event={"ID":"05ea8b19-bede-441f-a2df-bcb445f460c9","Type":"ContainerStarted","Data":"16794c0fc06587b089c823fb3d4d0ffb9b90fe0d38b7ce43a7039bb65cba1bd4"}
Jul 05 20:00:20.971053 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:20.971007    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" podStartSLOduration=0.970992844 podStartE2EDuration="970.992844ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:00:20.969726197 +0000 UTC m=+1665.792216881" watchObservedRunningTime="2026-07-05 20:00:20.970992844 +0000 UTC m=+1665.793483526"
Jul 05 20:00:21.528697 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:21.528668    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:21.533656 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:21.533631    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:21.956073 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:21.955991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:21.956846 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:21.956821    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:22.984090 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:22.984059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:23.070852 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:23.070820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:23.195518 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:23.195491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:23.498788 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:23.498761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:23.853716 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:23.853622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:23.954560 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:23.954530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:27.443713 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:27.443684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:28.075768 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:28.075730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:28.175916 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:28.175885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:28.479812 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:28.479726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:34.000239 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:34.000198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:34.111435 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:34.111401    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:34.430859 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:34.430768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:34.732024 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:34.731946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:34.807234 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:34.807202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:36.029986 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.029953    2579 generic.go:356] "Generic (PLEG): container finished" podID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerID="9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713" exitCode=0
Jul 05 20:00:36.030425 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.030010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" event={"ID":"05ea8b19-bede-441f-a2df-bcb445f460c9","Type":"ContainerDied","Data":"9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"}
Jul 05 20:00:36.030425 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.030418    2579 scope.go:117] "RemoveContainer" containerID="9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"
Jul 05 20:00:36.031445 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.031413    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:00:36.031533 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.031500    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:00:36.031578 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.031543    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:00:36.956027 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:36.955983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:37.039973 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:37.039928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" event={"ID":"05ea8b19-bede-441f-a2df-bcb445f460c9","Type":"ContainerStarted","Data":"e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4"}
Jul 05 20:00:37.528458 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:37.528420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:37.529709 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:37.529682    2579 patch_prober.go:28] interesting pod/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 05 20:00:37.529993 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:37.529953    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 05 20:00:38.529156 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:38.529111    2579 patch_prober.go:28] interesting pod/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 05 20:00:38.529673 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:38.529189    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 05 20:00:39.528923 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:39.528888    2579 patch_prober.go:28] interesting pod/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 05 20:00:39.529201 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:39.529170    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 05 20:00:40.526080 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.526041    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:40.529423 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.528998    2579 patch_prober.go:28] interesting pod/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 05 20:00:40.529423 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.529053    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 05 20:00:40.627335 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.627305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:40.770470 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.770438    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"]
Jul 05 20:00:40.770666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.770623    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy" containerID="cri-o://e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4" gracePeriod=30
Jul 05 20:00:40.801341 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:40.801255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:41.013750 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:41.013718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:41.129370 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:41.129291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:41.236625 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:41.236594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:41.403721 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:41.403642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:46.028479 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.028457    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:46.093057 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.093019    2579 generic.go:356] "Generic (PLEG): container finished" podID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerID="e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4" exitCode=0
Jul 05 20:00:46.093202 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.093077    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"
Jul 05 20:00:46.093202 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.093080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" event={"ID":"05ea8b19-bede-441f-a2df-bcb445f460c9","Type":"ContainerDied","Data":"e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4"}
Jul 05 20:00:46.093202 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.093165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w" event={"ID":"05ea8b19-bede-441f-a2df-bcb445f460c9","Type":"ContainerDied","Data":"16794c0fc06587b089c823fb3d4d0ffb9b90fe0d38b7ce43a7039bb65cba1bd4"}
Jul 05 20:00:46.093202 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.093191    2579 scope.go:117] "RemoveContainer" containerID="e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4"
Jul 05 20:00:46.102070 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.102052    2579 scope.go:117] "RemoveContainer" containerID="9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"
Jul 05 20:00:46.109732 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.109713    2579 scope.go:117] "RemoveContainer" containerID="e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4"
Jul 05 20:00:46.109986 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:00:46.109968    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4\": container with ID starting with e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4 not found: ID does not exist" containerID="e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4"
Jul 05 20:00:46.110070 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.109994    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4"} err="failed to get container status \"e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4\": rpc error: code = NotFound desc = could not find container \"e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4\": container with ID starting with e11dfa2ac8c175fa14b2c99f6e84a0cd987069a8525c661e7e56e7cf962976b4 not found: ID does not exist"
Jul 05 20:00:46.110070 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.110010    2579 scope.go:117] "RemoveContainer" containerID="9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"
Jul 05 20:00:46.110226 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:00:46.110213    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713\": container with ID starting with 9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713 not found: ID does not exist" containerID="9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"
Jul 05 20:00:46.110307 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.110229    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713"} err="failed to get container status \"9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713\": rpc error: code = NotFound desc = could not find container \"9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713\": container with ID starting with 9730ac193135c2a4704c5773b47a94fcab60b4b0eba4d5e26560dff17e470713 not found: ID does not exist"
Jul 05 20:00:46.127517 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127499    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-certs\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127601 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-socket\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127601 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127562    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-envoy\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127601 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127586    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-credential-socket\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127722 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8b19-bede-441f-a2df-bcb445f460c9-istiod-ca-cert\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127722 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-data\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127722 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-podinfo\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127722 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127714    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc8bd\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-kube-api-access-xc8bd\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127960 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127768    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-token\") pod \"05ea8b19-bede-441f-a2df-bcb445f460c9\" (UID: \"05ea8b19-bede-441f-a2df-bcb445f460c9\") "
Jul 05 20:00:46.127960 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127817    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:00:46.127960 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127831    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:00:46.127960 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.127946    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:00:46.128174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.128025    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.128174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.128044    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.128174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.128057    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.128330 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.128259    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ea8b19-bede-441f-a2df-bcb445f460c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:00:46.128740 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.128713    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:00:46.129655 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.129630    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:00:46.129913 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.129887    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:00:46.130176 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.130157    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 20:00:46.130249 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.130235    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-kube-api-access-xc8bd" (OuterVolumeSpecName: "kube-api-access-xc8bd") pod "05ea8b19-bede-441f-a2df-bcb445f460c9" (UID: "05ea8b19-bede-441f-a2df-bcb445f460c9"). InnerVolumeSpecName "kube-api-access-xc8bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:00:46.228657 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.228633    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.228657 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.228653    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.228657 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.228662    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8b19-bede-441f-a2df-bcb445f460c9-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.228842 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.228670    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.228842 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.228679    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8b19-bede-441f-a2df-bcb445f460c9-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.228842 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.228687    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc8bd\" (UniqueName: \"kubernetes.io/projected/05ea8b19-bede-441f-a2df-bcb445f460c9-kube-api-access-xc8bd\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:00:46.415585 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.415558    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"]
Jul 05 20:00:46.419150 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:46.419128    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3e263149-openshift-default-7b4b59dff5-q4x5w"]
Jul 05 20:00:47.070811 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:47.070779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:47.129574 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:47.129537    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:47.212735 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:47.212708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:47.311354 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:47.311329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:47.410263 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:47.410200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:47.617393 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:47.617361    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" path="/var/lib/kubelet/pods/05ea8b19-bede-441f-a2df-bcb445f460c9/volumes"
Jul 05 20:00:53.142632 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:53.142602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:53.199976 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:53.199947    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:00:59.881736 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:00:59.881648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:00.145436 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145355    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"]
Jul 05 20:01:00.145810 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145781    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy"
Jul 05 20:01:00.145810 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145811    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy"
Jul 05 20:01:00.145933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145825    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy"
Jul 05 20:01:00.145933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145832    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy"
Jul 05 20:01:00.145933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145910    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy"
Jul 05 20:01:00.145933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145920    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2d01bc-b3e0-43c2-ae0e-abaa2f1a5cb6" containerName="istio-proxy"
Jul 05 20:01:00.145933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.145927    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy"
Jul 05 20:01:00.150280 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.150257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.153225 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.153201    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f4b2f9ba-openshift-default-dockercfg-nv698\""
Jul 05 20:01:00.162391 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.162368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"]
Jul 05 20:01:00.172920 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.172893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:00.249396 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903ad1fb-a8d8-41d2-9958-6897963dbc76-istiod-ca-cert\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-socket\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-certs\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-data\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-podinfo\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-token\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249908 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwwc\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-kube-api-access-6cwwc\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249908 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-credential-socket\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.249908 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.249715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-envoy\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.350584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903ad1fb-a8d8-41d2-9958-6897963dbc76-istiod-ca-cert\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.350769 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-socket\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.350769 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-certs\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.350921 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-data\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.350921 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-podinfo\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.350921 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-token\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351092 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwwc\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-kube-api-access-6cwwc\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351092 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.350982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-credential-socket\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351092 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.351013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-envoy\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351092 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.351016    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-socket\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351362 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.351091    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-certs\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351362 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.351132    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-data\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351500 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.351361    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-credential-socket\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.351500 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.351376    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903ad1fb-a8d8-41d2-9958-6897963dbc76-istiod-ca-cert\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.353583 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.353553    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-envoy\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.353937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.353916    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-podinfo\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.360240 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.360221    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-token\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.360893 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.360877    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwwc\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-kube-api-access-6cwwc\") pod \"e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") " pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.462443 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.462355    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:00.631888 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.631737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"]
Jul 05 20:01:00.634673 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:01:00.634632    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903ad1fb_a8d8_41d2_9958_6897963dbc76.slice/crio-bc2906794b5ea0cacb5c34629ec332719ff77238a86c3d57c54022baf459b0f0 WatchSource:0}: Error finding container bc2906794b5ea0cacb5c34629ec332719ff77238a86c3d57c54022baf459b0f0: Status 404 returned error can't find the container with id bc2906794b5ea0cacb5c34629ec332719ff77238a86c3d57c54022baf459b0f0
Jul 05 20:01:00.636969 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.636936    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:01:00.637072 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.636998    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:01:00.637072 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.637030    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:01:00.680631 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:00.680607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:01.173674 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:01.173639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" event={"ID":"903ad1fb-a8d8-41d2-9958-6897963dbc76","Type":"ContainerStarted","Data":"f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"}
Jul 05 20:01:01.174064 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:01.173698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" event={"ID":"903ad1fb-a8d8-41d2-9958-6897963dbc76","Type":"ContainerStarted","Data":"bc2906794b5ea0cacb5c34629ec332719ff77238a86c3d57c54022baf459b0f0"}
Jul 05 20:01:01.194974 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:01.194930    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podStartSLOduration=1.194915382 podStartE2EDuration="1.194915382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:01:01.194014659 +0000 UTC m=+1706.016505345" watchObservedRunningTime="2026-07-05 20:01:01.194915382 +0000 UTC m=+1706.017406064"
Jul 05 20:01:01.462918 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:01.462842    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:01.467529 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:01.467502    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:02.180034 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:02.180003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:02.180849 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:02.180833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:03.169140 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:03.169102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:03.273234 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:03.273209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:03.565254 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:03.565226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:03.665302 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:03.665264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:03.926257 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:03.926177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:04.030442 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:04.030408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:07.680654 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:07.680618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:16.177017 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.176982    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"]
Jul 05 20:01:16.177626 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.177604    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy"
Jul 05 20:01:16.177691 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.177630    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea8b19-bede-441f-a2df-bcb445f460c9" containerName="istio-proxy"
Jul 05 20:01:16.181416 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.181390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.185790 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.185649    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f4b2f9ba\"/\"openshift-service-ca.crt\""
Jul 05 20:01:16.185941 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.185914    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f4b2f9ba\"/\"kube-root-ca.crt\""
Jul 05 20:01:16.186332 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.186140    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f4b2f9ba\"/\"e2e-lifecycle-model-f4b2f9ba-kserve-self-signed-certs\""
Jul 05 20:01:16.186332 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.186144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f4b2f9ba\"/\"default-dockercfg-m4vsl\""
Jul 05 20:01:16.189807 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.189774    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"]
Jul 05 20:01:16.208642 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.208616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:16.298305 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.298275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-tmp-dir\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.298485 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.298327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73030f54-8b10-49fa-9c22-525646384121-tls-certs\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.298485 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.298378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-home\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.298485 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.298400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-dshm\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.298485 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.298466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-model-cache\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.298670 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.298522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnm4\" (UniqueName: \"kubernetes.io/projected/73030f54-8b10-49fa-9c22-525646384121-kube-api-access-tsnm4\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.399851 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.399821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73030f54-8b10-49fa-9c22-525646384121-tls-certs\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400009 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.399872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-home\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400009 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.399896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-dshm\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400009 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.399962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-model-cache\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400179 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.400010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnm4\" (UniqueName: \"kubernetes.io/projected/73030f54-8b10-49fa-9c22-525646384121-kube-api-access-tsnm4\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400179 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.400056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-tmp-dir\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400355 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.400333    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-home\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400441 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.400412    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-model-cache\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.400488 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.400438    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-tmp-dir\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.402196 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.402175    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-dshm\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.402498 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.402477    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73030f54-8b10-49fa-9c22-525646384121-tls-certs\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.407549 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.407526    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnm4\" (UniqueName: \"kubernetes.io/projected/73030f54-8b10-49fa-9c22-525646384121-kube-api-access-tsnm4\") pod \"e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") " pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.496147 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.496122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:16.638919 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:16.638891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"]
Jul 05 20:01:16.640117 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:01:16.640085    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73030f54_8b10_49fa_9c22_525646384121.slice/crio-74897b865f37b5a471653a94c8e4b08f9f6ab1f914e988e40088bc596dda2ff5 WatchSource:0}: Error finding container 74897b865f37b5a471653a94c8e4b08f9f6ab1f914e988e40088bc596dda2ff5: Status 404 returned error can't find the container with id 74897b865f37b5a471653a94c8e4b08f9f6ab1f914e988e40088bc596dda2ff5
Jul 05 20:01:17.217175 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.216427    2579 patch_prober.go:28] interesting pod/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:40436->10.134.0.57:15021: read: connection reset by peer" start-of-body=
Jul 05 20:01:17.217175 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.216501    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:40436->10.134.0.57:15021: read: connection reset by peer"
Jul 05 20:01:17.239008 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:01:17.238977    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903ad1fb_a8d8_41d2_9958_6897963dbc76.slice/crio-conmon-f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d.scope\": RecentStats: unable to find data in memory cache]"
Jul 05 20:01:17.239008 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:01:17.238994    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903ad1fb_a8d8_41d2_9958_6897963dbc76.slice/crio-f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d.scope\": RecentStats: unable to find data in memory cache]"
Jul 05 20:01:17.270449 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.270424    2579 generic.go:356] "Generic (PLEG): container finished" podID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerID="f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d" exitCode=0
Jul 05 20:01:17.270558 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.270491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" event={"ID":"903ad1fb-a8d8-41d2-9958-6897963dbc76","Type":"ContainerDied","Data":"f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"}
Jul 05 20:01:17.270965 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.270941    2579 scope.go:117] "RemoveContainer" containerID="f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"
Jul 05 20:01:17.272015 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.271988    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:01:17.272098 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.272056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r" event={"ID":"73030f54-8b10-49fa-9c22-525646384121","Type":"ContainerStarted","Data":"e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7"}
Jul 05 20:01:17.272098 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.272066    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:01:17.272098 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.272084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r" event={"ID":"73030f54-8b10-49fa-9c22-525646384121","Type":"ContainerStarted","Data":"74897b865f37b5a471653a94c8e4b08f9f6ab1f914e988e40088bc596dda2ff5"}
Jul 05 20:01:17.272216 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:17.272106    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:01:18.279158 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:18.279126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" event={"ID":"903ad1fb-a8d8-41d2-9958-6897963dbc76","Type":"ContainerStarted","Data":"028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43"}
Jul 05 20:01:18.301094 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:18.301048    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r" podStartSLOduration=2.301030761 podStartE2EDuration="2.301030761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:01:17.309643968 +0000 UTC m=+1722.132134651" watchObservedRunningTime="2026-07-05 20:01:18.301030761 +0000 UTC m=+1723.123521485"
Jul 05 20:01:18.463273 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:18.463231    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:18.463478 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:18.463456    2579 patch_prober.go:28] interesting pod/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 05 20:01:18.463528 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:18.463508    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 05 20:01:19.462857 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:19.462822    2579 patch_prober.go:28] interesting pod/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 05 20:01:19.463231 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:19.462882    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 05 20:01:20.463189 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:20.463152    2579 patch_prober.go:28] interesting pod/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 05 20:01:20.463562 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:20.463208    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 05 20:01:21.462761 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:21.462728    2579 patch_prober.go:28] interesting pod/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 05 20:01:21.462969 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:21.462785    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 05 20:01:22.466386 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:22.466354    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:22.466814 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:22.466756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:22.467336 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:22.467319    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:01:26.496995 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:26.496965    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:26.497438 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:26.497010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:26.509297 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:26.509275    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:27.349000 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:27.348972    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:01:28.446549 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:28.446519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:28.546096 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:28.546063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:34.971939 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:34.971903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:35.509634 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:35.509601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:35.611193 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:35.611153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:35.755287 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:35.755260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:41.010308 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:41.010275    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:01:45.993655 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:45.993622    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"]
Jul 05 20:01:46.088106 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:01:46.088074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:02:01.013575 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.013538    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r" podUID="73030f54-8b10-49fa-9c22-525646384121" containerName="main" containerID="cri-o://e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7" gracePeriod=45
Jul 05 20:02:01.260302 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.260267    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:02:01.398391 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsnm4\" (UniqueName: \"kubernetes.io/projected/73030f54-8b10-49fa-9c22-525646384121-kube-api-access-tsnm4\") pod \"73030f54-8b10-49fa-9c22-525646384121\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") "
Jul 05 20:02:01.398391 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-tmp-dir\") pod \"73030f54-8b10-49fa-9c22-525646384121\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") "
Jul 05 20:02:01.398590 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398423    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73030f54-8b10-49fa-9c22-525646384121-tls-certs\") pod \"73030f54-8b10-49fa-9c22-525646384121\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") "
Jul 05 20:02:01.398590 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-dshm\") pod \"73030f54-8b10-49fa-9c22-525646384121\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") "
Jul 05 20:02:01.398590 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-home\") pod \"73030f54-8b10-49fa-9c22-525646384121\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") "
Jul 05 20:02:01.398590 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-model-cache\") pod \"73030f54-8b10-49fa-9c22-525646384121\" (UID: \"73030f54-8b10-49fa-9c22-525646384121\") "
Jul 05 20:02:01.398854 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398743    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73030f54-8b10-49fa-9c22-525646384121" (UID: "73030f54-8b10-49fa-9c22-525646384121"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:02:01.398854 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398837    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-home" (OuterVolumeSpecName: "home") pod "73030f54-8b10-49fa-9c22-525646384121" (UID: "73030f54-8b10-49fa-9c22-525646384121"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:02:01.398963 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398913    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-home\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:02:01.398963 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398933    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-tmp-dir\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:02:01.398963 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.398943    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-model-cache" (OuterVolumeSpecName: "model-cache") pod "73030f54-8b10-49fa-9c22-525646384121" (UID: "73030f54-8b10-49fa-9c22-525646384121"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:02:01.400507 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.400478    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-dshm" (OuterVolumeSpecName: "dshm") pod "73030f54-8b10-49fa-9c22-525646384121" (UID: "73030f54-8b10-49fa-9c22-525646384121"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:02:01.400629 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.400575    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73030f54-8b10-49fa-9c22-525646384121-kube-api-access-tsnm4" (OuterVolumeSpecName: "kube-api-access-tsnm4") pod "73030f54-8b10-49fa-9c22-525646384121" (UID: "73030f54-8b10-49fa-9c22-525646384121"). InnerVolumeSpecName "kube-api-access-tsnm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:02:01.400687 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.400635    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73030f54-8b10-49fa-9c22-525646384121-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73030f54-8b10-49fa-9c22-525646384121" (UID: "73030f54-8b10-49fa-9c22-525646384121"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:02:01.499561 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.499533    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73030f54-8b10-49fa-9c22-525646384121-tls-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:02:01.499561 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.499558    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-dshm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:02:01.499561 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.499566    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73030f54-8b10-49fa-9c22-525646384121-model-cache\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:02:01.499754 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.499575    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsnm4\" (UniqueName: \"kubernetes.io/projected/73030f54-8b10-49fa-9c22-525646384121-kube-api-access-tsnm4\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:02:01.507153 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.507130    2579 generic.go:356] "Generic (PLEG): container finished" podID="73030f54-8b10-49fa-9c22-525646384121" containerID="e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7" exitCode=0
Jul 05 20:02:01.507267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.507169    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"
Jul 05 20:02:01.507267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.507219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r" event={"ID":"73030f54-8b10-49fa-9c22-525646384121","Type":"ContainerDied","Data":"e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7"}
Jul 05 20:02:01.507339 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.507264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r" event={"ID":"73030f54-8b10-49fa-9c22-525646384121","Type":"ContainerDied","Data":"74897b865f37b5a471653a94c8e4b08f9f6ab1f914e988e40088bc596dda2ff5"}
Jul 05 20:02:01.507339 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.507286    2579 scope.go:117] "RemoveContainer" containerID="e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7"
Jul 05 20:02:01.524504 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.524485    2579 scope.go:117] "RemoveContainer" containerID="e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7"
Jul 05 20:02:01.524775 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:02:01.524754    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7\": container with ID starting with e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7 not found: ID does not exist" containerID="e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7"
Jul 05 20:02:01.524887 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.524781    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7"} err="failed to get container status \"e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7\": rpc error: code = NotFound desc = could not find container \"e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7\": container with ID starting with e3c4f7d8e523e603945f8d0ac1ee28dacf3fb9e1f0f7f733fcf2f13f7def09a7 not found: ID does not exist"
Jul 05 20:02:01.534462 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.534437    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"]
Jul 05 20:02:01.536589 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.536565    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f4b2f9ba/e2e-lifecycle-model-f4b2f9ba-kserve-cf5ff5c9f-4k66r"]
Jul 05 20:02:01.617890 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:01.617860    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73030f54-8b10-49fa-9c22-525646384121" path="/var/lib/kubelet/pods/73030f54-8b10-49fa-9c22-525646384121/volumes"
Jul 05 20:02:22.762700 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:22.762667    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:02:23.005034 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:23.004999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:02:28.511413 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:28.511327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:02:59.910634 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:02:59.910598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:00.191194 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:00.191117    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"]
Jul 05 20:03:00.191348 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:00.191321    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy" containerID="cri-o://028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43" gracePeriod=30
Jul 05 20:03:01.068968 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:01.068937    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:01.633474 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:01.633442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:01.723425 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:01.723396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:01.823503 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:01.823477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:02.595638 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:02.595604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:02.693302 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:02.693273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:02.793411 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:02.793388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:04.252995 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:04.252968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:05.461305 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.461239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:03:05.625994 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.625965    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cwwc\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-kube-api-access-6cwwc\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626187 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903ad1fb-a8d8-41d2-9958-6897963dbc76-istiod-ca-cert\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626187 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626043    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-envoy\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626187 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626150    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-data\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-socket\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626212    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-token\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-podinfo\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626306    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-credential-socket\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626345    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-certs\") pod \"903ad1fb-a8d8-41d2-9958-6897963dbc76\" (UID: \"903ad1fb-a8d8-41d2-9958-6897963dbc76\") "
Jul 05 20:03:05.626612 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626427    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:03:05.626612 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626474    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/903ad1fb-a8d8-41d2-9958-6897963dbc76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:03:05.626742 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626673    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:03:05.626742 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626685    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903ad1fb-a8d8-41d2-9958-6897963dbc76-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.626742 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626716    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.626937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626876    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:03:05.627006 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.626928    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-data" (OuterVolumeSpecName: "istio-data") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:03:05.628531 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.628505    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 20:03:05.628646 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.628601    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-token" (OuterVolumeSpecName: "istio-token") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:03:05.628855 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.628833    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:03:05.628979 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.628861    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-kube-api-access-6cwwc" (OuterVolumeSpecName: "kube-api-access-6cwwc") pod "903ad1fb-a8d8-41d2-9958-6897963dbc76" (UID: "903ad1fb-a8d8-41d2-9958-6897963dbc76"). InnerVolumeSpecName "kube-api-access-6cwwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727566    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727600    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727609    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727617    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903ad1fb-a8d8-41d2-9958-6897963dbc76-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727626    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727635    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903ad1fb-a8d8-41d2-9958-6897963dbc76-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.727651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.727644    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cwwc\" (UniqueName: \"kubernetes.io/projected/903ad1fb-a8d8-41d2-9958-6897963dbc76-kube-api-access-6cwwc\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:03:05.829924 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.829890    2579 generic.go:356] "Generic (PLEG): container finished" podID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerID="028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43" exitCode=0
Jul 05 20:03:05.830080 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.829953    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"
Jul 05 20:03:05.830080 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.829972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" event={"ID":"903ad1fb-a8d8-41d2-9958-6897963dbc76","Type":"ContainerDied","Data":"028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43"}
Jul 05 20:03:05.830080 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.830033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp" event={"ID":"903ad1fb-a8d8-41d2-9958-6897963dbc76","Type":"ContainerDied","Data":"bc2906794b5ea0cacb5c34629ec332719ff77238a86c3d57c54022baf459b0f0"}
Jul 05 20:03:05.830080 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.830059    2579 scope.go:117] "RemoveContainer" containerID="028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43"
Jul 05 20:03:05.840314 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.840296    2579 scope.go:117] "RemoveContainer" containerID="f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"
Jul 05 20:03:05.850297 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.850278    2579 scope.go:117] "RemoveContainer" containerID="028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43"
Jul 05 20:03:05.850557 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:03:05.850540    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43\": container with ID starting with 028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43 not found: ID does not exist" containerID="028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43"
Jul 05 20:03:05.850613 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.850566    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43"} err="failed to get container status \"028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43\": rpc error: code = NotFound desc = could not find container \"028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43\": container with ID starting with 028a42300d80312ecf72444d073a7669f5770072c437128d8e91e4308407ed43 not found: ID does not exist"
Jul 05 20:03:05.850613 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.850585    2579 scope.go:117] "RemoveContainer" containerID="f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"
Jul 05 20:03:05.850874 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:03:05.850856    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d\": container with ID starting with f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d not found: ID does not exist" containerID="f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"
Jul 05 20:03:05.850933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.850880    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d"} err="failed to get container status \"f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d\": rpc error: code = NotFound desc = could not find container \"f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d\": container with ID starting with f00bb18fffe5bde551a205ea7ac87da4ff9851e61190739988fcf289334c8b1d not found: ID does not exist"
Jul 05 20:03:05.854460 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.854438    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"]
Jul 05 20:03:05.858130 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:05.858110    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f4b2f9ba-openshift-default-68fbdd8b87-v5tpp"]
Jul 05 20:03:07.617828 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:07.617779    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" path="/var/lib/kubelet/pods/903ad1fb-a8d8-41d2-9958-6897963dbc76/volumes"
Jul 05 20:03:09.875755 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:09.875725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:09.976271 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:09.976243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:10.591725 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:10.591695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:16.490971 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:16.490929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:16.550662 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:16.550605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:16.639632 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:16.639606    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:16.737189 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:16.737160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:27.220683 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:27.220643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:27.582359 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:27.582323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:48.514495 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:48.514464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:54.135268 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.135226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:54.235906 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.235877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:54.477894 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.477813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:54.775168 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775134    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"]
Jul 05 20:03:54.775502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775490    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy"
Jul 05 20:03:54.775550 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775503    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy"
Jul 05 20:03:54.775550 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775518    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy"
Jul 05 20:03:54.775550 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775523    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy"
Jul 05 20:03:54.775550 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775540    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73030f54-8b10-49fa-9c22-525646384121" containerName="main"
Jul 05 20:03:54.775550 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775547    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="73030f54-8b10-49fa-9c22-525646384121" containerName="main"
Jul 05 20:03:54.775723 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775602    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy"
Jul 05 20:03:54.775723 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775612    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="903ad1fb-a8d8-41d2-9958-6897963dbc76" containerName="istio-proxy"
Jul 05 20:03:54.775723 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.775618    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="73030f54-8b10-49fa-9c22-525646384121" containerName="main"
Jul 05 20:03:54.778597 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.778576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.781557 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.781539    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8dc0f0-openshift-default-dockercfg-bdfl7\""
Jul 05 20:03:54.791303 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.791283    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"]
Jul 05 20:03:54.797732 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.797714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:54.931584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-envoy\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931584 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-certs\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-token\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-podinfo\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34424063-80b5-4c0d-aaad-bc321d18ff3d-istiod-ca-cert\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7v97\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-kube-api-access-l7v97\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-data\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-socket\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:54.931863 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:54.931864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-credential-socket\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.032842 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.032751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34424063-80b5-4c0d-aaad-bc321d18ff3d-istiod-ca-cert\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.032842 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.032787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7v97\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-kube-api-access-l7v97\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.032850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-data\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.032901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-socket\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.032931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-credential-socket\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.032984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-envoy\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-certs\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-token\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033351 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-podinfo\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033418 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033397    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-socket\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033476 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033423    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-credential-socket\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033757 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033491    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-certs\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033757 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033533    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34424063-80b5-4c0d-aaad-bc321d18ff3d-istiod-ca-cert\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.033757 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:55.033910 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.033818    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-data\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.035483 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.035462    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-envoy\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.035576 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.035491    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-podinfo\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.040288 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.040267    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7v97\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-kube-api-access-l7v97\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.040399 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.040315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-token\") pod \"e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") " pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.088794 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.088765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:55.222532 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.222510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"]
Jul 05 20:03:55.224086 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:03:55.224063    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34424063_80b5_4c0d_aaad_bc321d18ff3d.slice/crio-bd1e7e1eea9df1aa3a029dcc55b8c4eb7ca165b0a7cd262ee5b45d12b0617d87 WatchSource:0}: Error finding container bd1e7e1eea9df1aa3a029dcc55b8c4eb7ca165b0a7cd262ee5b45d12b0617d87: Status 404 returned error can't find the container with id bd1e7e1eea9df1aa3a029dcc55b8c4eb7ca165b0a7cd262ee5b45d12b0617d87
Jul 05 20:03:55.226669 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.226628    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:03:55.226764 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.226721    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:03:55.226830 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:55.226764    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:03:56.080227 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:56.080192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" event={"ID":"34424063-80b5-4c0d-aaad-bc321d18ff3d","Type":"ContainerStarted","Data":"52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"}
Jul 05 20:03:56.080410 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:56.080247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" event={"ID":"34424063-80b5-4c0d-aaad-bc321d18ff3d","Type":"ContainerStarted","Data":"bd1e7e1eea9df1aa3a029dcc55b8c4eb7ca165b0a7cd262ee5b45d12b0617d87"}
Jul 05 20:03:56.088971 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:56.088947    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:56.090540 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:56.090510    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 05 20:03:56.090676 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:56.090568    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 05 20:03:56.100952 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:56.100907    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podStartSLOduration=2.100888992 podStartE2EDuration="2.100888992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:03:56.100841237 +0000 UTC m=+1880.923331923" watchObservedRunningTime="2026-07-05 20:03:56.100888992 +0000 UTC m=+1880.923379675"
Jul 05 20:03:57.093525 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:57.093497    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:58.091027 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.090956    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:58.091866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.091844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:03:58.187302 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.187261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:58.272529 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.272501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:58.374008 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.373899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:58.473479 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.473440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:58.712256 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.712174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:03:58.813427 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:03:58.813396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:02.653505 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:02.653446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:02.983134 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:02.983104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:03.260051 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.259976    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"]
Jul 05 20:04:03.264058 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.264040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.266868 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.266844    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b14b17-openshift-default-dockercfg-hvwwt\""
Jul 05 20:04:03.281233 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.281200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:03.283131 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.283109    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"]
Jul 05 20:04:03.402753 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-credential-socket\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.402926 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-token\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.402926 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-podinfo\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.402926 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-certs\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.402926 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-socket\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.403088 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-envoy\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.403088 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.402985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqx62\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-kube-api-access-dqx62\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.403088 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.403068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-data\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.403188 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.403098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istiod-ca-cert\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.438522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.438494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:03.504122 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqx62\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-kube-api-access-dqx62\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504288 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-data\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504288 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istiod-ca-cert\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504288 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-credential-socket\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504469 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-token\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504469 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-podinfo\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504469 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-certs\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504630 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-socket\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504630 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-envoy\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504732 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504659    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-data\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.504791 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.504731    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-credential-socket\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.505043 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.505017    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-certs\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.505160 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.505051    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-socket\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.505160 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.505099    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istiod-ca-cert\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.507160 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.507139    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-envoy\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.507384 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.507364    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-podinfo\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.511435 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.511383    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-token\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.511777 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.511759    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqx62\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-kube-api-access-dqx62\") pod \"e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") " pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.579479 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.579455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:03.714303 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.714275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"]
Jul 05 20:04:03.717318 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:04:03.717289    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6eb2ee_98a4_4a32_b8f2_42fedd99d1c5.slice/crio-bc094dafec422be0b7633268ccb4fb2fc93cc4d482113fb455ab5d95cd5f0884 WatchSource:0}: Error finding container bc094dafec422be0b7633268ccb4fb2fc93cc4d482113fb455ab5d95cd5f0884: Status 404 returned error can't find the container with id bc094dafec422be0b7633268ccb4fb2fc93cc4d482113fb455ab5d95cd5f0884
Jul 05 20:04:03.719884 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.719858    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:03.719961 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.719913    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:03.719961 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:03.719947    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:04.122074 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:04.121982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" event={"ID":"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5","Type":"ContainerStarted","Data":"3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"}
Jul 05 20:04:04.122074 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:04.122038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" event={"ID":"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5","Type":"ContainerStarted","Data":"bc094dafec422be0b7633268ccb4fb2fc93cc4d482113fb455ab5d95cd5f0884"}
Jul 05 20:04:04.140904 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:04.140851    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podStartSLOduration=1.140832301 podStartE2EDuration="1.140832301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:04.140645023 +0000 UTC m=+1888.963135716" watchObservedRunningTime="2026-07-05 20:04:04.140832301 +0000 UTC m=+1888.963322983"
Jul 05 20:04:04.579843 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:04.579788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:04.584639 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:04.584618    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:05.127713 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:05.127680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:05.128744 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:05.128721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:06.177989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:06.177955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:06.262057 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:06.262024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:06.327651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:06.327571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:06.746646 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:06.746602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:06.846614 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:06.846583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:10.691697 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:10.691664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:13.264526 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:13.263847    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:43492->10.134.0.59:15021: read: connection reset by peer" start-of-body=
Jul 05 20:04:13.264526 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:13.263914    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:43492->10.134.0.59:15021: read: connection reset by peer"
Jul 05 20:04:14.180294 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:14.180264    2579 generic.go:356] "Generic (PLEG): container finished" podID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerID="52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339" exitCode=0
Jul 05 20:04:14.180480 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:14.180332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" event={"ID":"34424063-80b5-4c0d-aaad-bc321d18ff3d","Type":"ContainerDied","Data":"52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"}
Jul 05 20:04:14.180769 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:14.180750    2579 scope.go:117] "RemoveContainer" containerID="52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"
Jul 05 20:04:14.181765 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:14.181734    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:14.181881 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:14.181826    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:14.181881 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:14.181874    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:15.194633 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:15.194595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" event={"ID":"34424063-80b5-4c0d-aaad-bc321d18ff3d","Type":"ContainerStarted","Data":"1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c"}
Jul 05 20:04:16.089064 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:16.089023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:04:16.089273 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:16.089185    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 05 20:04:16.089273 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:16.089235    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 05 20:04:17.089068 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:17.089033    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 05 20:04:17.089420 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:17.089084    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 05 20:04:18.089989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:18.089944    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 05 20:04:18.090463 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:18.090019    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 05 20:04:19.093147 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:19.093117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:04:19.093623 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:19.093479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:04:19.094092 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:19.094074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:04:20.130136 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.130108    2579 patch_prober.go:28] interesting pod/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 05 20:04:20.130445 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.130176    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 05 20:04:20.195279 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.195248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:20.221701 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.221677    2579 generic.go:356] "Generic (PLEG): container finished" podID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerID="3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69" exitCode=0
Jul 05 20:04:20.221817 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.221746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" event={"ID":"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5","Type":"ContainerDied","Data":"3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"}
Jul 05 20:04:20.222212 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.222193    2579 scope.go:117] "RemoveContainer" containerID="3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"
Jul 05 20:04:20.223146 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.223122    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:20.223214 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.223182    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:20.223252 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.223215    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:04:20.297501 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:20.297463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:21.232843 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:21.231924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" event={"ID":"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5","Type":"ContainerStarted","Data":"d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80"}
Jul 05 20:04:21.579998 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:21.579967    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:21.580177 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:21.580131    2579 patch_prober.go:28] interesting pod/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 05 20:04:21.580225 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:21.580175    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 05 20:04:22.580653 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:22.580617    2579 patch_prober.go:28] interesting pod/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 05 20:04:22.581132 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:22.580678    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 05 20:04:22.779691 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:22.779653    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:23.580551 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:23.580516    2579 patch_prober.go:28] interesting pod/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 05 20:04:23.580733 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:23.580568    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 05 20:04:24.580163 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:24.580127    2579 patch_prober.go:28] interesting pod/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 05 20:04:24.580339 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:24.580187    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 05 20:04:25.583896 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:25.583868    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:25.584356 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:25.584236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:25.584945 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:25.584928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:04:27.599847 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:27.599814    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:27.703113 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:27.703080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:04:57.492578 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:04:57.492544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:19.425245 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:19.425213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:20.425755 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:20.425723    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:20.593765 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:20.593737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:20.985373 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:20.985337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:21.083750 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:21.083724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:21.284070 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:21.283994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:05:26.058229 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:05:26.058196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:02.807683 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:02.807602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:03.092224 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.092150    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"]
Jul 05 20:06:03.092406 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.092376    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" containerID="cri-o://1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c" gracePeriod=30
Jul 05 20:06:03.105556 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.105532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:03.303206 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.303173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:03.480549 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.480479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:03.875173 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.875141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:03.975856 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:03.975823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:04.095729 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:04.095692    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 20:06:04.095946 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:04.095768    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 20:06:04.113513 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:04.113482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:08.351510 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.351450    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:06:08.362954 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.362924    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-token\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363095 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.362964    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-podinfo\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363095 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-envoy\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363095 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-socket\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363118    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7v97\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-kube-api-access-l7v97\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363177    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-certs\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-credential-socket\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34424063-80b5-4c0d-aaad-bc321d18ff3d-istiod-ca-cert\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363483 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-data\") pod \"34424063-80b5-4c0d-aaad-bc321d18ff3d\" (UID: \"34424063-80b5-4c0d-aaad-bc321d18ff3d\") "
Jul 05 20:06:08.363483 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363414    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:08.363625 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363595    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:08.363688 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363658    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.363824 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363786    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:08.363897 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.363831    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34424063-80b5-4c0d-aaad-bc321d18ff3d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:06:08.364198 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.364166    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-data" (OuterVolumeSpecName: "istio-data") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:08.365318 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.365298    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:08.365411 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.365318    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 20:06:08.365520 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.365499    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:08.365682 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.365654    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-kube-api-access-l7v97" (OuterVolumeSpecName: "kube-api-access-l7v97") pod "34424063-80b5-4c0d-aaad-bc321d18ff3d" (UID: "34424063-80b5-4c0d-aaad-bc321d18ff3d"). InnerVolumeSpecName "kube-api-access-l7v97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:08.464817 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464757    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7v97\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-kube-api-access-l7v97\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.464817 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464789    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.465021 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464828    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.465021 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464840    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34424063-80b5-4c0d-aaad-bc321d18ff3d-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.465021 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464852    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.465021 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464863    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.465021 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464873    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.465021 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.464883    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34424063-80b5-4c0d-aaad-bc321d18ff3d-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:08.783813 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.783768    2579 generic.go:356] "Generic (PLEG): container finished" podID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerID="1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c" exitCode=0
Jul 05 20:06:08.784017 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.783828    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"
Jul 05 20:06:08.784017 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.783834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" event={"ID":"34424063-80b5-4c0d-aaad-bc321d18ff3d","Type":"ContainerDied","Data":"1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c"}
Jul 05 20:06:08.784017 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.783896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq" event={"ID":"34424063-80b5-4c0d-aaad-bc321d18ff3d","Type":"ContainerDied","Data":"bd1e7e1eea9df1aa3a029dcc55b8c4eb7ca165b0a7cd262ee5b45d12b0617d87"}
Jul 05 20:06:08.784017 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.783925    2579 scope.go:117] "RemoveContainer" containerID="1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c"
Jul 05 20:06:08.794968 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.794953    2579 scope.go:117] "RemoveContainer" containerID="52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"
Jul 05 20:06:08.802683 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.802668    2579 scope.go:117] "RemoveContainer" containerID="1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c"
Jul 05 20:06:08.802962 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:08.802937    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c\": container with ID starting with 1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c not found: ID does not exist" containerID="1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c"
Jul 05 20:06:08.803025 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.802973    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c"} err="failed to get container status \"1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c\": rpc error: code = NotFound desc = could not find container \"1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c\": container with ID starting with 1673f95a32bccde73d9746493b6d25d96b69b170f68072fa8402169a3f20186c not found: ID does not exist"
Jul 05 20:06:08.803025 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.802994    2579 scope.go:117] "RemoveContainer" containerID="52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"
Jul 05 20:06:08.803262 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:08.803244    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339\": container with ID starting with 52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339 not found: ID does not exist" containerID="52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"
Jul 05 20:06:08.803310 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.803270    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339"} err="failed to get container status \"52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339\": rpc error: code = NotFound desc = could not find container \"52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339\": container with ID starting with 52f996ae5a2541e3bec89066fe9ea752f7fb3b82e50f2fb355dc8a6a46e47339 not found: ID does not exist"
Jul 05 20:06:08.807647 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.807626    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"]
Jul 05 20:06:08.812993 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:08.812975    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc0f0-openshift-default-8446b7475f-skscq"]
Jul 05 20:06:09.557310 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:09.557283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:09.618670 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:09.618641    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" path="/var/lib/kubelet/pods/34424063-80b5-4c0d-aaad-bc321d18ff3d/volumes"
Jul 05 20:06:09.657663 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:09.657637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:09.786657 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:09.786618    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"]
Jul 05 20:06:09.786888 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:09.786864    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" containerID="cri-o://d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80" gracePeriod=30
Jul 05 20:06:09.815418 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:09.815348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:10.047668 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:10.047637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:10.382953 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:10.382922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:10.585989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:10.585950    2579 patch_prober.go:28] interesting pod/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 20:06:10.586373 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:10.586014    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 20:06:10.676824 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:10.676730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:10.949161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:10.949068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:15.047686 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.047636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:06:15.126164 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126132    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-data\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126286 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-credential-socket\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126286 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-certs\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126286 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126275    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istiod-ca-cert\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126437 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-token\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126437 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-socket\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126437 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126356    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-envoy\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126593 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126422    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:15.126593 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126544    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:15.126715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126609    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:15.126715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-podinfo\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126835 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126699    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:06:15.126835 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126731    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqx62\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-kube-api-access-dqx62\") pod \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\" (UID: \"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5\") "
Jul 05 20:06:15.126971 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.126952    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:15.127071 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.127054    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.127126 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.127074    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.127126 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.127082    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.127126 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.127091    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.127126 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.127106    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.128674 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.128652    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 20:06:15.128768 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.128701    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-kube-api-access-dqx62" (OuterVolumeSpecName: "kube-api-access-dqx62") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "kube-api-access-dqx62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:15.128898 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.128883    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:15.128950 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.128919    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" (UID: "ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:15.228462 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.228437    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.228462 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.228461    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqx62\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-kube-api-access-dqx62\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.228626 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.228472    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.228626 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.228481    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:15.821726 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.821690    2579 generic.go:356] "Generic (PLEG): container finished" podID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerID="d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80" exitCode=0
Jul 05 20:06:15.821936 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.821733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" event={"ID":"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5","Type":"ContainerDied","Data":"d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80"}
Jul 05 20:06:15.821936 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.821745    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"
Jul 05 20:06:15.821936 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.821773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp" event={"ID":"ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5","Type":"ContainerDied","Data":"bc094dafec422be0b7633268ccb4fb2fc93cc4d482113fb455ab5d95cd5f0884"}
Jul 05 20:06:15.821936 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.821794    2579 scope.go:117] "RemoveContainer" containerID="d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80"
Jul 05 20:06:15.831130 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.831114    2579 scope.go:117] "RemoveContainer" containerID="3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"
Jul 05 20:06:15.841342 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.841190    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"]
Jul 05 20:06:15.841342 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.841321    2579 scope.go:117] "RemoveContainer" containerID="d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80"
Jul 05 20:06:15.842236 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:15.842087    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80\": container with ID starting with d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80 not found: ID does not exist" containerID="d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80"
Jul 05 20:06:15.842236 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.842124    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80"} err="failed to get container status \"d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80\": rpc error: code = NotFound desc = could not find container \"d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80\": container with ID starting with d4c6486e1a515c3f3b197bad415d8e1360c8971cba9829f5563a58b3881c8e80 not found: ID does not exist"
Jul 05 20:06:15.842236 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.842151    2579 scope.go:117] "RemoveContainer" containerID="3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"
Jul 05 20:06:15.842673 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:15.842645    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69\": container with ID starting with 3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69 not found: ID does not exist" containerID="3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"
Jul 05 20:06:15.842780 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.842680    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69"} err="failed to get container status \"3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69\": rpc error: code = NotFound desc = could not find container \"3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69\": container with ID starting with 3a3a3079a95142d02d91a5b79a203d803d459dc03c425f93f149c922f020fc69 not found: ID does not exist"
Jul 05 20:06:15.845084 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:15.845064    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b14b17-openshift-default-7bb4c6f56f-gc6xp"]
Jul 05 20:06:16.679485 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.679448    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:16.745911 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.745878    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"]
Jul 05 20:06:16.746353 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746328    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy"
Jul 05 20:06:16.746353 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746354    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy"
Jul 05 20:06:16.746502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746369    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy"
Jul 05 20:06:16.746502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746378    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy"
Jul 05 20:06:16.746502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746474    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy"
Jul 05 20:06:16.746502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746487    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy"
Jul 05 20:06:16.746502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746495    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy"
Jul 05 20:06:16.746502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.746501    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy"
Jul 05 20:06:16.751142 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.751124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.753871 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.753847    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-237c8b-serving-cert\""
Jul 05 20:06:16.761542 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.761517    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"]
Jul 05 20:06:16.776089 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.776059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:16.834643 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.834617    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:16.846433 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.846411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgk6\" (UniqueName: \"kubernetes.io/projected/d6583e87-1d9f-4b6e-befe-dc725d073c81-kube-api-access-ksgk6\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.846563 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.846454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.846563 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.846532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6583e87-1d9f-4b6e-befe-dc725d073c81-openshift-service-ca\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.947589 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.947512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgk6\" (UniqueName: \"kubernetes.io/projected/d6583e87-1d9f-4b6e-befe-dc725d073c81-kube-api-access-ksgk6\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.947589 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.947558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.947762 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.947601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6583e87-1d9f-4b6e-befe-dc725d073c81-openshift-service-ca\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.947762 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:16.947741    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-237c8b-serving-cert: secret "maas-api-e2e-api-a-237c8b-serving-cert" not found
Jul 05 20:06:16.947878 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:16.947865    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls podName:d6583e87-1d9f-4b6e-befe-dc725d073c81 nodeName:}" failed. No retries permitted until 2026-07-05 20:06:17.447845229 +0000 UTC m=+2022.270335889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls") pod "maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" (UID: "d6583e87-1d9f-4b6e-befe-dc725d073c81") : secret "maas-api-e2e-api-a-237c8b-serving-cert" not found
Jul 05 20:06:16.948201 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.948186    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6583e87-1d9f-4b6e-befe-dc725d073c81-openshift-service-ca\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:16.958666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:16.958643    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgk6\" (UniqueName: \"kubernetes.io/projected/d6583e87-1d9f-4b6e-befe-dc725d073c81-kube-api-access-ksgk6\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:17.102376 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.102344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:17.248190 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.248165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:17.348824 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.348781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:17.451218 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.451185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:17.453588 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.453559    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls\") pod \"maas-api-e2e-api-a-237c8b-6884686df4-kgfxv\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") " pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:17.617932 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.617855    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" path="/var/lib/kubelet/pods/ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5/volumes"
Jul 05 20:06:17.663298 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.663272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:17.797773 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.797740    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"]
Jul 05 20:06:17.800982 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:06:17.800954    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6583e87_1d9f_4b6e_befe_dc725d073c81.slice/crio-14c402c3fa397cd335165c409015894e2ead66a64a5c6f732d5f07839f20ef20 WatchSource:0}: Error finding container 14c402c3fa397cd335165c409015894e2ead66a64a5c6f732d5f07839f20ef20: Status 404 returned error can't find the container with id 14c402c3fa397cd335165c409015894e2ead66a64a5c6f732d5f07839f20ef20
Jul 05 20:06:17.802812 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.802778    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 20:06:17.834444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:17.834415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" event={"ID":"d6583e87-1d9f-4b6e-befe-dc725d073c81","Type":"ContainerStarted","Data":"14c402c3fa397cd335165c409015894e2ead66a64a5c6f732d5f07839f20ef20"}
Jul 05 20:06:18.841031 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:18.840999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" event={"ID":"d6583e87-1d9f-4b6e-befe-dc725d073c81","Type":"ContainerStarted","Data":"3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a"}
Jul 05 20:06:18.841396 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:18.841063    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:18.860250 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:18.860205    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" podStartSLOduration=2.52640038 podStartE2EDuration="2.860192051s" totalImagesPullingTime="333.791671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:06:18.858978685 +0000 UTC m=+2023.681469367" watchObservedRunningTime="2026-07-05 20:06:18.860192051 +0000 UTC m=+2023.682682734"
Jul 05 20:06:21.177973 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.177935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:21.636434 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.636402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:21.918964 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.918884    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"]
Jul 05 20:06:21.919266 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.919253    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy"
Jul 05 20:06:21.919266 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.919266    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34424063-80b5-4c0d-aaad-bc321d18ff3d" containerName="istio-proxy"
Jul 05 20:06:21.919413 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.919276    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy"
Jul 05 20:06:21.919413 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.919282    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6eb2ee-98a4-4a32-b8f2-42fedd99d1c5" containerName="istio-proxy"
Jul 05 20:06:21.922500 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.922480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.925267 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.925246    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-29e15f-openshift-default-dockercfg-cgmn5\""
Jul 05 20:06:21.933496 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.933466    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"]
Jul 05 20:06:21.946296 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.946274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:21.994659 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8gf6\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-kube-api-access-c8gf6\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994659 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-data\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-credential-socket\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-token\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-envoy\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-certs\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-podinfo\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.994865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-socket\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:21.995163 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:21.994887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istiod-ca-cert\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095647 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8gf6\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-kube-api-access-c8gf6\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095647 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-data\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-credential-socket\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-token\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-envoy\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-certs\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-podinfo\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-socket\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.095937 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.095875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istiod-ca-cert\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.096296 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.096144    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-credential-socket\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.096296 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.096214    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-certs\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.096296 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.096287    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-data\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.096523 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.096504    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istiod-ca-cert\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.096579 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.096523    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-socket\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.098320 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.098293    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-envoy\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.098432 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.098377    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-podinfo\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.103457 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.103426    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-token\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.103607 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.103586    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8gf6\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-kube-api-access-c8gf6\") pod \"e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") " pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.233462 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.233440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:22.387716 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.387686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"]
Jul 05 20:06:22.388211 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:06:22.388186    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2554acd_c344_4ad4_9833_1bdd83c0e1dc.slice/crio-e6e9be449c759eae7460f2b26a1f8ffad3f28163db9a1684a3dec1107b2b65cd WatchSource:0}: Error finding container e6e9be449c759eae7460f2b26a1f8ffad3f28163db9a1684a3dec1107b2b65cd: Status 404 returned error can't find the container with id e6e9be449c759eae7460f2b26a1f8ffad3f28163db9a1684a3dec1107b2b65cd
Jul 05 20:06:22.390443 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.390406    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:06:22.390522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.390473    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:06:22.390522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.390504    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:06:22.407059 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.407026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:22.863500 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.863464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" event={"ID":"f2554acd-c344-4ad4-9833-1bdd83c0e1dc","Type":"ContainerStarted","Data":"3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"}
Jul 05 20:06:22.863674 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.863516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" event={"ID":"f2554acd-c344-4ad4-9833-1bdd83c0e1dc","Type":"ContainerStarted","Data":"e6e9be449c759eae7460f2b26a1f8ffad3f28163db9a1684a3dec1107b2b65cd"}
Jul 05 20:06:22.885715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:22.885669    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" podStartSLOduration=1.885650049 podStartE2EDuration="1.885650049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:06:22.884985949 +0000 UTC m=+2027.707476633" watchObservedRunningTime="2026-07-05 20:06:22.885650049 +0000 UTC m=+2027.708140732"
Jul 05 20:06:23.233620 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:23.233590    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:23.238347 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:23.238326    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:23.869001 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:23.868969    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:23.869959 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:23.869936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:24.852050 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:24.852011    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:24.904999 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:24.904964    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:24.963305 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:24.963273    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"]
Jul 05 20:06:24.967474 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:24.967456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:24.970117 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:24.970091    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-29e15f-serving-cert\""
Jul 05 20:06:24.977707 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:24.977684    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"]
Jul 05 20:06:25.002295 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.002263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:25.021518 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.021492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.021662 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.021559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76mz\" (UniqueName: \"kubernetes.io/projected/ac074702-43dd-401d-aaaf-3dfc950c93f5-kube-api-access-l76mz\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.021780 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.021754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac074702-43dd-401d-aaaf-3dfc950c93f5-openshift-service-ca\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.101825 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.101783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:25.122609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.122538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac074702-43dd-401d-aaaf-3dfc950c93f5-openshift-service-ca\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.122736 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.122609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.122736 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.122638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76mz\" (UniqueName: \"kubernetes.io/projected/ac074702-43dd-401d-aaaf-3dfc950c93f5-kube-api-access-l76mz\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.122821 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:25.122755    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-29e15f-serving-cert: secret "maas-api-e2e-api-b-29e15f-serving-cert" not found
Jul 05 20:06:25.122862 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:25.122837    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls podName:ac074702-43dd-401d-aaaf-3dfc950c93f5 nodeName:}" failed. No retries permitted until 2026-07-05 20:06:25.622820265 +0000 UTC m=+2030.445310946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls") pod "maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" (UID: "ac074702-43dd-401d-aaaf-3dfc950c93f5") : secret "maas-api-e2e-api-b-29e15f-serving-cert" not found
Jul 05 20:06:25.123320 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.123299    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac074702-43dd-401d-aaaf-3dfc950c93f5-openshift-service-ca\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.131517 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.131487    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76mz\" (UniqueName: \"kubernetes.io/projected/ac074702-43dd-401d-aaaf-3dfc950c93f5-kube-api-access-l76mz\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.345123 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.345091    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:25.446469 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.446394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:25.545471 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.545444    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:25.626413 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.626378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.628715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.628686    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls\") pod \"maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") " pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:25.880128 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:25.880098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:26.019522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:26.019495    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"]
Jul 05 20:06:26.021271 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:06:26.021245    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac074702_43dd_401d_aaaf_3dfc950c93f5.slice/crio-eda7589ea7b0cb5ec96bb4df3e77b0143066e53f1fc6347b9de89f3ebb060119 WatchSource:0}: Error finding container eda7589ea7b0cb5ec96bb4df3e77b0143066e53f1fc6347b9de89f3ebb060119: Status 404 returned error can't find the container with id eda7589ea7b0cb5ec96bb4df3e77b0143066e53f1fc6347b9de89f3ebb060119
Jul 05 20:06:26.887129 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:26.887095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" event={"ID":"ac074702-43dd-401d-aaaf-3dfc950c93f5","Type":"ContainerStarted","Data":"08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de"}
Jul 05 20:06:26.887494 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:26.887153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" event={"ID":"ac074702-43dd-401d-aaaf-3dfc950c93f5","Type":"ContainerStarted","Data":"eda7589ea7b0cb5ec96bb4df3e77b0143066e53f1fc6347b9de89f3ebb060119"}
Jul 05 20:06:26.887494 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:26.887179    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:26.906113 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:26.906068    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" podStartSLOduration=2.489202292 podStartE2EDuration="2.906053531s" totalImagesPullingTime="416.851239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:06:26.903370888 +0000 UTC m=+2031.725861571" watchObservedRunningTime="2026-07-05 20:06:26.906053531 +0000 UTC m=+2031.728544259"
Jul 05 20:06:29.113037 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:29.112997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:29.214001 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:29.213965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:29.397049 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:29.396966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:32.897989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:32.897959    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:37.551432 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.551398    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:37.929775 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.929694    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:37.949536 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.949504    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerID="3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611" exitCode=0
Jul 05 20:06:37.949696 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.949581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" event={"ID":"f2554acd-c344-4ad4-9833-1bdd83c0e1dc","Type":"ContainerDied","Data":"3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"}
Jul 05 20:06:37.950011 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.949995    2579 scope.go:117] "RemoveContainer" containerID="3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"
Jul 05 20:06:37.951029 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.951001    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:06:37.951154 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.951079    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:06:37.951154 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:37.951125    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 05 20:06:38.029599 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.029578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:38.129813 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.129764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:38.211112 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.211032    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"]
Jul 05 20:06:38.211299 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.211271    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" podUID="d6583e87-1d9f-4b6e-befe-dc725d073c81" containerName="maas-api" containerID="cri-o://3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a" gracePeriod=30
Jul 05 20:06:38.230615 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.230584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:38.470113 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.470050    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:38.547689 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.547663    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6583e87-1d9f-4b6e-befe-dc725d073c81-openshift-service-ca\") pod \"d6583e87-1d9f-4b6e-befe-dc725d073c81\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") "
Jul 05 20:06:38.547864 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.547718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksgk6\" (UniqueName: \"kubernetes.io/projected/d6583e87-1d9f-4b6e-befe-dc725d073c81-kube-api-access-ksgk6\") pod \"d6583e87-1d9f-4b6e-befe-dc725d073c81\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") "
Jul 05 20:06:38.547864 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.547743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls\") pod \"d6583e87-1d9f-4b6e-befe-dc725d073c81\" (UID: \"d6583e87-1d9f-4b6e-befe-dc725d073c81\") "
Jul 05 20:06:38.548106 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.548079    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6583e87-1d9f-4b6e-befe-dc725d073c81-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6583e87-1d9f-4b6e-befe-dc725d073c81" (UID: "d6583e87-1d9f-4b6e-befe-dc725d073c81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:06:38.549844 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.549819    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6583e87-1d9f-4b6e-befe-dc725d073c81" (UID: "d6583e87-1d9f-4b6e-befe-dc725d073c81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:06:38.549925 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.549871    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583e87-1d9f-4b6e-befe-dc725d073c81-kube-api-access-ksgk6" (OuterVolumeSpecName: "kube-api-access-ksgk6") pod "d6583e87-1d9f-4b6e-befe-dc725d073c81" (UID: "d6583e87-1d9f-4b6e-befe-dc725d073c81"). InnerVolumeSpecName "kube-api-access-ksgk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:38.649148 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.649120    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksgk6\" (UniqueName: \"kubernetes.io/projected/d6583e87-1d9f-4b6e-befe-dc725d073c81-kube-api-access-ksgk6\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:38.649148 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.649145    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6583e87-1d9f-4b6e-befe-dc725d073c81-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:38.649148 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.649155    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6583e87-1d9f-4b6e-befe-dc725d073c81-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:38.868959 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.868910    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:38.956598 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.956564    2579 generic.go:356] "Generic (PLEG): container finished" podID="d6583e87-1d9f-4b6e-befe-dc725d073c81" containerID="3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a" exitCode=0
Jul 05 20:06:38.956781 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.956609    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"
Jul 05 20:06:38.956781 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.956638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" event={"ID":"d6583e87-1d9f-4b6e-befe-dc725d073c81","Type":"ContainerDied","Data":"3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a"}
Jul 05 20:06:38.956781 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.956681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv" event={"ID":"d6583e87-1d9f-4b6e-befe-dc725d073c81","Type":"ContainerDied","Data":"14c402c3fa397cd335165c409015894e2ead66a64a5c6f732d5f07839f20ef20"}
Jul 05 20:06:38.956781 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.956703    2579 scope.go:117] "RemoveContainer" containerID="3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a"
Jul 05 20:06:38.958869 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.958841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" event={"ID":"f2554acd-c344-4ad4-9833-1bdd83c0e1dc","Type":"ContainerStarted","Data":"95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409"}
Jul 05 20:06:38.966354 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.966339    2579 scope.go:117] "RemoveContainer" containerID="3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a"
Jul 05 20:06:38.966605 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:38.966584    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a\": container with ID starting with 3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a not found: ID does not exist" containerID="3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a"
Jul 05 20:06:38.966658 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.966612    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a"} err="failed to get container status \"3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a\": rpc error: code = NotFound desc = could not find container \"3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a\": container with ID starting with 3c08ece609914f4c00d1a0813bb49db30c30afb50eef72e032cec297df95c88a not found: ID does not exist"
Jul 05 20:06:38.998902 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:38.998877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"]
Jul 05 20:06:39.000945 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:39.000925    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-237c8b-6884686df4-kgfxv"]
Jul 05 20:06:39.234251 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:39.234218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:39.235413 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:39.235378    2579 patch_prober.go:28] interesting pod/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 05 20:06:39.235549 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:39.235440    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 05 20:06:39.619318 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:39.619238    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6583e87-1d9f-4b6e-befe-dc725d073c81" path="/var/lib/kubelet/pods/d6583e87-1d9f-4b6e-befe-dc725d073c81/volumes"
Jul 05 20:06:40.234576 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:40.234533    2579 patch_prober.go:28] interesting pod/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 05 20:06:40.235128 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:40.234608    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 05 20:06:41.234228 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:41.234187    2579 patch_prober.go:28] interesting pod/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 05 20:06:41.234451 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:41.234272    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 05 20:06:42.234698 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:42.234650    2579 patch_prober.go:28] interesting pod/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 05 20:06:42.235244 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:42.234727    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 05 20:06:43.237489 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:43.237452    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:43.237963 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:43.237719    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:43.238265 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:43.238250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:43.630276 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:43.630199    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:43.731930 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:43.731900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:43.904207 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:43.904130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:44.100274 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.100245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:44.276745 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.276716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:44.653115 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.653021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:44.768529 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.768496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:44.869495 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.869466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:44.991299 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.991266    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"]
Jul 05 20:06:44.991595 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:44.991551    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" podUID="ac074702-43dd-401d-aaaf-3dfc950c93f5" containerName="maas-api" containerID="cri-o://08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de" gracePeriod=30
Jul 05 20:06:45.035651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.035624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:45.243130 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.243078    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:45.415428 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.415404    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls\") pod \"ac074702-43dd-401d-aaaf-3dfc950c93f5\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") "
Jul 05 20:06:45.415761 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.415452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac074702-43dd-401d-aaaf-3dfc950c93f5-openshift-service-ca\") pod \"ac074702-43dd-401d-aaaf-3dfc950c93f5\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") "
Jul 05 20:06:45.415761 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.415479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l76mz\" (UniqueName: \"kubernetes.io/projected/ac074702-43dd-401d-aaaf-3dfc950c93f5-kube-api-access-l76mz\") pod \"ac074702-43dd-401d-aaaf-3dfc950c93f5\" (UID: \"ac074702-43dd-401d-aaaf-3dfc950c93f5\") "
Jul 05 20:06:45.415761 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.415749    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac074702-43dd-401d-aaaf-3dfc950c93f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac074702-43dd-401d-aaaf-3dfc950c93f5" (UID: "ac074702-43dd-401d-aaaf-3dfc950c93f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:06:45.417493 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.417460    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac074702-43dd-401d-aaaf-3dfc950c93f5-kube-api-access-l76mz" (OuterVolumeSpecName: "kube-api-access-l76mz") pod "ac074702-43dd-401d-aaaf-3dfc950c93f5" (UID: "ac074702-43dd-401d-aaaf-3dfc950c93f5"). InnerVolumeSpecName "kube-api-access-l76mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:45.417595 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.417509    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac074702-43dd-401d-aaaf-3dfc950c93f5" (UID: "ac074702-43dd-401d-aaaf-3dfc950c93f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:06:45.517127 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.517075    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac074702-43dd-401d-aaaf-3dfc950c93f5-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:45.517127 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.517095    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac074702-43dd-401d-aaaf-3dfc950c93f5-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:45.517127 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:45.517104    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l76mz\" (UniqueName: \"kubernetes.io/projected/ac074702-43dd-401d-aaaf-3dfc950c93f5-kube-api-access-l76mz\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:46.001540 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.001509    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac074702-43dd-401d-aaaf-3dfc950c93f5" containerID="08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de" exitCode=0
Jul 05 20:06:46.001730 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.001545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" event={"ID":"ac074702-43dd-401d-aaaf-3dfc950c93f5","Type":"ContainerDied","Data":"08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de"}
Jul 05 20:06:46.001730 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.001551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"
Jul 05 20:06:46.001730 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.001584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd" event={"ID":"ac074702-43dd-401d-aaaf-3dfc950c93f5","Type":"ContainerDied","Data":"eda7589ea7b0cb5ec96bb4df3e77b0143066e53f1fc6347b9de89f3ebb060119"}
Jul 05 20:06:46.001730 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.001605    2579 scope.go:117] "RemoveContainer" containerID="08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de"
Jul 05 20:06:46.010371 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.010348    2579 scope.go:117] "RemoveContainer" containerID="08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de"
Jul 05 20:06:46.010632 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:46.010615    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de\": container with ID starting with 08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de not found: ID does not exist" containerID="08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de"
Jul 05 20:06:46.010698 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.010640    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de"} err="failed to get container status \"08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de\": rpc error: code = NotFound desc = could not find container \"08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de\": container with ID starting with 08e7248ddd18376e86628ec847873af0ade4b022f488ce53450ef4be0616c2de not found: ID does not exist"
Jul 05 20:06:46.022079 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.022056    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"]
Jul 05 20:06:46.024275 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:46.024258    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-29e15f-fc58b9998-c8wnd"]
Jul 05 20:06:47.618393 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:47.618352    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac074702-43dd-401d-aaaf-3dfc950c93f5" path="/var/lib/kubelet/pods/ac074702-43dd-401d-aaaf-3dfc950c93f5/volumes"
Jul 05 20:06:50.369375 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:50.369344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:50.469929 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:50.469896    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:50.609903 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:50.609868    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"]
Jul 05 20:06:50.610117 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:50.610091    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy" containerID="cri-o://95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409" gracePeriod=30
Jul 05 20:06:50.630725 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:50.630624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:50.893650 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:50.893567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:51.208552 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:51.208476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:51.514210 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:51.514178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:52.104379 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:52.104318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:54.871012 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.870977    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:54.968447 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968415    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"]
Jul 05 20:06:54.968844 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968818    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6583e87-1d9f-4b6e-befe-dc725d073c81" containerName="maas-api"
Jul 05 20:06:54.968844 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968836    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6583e87-1d9f-4b6e-befe-dc725d073c81" containerName="maas-api"
Jul 05 20:06:54.969036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968853    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac074702-43dd-401d-aaaf-3dfc950c93f5" containerName="maas-api"
Jul 05 20:06:54.969036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968862    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac074702-43dd-401d-aaaf-3dfc950c93f5" containerName="maas-api"
Jul 05 20:06:54.969036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968944    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6583e87-1d9f-4b6e-befe-dc725d073c81" containerName="maas-api"
Jul 05 20:06:54.969036 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.968954    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac074702-43dd-401d-aaaf-3dfc950c93f5" containerName="maas-api"
Jul 05 20:06:54.976940 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.976910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:54.978280 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.978246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:54.980227 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.980201    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-d9296f-serving-cert\""
Jul 05 20:06:54.988496 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.988470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"]
Jul 05 20:06:54.992585 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.992559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0505c284-245f-4d6d-b337-f42d7ddfc32d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:54.992702 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.992597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft22w\" (UniqueName: \"kubernetes.io/projected/0505c284-245f-4d6d-b337-f42d7ddfc32d-kube-api-access-ft22w\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:54.992702 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:54.992650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0505c284-245f-4d6d-b337-f42d7ddfc32d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.093291 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.093252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0505c284-245f-4d6d-b337-f42d7ddfc32d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.093291 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.093304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft22w\" (UniqueName: \"kubernetes.io/projected/0505c284-245f-4d6d-b337-f42d7ddfc32d-kube-api-access-ft22w\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.093541 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.093342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0505c284-245f-4d6d-b337-f42d7ddfc32d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.094079 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.094050    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0505c284-245f-4d6d-b337-f42d7ddfc32d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.095847 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.095821    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0505c284-245f-4d6d-b337-f42d7ddfc32d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.102977 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.102950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:55.106261 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.106235    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft22w\" (UniqueName: \"kubernetes.io/projected/0505c284-245f-4d6d-b337-f42d7ddfc32d-kube-api-access-ft22w\") pod \"maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") " pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.200432 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.200363    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:55.288715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.288684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:55.423352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.423313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"]
Jul 05 20:06:55.425444 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:06:55.425413    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0505c284_245f_4d6d_b337_f42d7ddfc32d.slice/crio-f8c615e2230220453b7af42d9e6b340bed360a9b828c4aa4f040cc2348c2cf63 WatchSource:0}: Error finding container f8c615e2230220453b7af42d9e6b340bed360a9b828c4aa4f040cc2348c2cf63: Status 404 returned error can't find the container with id f8c615e2230220453b7af42d9e6b340bed360a9b828c4aa4f040cc2348c2cf63
Jul 05 20:06:55.544789 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.544765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:55.645339 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.645317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:55.862231 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.862208    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:55.898743 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.898715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-data\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.898765    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-credential-socket\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.898793    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-socket\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.898849    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-envoy\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.898878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-certs\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.898926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-token\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-podinfo\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899083    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8gf6\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-kube-api-access-c8gf6\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899161 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899116    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istiod-ca-cert\") pod \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\" (UID: \"f2554acd-c344-4ad4-9833-1bdd83c0e1dc\") "
Jul 05 20:06:55.899614 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899183    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:55.899614 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899473    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-credential-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:55.899614 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899512    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:06:55.899772 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899726    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:55.899852 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899780    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:55.899915 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.899856    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:55.901172 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.901145    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:06:55.901265 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.901189    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 20:06:55.901265 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.901212    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:55.901530 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:55.901516    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-kube-api-access-c8gf6" (OuterVolumeSpecName: "kube-api-access-c8gf6") pod "f2554acd-c344-4ad4-9833-1bdd83c0e1dc" (UID: "f2554acd-c344-4ad4-9833-1bdd83c0e1dc"). InnerVolumeSpecName "kube-api-access-c8gf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:06:56.000158 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000131    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-podinfo\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000158 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000155    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8gf6\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-kube-api-access-c8gf6\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000165    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istiod-ca-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000174    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-data\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000182    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-socket\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000189    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-envoy\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000197    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-workload-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.000331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.000204    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2554acd-c344-4ad4-9833-1bdd83c0e1dc-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:06:56.059064 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.058990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc" event={"ID":"0505c284-245f-4d6d-b337-f42d7ddfc32d","Type":"ContainerStarted","Data":"f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7"}
Jul 05 20:06:56.059064 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.059042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc" event={"ID":"0505c284-245f-4d6d-b337-f42d7ddfc32d","Type":"ContainerStarted","Data":"f8c615e2230220453b7af42d9e6b340bed360a9b828c4aa4f040cc2348c2cf63"}
Jul 05 20:06:56.059254 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.059073    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:06:56.060723 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.060698    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerID="95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409" exitCode=0
Jul 05 20:06:56.060878 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.060747    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"
Jul 05 20:06:56.060878 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.060782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" event={"ID":"f2554acd-c344-4ad4-9833-1bdd83c0e1dc","Type":"ContainerDied","Data":"95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409"}
Jul 05 20:06:56.060878 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.060856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq" event={"ID":"f2554acd-c344-4ad4-9833-1bdd83c0e1dc","Type":"ContainerDied","Data":"e6e9be449c759eae7460f2b26a1f8ffad3f28163db9a1684a3dec1107b2b65cd"}
Jul 05 20:06:56.061068 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.060889    2579 scope.go:117] "RemoveContainer" containerID="95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409"
Jul 05 20:06:56.069928 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.069916    2579 scope.go:117] "RemoveContainer" containerID="3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"
Jul 05 20:06:56.075872 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.075774    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc" podStartSLOduration=1.763886632 podStartE2EDuration="2.075760523s" totalImagesPullingTime="311.873891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:06:56.074876649 +0000 UTC m=+2060.897367332" watchObservedRunningTime="2026-07-05 20:06:56.075760523 +0000 UTC m=+2060.898251233"
Jul 05 20:06:56.078480 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.078462    2579 scope.go:117] "RemoveContainer" containerID="95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409"
Jul 05 20:06:56.078744 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:56.078726    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409\": container with ID starting with 95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409 not found: ID does not exist" containerID="95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409"
Jul 05 20:06:56.078791 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.078752    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409"} err="failed to get container status \"95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409\": rpc error: code = NotFound desc = could not find container \"95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409\": container with ID starting with 95823748269adeb545d9c47163d8d44347ec472ee0425cbf437d6cf697618409 not found: ID does not exist"
Jul 05 20:06:56.078791 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.078771    2579 scope.go:117] "RemoveContainer" containerID="3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"
Jul 05 20:06:56.079018 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:06:56.079001    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611\": container with ID starting with 3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611 not found: ID does not exist" containerID="3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"
Jul 05 20:06:56.079062 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.079024    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611"} err="failed to get container status \"3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611\": rpc error: code = NotFound desc = could not find container \"3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611\": container with ID starting with 3c3b8328468f587afe9ee0b391553eb8cb94c7200fc2d068c4679d815434d611 not found: ID does not exist"
Jul 05 20:06:56.089748 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.089726    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"]
Jul 05 20:06:56.094240 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:56.094221    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-29e15f-openshift-default-66d85d9685-xt7mq"]
Jul 05 20:06:57.617891 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:57.617860    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" path="/var/lib/kubelet/pods/f2554acd-c344-4ad4-9833-1bdd83c0e1dc/volumes"
Jul 05 20:06:59.393759 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:59.393728    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:06:59.742512 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:06:59.742467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:00.068673 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:00.068572    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:00.541598 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:00.541559    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:02.071990 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:02.071962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:07:02.938464 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:02.938434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:03.012262 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.012221    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"]
Jul 05 20:07:03.012618 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.012603    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy"
Jul 05 20:07:03.012688 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.012619    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy"
Jul 05 20:07:03.012688 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.012631    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy"
Jul 05 20:07:03.012688 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.012636    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy"
Jul 05 20:07:03.012858 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.012749    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy"
Jul 05 20:07:03.017258 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.017233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.021493 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.021473    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-65fb4d-serving-cert\""
Jul 05 20:07:03.034984 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.034959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"]
Jul 05 20:07:03.066396 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.066370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:03.067482 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.067464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.067578 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.067500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmzg8\" (UniqueName: \"kubernetes.io/projected/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-kube-api-access-nmzg8\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.067578 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.067534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.168815 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.168778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.169221 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.168831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmzg8\" (UniqueName: \"kubernetes.io/projected/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-kube-api-access-nmzg8\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.169221 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.168865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.169221 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:07:03.168937    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-65fb4d-serving-cert: secret "maas-api-e2e-shared-b-65fb4d-serving-cert" not found
Jul 05 20:07:03.169221 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:07:03.169001    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls podName:b2de9e77-b1c9-4496-9c3d-79d766ab96a7 nodeName:}" failed. No retries permitted until 2026-07-05 20:07:03.668981136 +0000 UTC m=+2068.491471800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls") pod "maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" (UID: "b2de9e77-b1c9-4496-9c3d-79d766ab96a7") : secret "maas-api-e2e-shared-b-65fb4d-serving-cert" not found
Jul 05 20:07:03.169649 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.169631    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.180424 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.180391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:03.180746 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.180722    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmzg8\" (UniqueName: \"kubernetes.io/projected/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-kube-api-access-nmzg8\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.386647 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.386615    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:03.515264 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.515234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:03.616559 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.616532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:03.673124 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.673048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.675684 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.675658    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls\") pod \"maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") " pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:03.927885 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:03.927791    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:04.066225 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:04.066199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"]
Jul 05 20:07:04.105643 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:04.105614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" event={"ID":"b2de9e77-b1c9-4496-9c3d-79d766ab96a7","Type":"ContainerStarted","Data":"0e61dca2072f951815fb4ff99b916140beb9bbedaddca2f6089eaf1ee01825bb"}
Jul 05 20:07:05.119436 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:05.119400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" event={"ID":"b2de9e77-b1c9-4496-9c3d-79d766ab96a7","Type":"ContainerStarted","Data":"1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf"}
Jul 05 20:07:05.119849 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:05.119558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:05.137612 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:05.137568    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" podStartSLOduration=2.820817802 podStartE2EDuration="3.137554386s" totalImagesPullingTime="316.736584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:07:05.135961268 +0000 UTC m=+2069.958451950" watchObservedRunningTime="2026-07-05 20:07:05.137554386 +0000 UTC m=+2069.960045067"
Jul 05 20:07:07.443261 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:07.443202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:11.129269 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:11.129240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:07:15.477168 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.477135    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"]
Jul 05 20:07:15.477636 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.477620    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2554acd-c344-4ad4-9833-1bdd83c0e1dc" containerName="istio-proxy"
Jul 05 20:07:15.480830 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.480792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.483640 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.483619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"kube-root-ca.crt\""
Jul 05 20:07:15.484967 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.484942    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"openshift-service-ca.crt\""
Jul 05 20:07:15.485086 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.485065    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"default-dockercfg-rkkhx\""
Jul 05 20:07:15.485150 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.485132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"auth-test-model-d9296f-kserve-self-signed-certs\""
Jul 05 20:07:15.491369 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.491345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"]
Jul 05 20:07:15.502193 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.502174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:15.573096 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.573071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4j9\" (UniqueName: \"kubernetes.io/projected/85929dc6-010f-40ed-9894-6874a0dc7e87-kube-api-access-tr4j9\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.573195 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.573104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-tmp-dir\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.573243 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.573205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-dshm\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.573280 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.573263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-home\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.573318 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.573308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85929dc6-010f-40ed-9894-6874a0dc7e87-tls-certs\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.573354 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.573329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-model-cache\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674387 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-home\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674387 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85929dc6-010f-40ed-9894-6874a0dc7e87-tls-certs\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674602 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-model-cache\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674602 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4j9\" (UniqueName: \"kubernetes.io/projected/85929dc6-010f-40ed-9894-6874a0dc7e87-kube-api-access-tr4j9\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674602 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-tmp-dir\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674602 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-dshm\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674870 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674793    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-home\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674935 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674865    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-model-cache\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.674935 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.674907    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-tmp-dir\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.676717 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.676697    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-dshm\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.676982 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.676967    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85929dc6-010f-40ed-9894-6874a0dc7e87-tls-certs\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.682440 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.682419    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4j9\" (UniqueName: \"kubernetes.io/projected/85929dc6-010f-40ed-9894-6874a0dc7e87-kube-api-access-tr4j9\") pod \"auth-test-model-d9296f-kserve-557cccc44c-qdb4l\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") " pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.791354 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.791331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:15.924493 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:15.924463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"]
Jul 05 20:07:15.925505 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:07:15.925476    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85929dc6_010f_40ed_9894_6874a0dc7e87.slice/crio-ab435da671faff2d1468764ae4b76827a897873adae8532dbbac929a6aacdfdc WatchSource:0}: Error finding container ab435da671faff2d1468764ae4b76827a897873adae8532dbbac929a6aacdfdc: Status 404 returned error can't find the container with id ab435da671faff2d1468764ae4b76827a897873adae8532dbbac929a6aacdfdc
Jul 05 20:07:16.178217 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:16.178125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l" event={"ID":"85929dc6-010f-40ed-9894-6874a0dc7e87","Type":"ContainerStarted","Data":"e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94"}
Jul 05 20:07:16.178217 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:16.178175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l" event={"ID":"85929dc6-010f-40ed-9894-6874a0dc7e87","Type":"ContainerStarted","Data":"ab435da671faff2d1468764ae4b76827a897873adae8532dbbac929a6aacdfdc"}
Jul 05 20:07:16.194842 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:16.194779    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l" podStartSLOduration=1.19476464 podStartE2EDuration="1.19476464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:07:16.193523154 +0000 UTC m=+2081.016013836" watchObservedRunningTime="2026-07-05 20:07:16.19476464 +0000 UTC m=+2081.017255341"
Jul 05 20:07:16.212660 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:16.212629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:16.313508 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:16.313480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:24.190517 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:24.190486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:24.291636 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:24.291602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:25.792008 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:25.791978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:25.792371 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:25.792024    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:25.804193 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:25.804168    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:26.240191 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:26.240166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:07:30.220131 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:30.220092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:30.274835 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:30.274790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:51.789828 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.789779    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"]
Jul 05 20:07:51.793327 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.793311    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.796385 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.796361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"kube-root-ca.crt\""
Jul 05 20:07:51.797579 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.797554    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"default-dockercfg-fzptz\""
Jul 05 20:07:51.797684 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.797594    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"openshift-service-ca.crt\""
Jul 05 20:07:51.797684 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.797611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"auth-test-model-65fb4d-kserve-self-signed-certs\""
Jul 05 20:07:51.801611 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.801590    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"]
Jul 05 20:07:51.871005 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.870980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-model-cache\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.871145 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.871010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-tmp-dir\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.871145 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.871036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-home\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.871249 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.871142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-dshm\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.871249 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.871168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpq5k\" (UniqueName: \"kubernetes.io/projected/7176f57c-9916-41a9-a871-4d86a885ac7e-kube-api-access-cpq5k\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.871249 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.871243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7176f57c-9916-41a9-a871-4d86a885ac7e-tls-certs\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.877233 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.877207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:07:51.972292 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-dshm\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972292 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpq5k\" (UniqueName: \"kubernetes.io/projected/7176f57c-9916-41a9-a871-4d86a885ac7e-kube-api-access-cpq5k\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972458 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7176f57c-9916-41a9-a871-4d86a885ac7e-tls-certs\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972458 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-model-cache\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972458 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-tmp-dir\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972458 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-home\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972773 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972752    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-model-cache\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972793    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-home\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.972866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.972845    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-tmp-dir\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.974459 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.974440    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-dshm\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.974707 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.974681    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7176f57c-9916-41a9-a871-4d86a885ac7e-tls-certs\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:51.980430 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:51.980406    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpq5k\" (UniqueName: \"kubernetes.io/projected/7176f57c-9916-41a9-a871-4d86a885ac7e-kube-api-access-cpq5k\") pod \"auth-test-model-65fb4d-kserve-5999c7db75-v9tfw\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") " pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:52.103416 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:52.103347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:07:52.231486 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:52.231461    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"]
Jul 05 20:07:52.232970 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:07:52.232945    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7176f57c_9916_41a9_a871_4d86a885ac7e.slice/crio-93e37341840196fe0ef1fc6624883a2c6441a564b81a0a0d503ac518664fae6d WatchSource:0}: Error finding container 93e37341840196fe0ef1fc6624883a2c6441a564b81a0a0d503ac518664fae6d: Status 404 returned error can't find the container with id 93e37341840196fe0ef1fc6624883a2c6441a564b81a0a0d503ac518664fae6d
Jul 05 20:07:52.366708 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:52.366619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw" event={"ID":"7176f57c-9916-41a9-a871-4d86a885ac7e","Type":"ContainerStarted","Data":"1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365"}
Jul 05 20:07:52.366708 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:52.366668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw" event={"ID":"7176f57c-9916-41a9-a871-4d86a885ac7e","Type":"ContainerStarted","Data":"93e37341840196fe0ef1fc6624883a2c6441a564b81a0a0d503ac518664fae6d"}
Jul 05 20:07:52.382697 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:07:52.382642    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw" podStartSLOduration=1.382628678 podStartE2EDuration="1.382628678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:07:52.382340003 +0000 UTC m=+2117.204830687" watchObservedRunningTime="2026-07-05 20:07:52.382628678 +0000 UTC m=+2117.205119359"
Jul 05 20:08:02.104407 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:08:02.104372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:08:02.104901 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:08:02.104443    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:08:02.116720 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:08:02.116698    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:08:02.429079 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:08:02.428987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:08:35.611277 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:08:35.611209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:08:36.778083 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:08:36.778049    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:09:38.416070 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:38.416034    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"]
Jul 05 20:09:38.441348 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:38.441318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:09:39.294149 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:39.294116    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"]
Jul 05 20:09:39.314220 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:39.314192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:09:53.009713 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.009677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:09:53.435837 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.435732    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l" podUID="85929dc6-010f-40ed-9894-6874a0dc7e87" containerName="main" containerID="cri-o://e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94" gracePeriod=45
Jul 05 20:09:53.686447 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.686381    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:09:53.817935 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.817897    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr4j9\" (UniqueName: \"kubernetes.io/projected/85929dc6-010f-40ed-9894-6874a0dc7e87-kube-api-access-tr4j9\") pod \"85929dc6-010f-40ed-9894-6874a0dc7e87\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") "
Jul 05 20:09:53.817935 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.817940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-tmp-dir\") pod \"85929dc6-010f-40ed-9894-6874a0dc7e87\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") "
Jul 05 20:09:53.818174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.817980    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85929dc6-010f-40ed-9894-6874a0dc7e87-tls-certs\") pod \"85929dc6-010f-40ed-9894-6874a0dc7e87\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") "
Jul 05 20:09:53.818174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.818005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-model-cache\") pod \"85929dc6-010f-40ed-9894-6874a0dc7e87\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") "
Jul 05 20:09:53.818174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.818024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-home\") pod \"85929dc6-010f-40ed-9894-6874a0dc7e87\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") "
Jul 05 20:09:53.818174 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.818046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-dshm\") pod \"85929dc6-010f-40ed-9894-6874a0dc7e87\" (UID: \"85929dc6-010f-40ed-9894-6874a0dc7e87\") "
Jul 05 20:09:53.818381 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.818306    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-model-cache" (OuterVolumeSpecName: "model-cache") pod "85929dc6-010f-40ed-9894-6874a0dc7e87" (UID: "85929dc6-010f-40ed-9894-6874a0dc7e87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:53.818381 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.818312    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-home" (OuterVolumeSpecName: "home") pod "85929dc6-010f-40ed-9894-6874a0dc7e87" (UID: "85929dc6-010f-40ed-9894-6874a0dc7e87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:53.818381 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.818334    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85929dc6-010f-40ed-9894-6874a0dc7e87" (UID: "85929dc6-010f-40ed-9894-6874a0dc7e87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:53.820162 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.820138    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-dshm" (OuterVolumeSpecName: "dshm") pod "85929dc6-010f-40ed-9894-6874a0dc7e87" (UID: "85929dc6-010f-40ed-9894-6874a0dc7e87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:53.820269 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.820193    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85929dc6-010f-40ed-9894-6874a0dc7e87-kube-api-access-tr4j9" (OuterVolumeSpecName: "kube-api-access-tr4j9") pod "85929dc6-010f-40ed-9894-6874a0dc7e87" (UID: "85929dc6-010f-40ed-9894-6874a0dc7e87"). InnerVolumeSpecName "kube-api-access-tr4j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:09:53.820269 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.820211    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85929dc6-010f-40ed-9894-6874a0dc7e87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85929dc6-010f-40ed-9894-6874a0dc7e87" (UID: "85929dc6-010f-40ed-9894-6874a0dc7e87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:09:53.919714 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.919687    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr4j9\" (UniqueName: \"kubernetes.io/projected/85929dc6-010f-40ed-9894-6874a0dc7e87-kube-api-access-tr4j9\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:53.919866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.919729    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-tmp-dir\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:53.919866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.919739    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85929dc6-010f-40ed-9894-6874a0dc7e87-tls-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:53.919866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.919749    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-model-cache\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:53.919866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.919757    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-home\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:53.919866 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:53.919764    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85929dc6-010f-40ed-9894-6874a0dc7e87-dshm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:54.017637 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.017606    2579 generic.go:356] "Generic (PLEG): container finished" podID="85929dc6-010f-40ed-9894-6874a0dc7e87" containerID="e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94" exitCode=0
Jul 05 20:09:54.018129 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.017645    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"
Jul 05 20:09:54.018129 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.017665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l" event={"ID":"85929dc6-010f-40ed-9894-6874a0dc7e87","Type":"ContainerDied","Data":"e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94"}
Jul 05 20:09:54.018129 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.017704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l" event={"ID":"85929dc6-010f-40ed-9894-6874a0dc7e87","Type":"ContainerDied","Data":"ab435da671faff2d1468764ae4b76827a897873adae8532dbbac929a6aacdfdc"}
Jul 05 20:09:54.018129 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.017730    2579 scope.go:117] "RemoveContainer" containerID="e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94"
Jul 05 20:09:54.030242 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.030226    2579 scope.go:117] "RemoveContainer" containerID="e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94"
Jul 05 20:09:54.030508 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:09:54.030490    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94\": container with ID starting with e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94 not found: ID does not exist" containerID="e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94"
Jul 05 20:09:54.030556 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.030518    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94"} err="failed to get container status \"e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94\": rpc error: code = NotFound desc = could not find container \"e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94\": container with ID starting with e059fc3ef058424bc77ba0dd3717aef0b3c911055e2786f0cc1c495401327a94 not found: ID does not exist"
Jul 05 20:09:54.039647 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.039626    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"]
Jul 05 20:09:54.043100 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.043081    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/auth-test-model-d9296f-kserve-557cccc44c-qdb4l"]
Jul 05 20:09:54.314526 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.314444    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw" podUID="7176f57c-9916-41a9-a871-4d86a885ac7e" containerName="main" containerID="cri-o://1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365" gracePeriod=45
Jul 05 20:09:54.567679 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.567622    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:09:54.726185 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726156    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpq5k\" (UniqueName: \"kubernetes.io/projected/7176f57c-9916-41a9-a871-4d86a885ac7e-kube-api-access-cpq5k\") pod \"7176f57c-9916-41a9-a871-4d86a885ac7e\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") "
Jul 05 20:09:54.726348 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-tmp-dir\") pod \"7176f57c-9916-41a9-a871-4d86a885ac7e\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") "
Jul 05 20:09:54.726348 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-dshm\") pod \"7176f57c-9916-41a9-a871-4d86a885ac7e\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") "
Jul 05 20:09:54.726348 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7176f57c-9916-41a9-a871-4d86a885ac7e-tls-certs\") pod \"7176f57c-9916-41a9-a871-4d86a885ac7e\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") "
Jul 05 20:09:54.726348 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726320    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-model-cache\") pod \"7176f57c-9916-41a9-a871-4d86a885ac7e\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") "
Jul 05 20:09:54.726563 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726352    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-home\") pod \"7176f57c-9916-41a9-a871-4d86a885ac7e\" (UID: \"7176f57c-9916-41a9-a871-4d86a885ac7e\") "
Jul 05 20:09:54.726563 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726525    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7176f57c-9916-41a9-a871-4d86a885ac7e" (UID: "7176f57c-9916-41a9-a871-4d86a885ac7e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:54.726675 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726563    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-model-cache" (OuterVolumeSpecName: "model-cache") pod "7176f57c-9916-41a9-a871-4d86a885ac7e" (UID: "7176f57c-9916-41a9-a871-4d86a885ac7e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:54.726675 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726663    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-home" (OuterVolumeSpecName: "home") pod "7176f57c-9916-41a9-a871-4d86a885ac7e" (UID: "7176f57c-9916-41a9-a871-4d86a885ac7e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:54.726774 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726697    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-tmp-dir\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:54.726774 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.726717    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-model-cache\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:54.728430 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.728413    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-dshm" (OuterVolumeSpecName: "dshm") pod "7176f57c-9916-41a9-a871-4d86a885ac7e" (UID: "7176f57c-9916-41a9-a871-4d86a885ac7e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:09:54.728510 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.728473    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7176f57c-9916-41a9-a871-4d86a885ac7e-kube-api-access-cpq5k" (OuterVolumeSpecName: "kube-api-access-cpq5k") pod "7176f57c-9916-41a9-a871-4d86a885ac7e" (UID: "7176f57c-9916-41a9-a871-4d86a885ac7e"). InnerVolumeSpecName "kube-api-access-cpq5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:09:54.728569 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.728531    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7176f57c-9916-41a9-a871-4d86a885ac7e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7176f57c-9916-41a9-a871-4d86a885ac7e" (UID: "7176f57c-9916-41a9-a871-4d86a885ac7e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:09:54.827299 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.827245    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-dshm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:54.827299 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.827264    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7176f57c-9916-41a9-a871-4d86a885ac7e-tls-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:54.827299 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.827274    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7176f57c-9916-41a9-a871-4d86a885ac7e-home\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:54.827299 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:54.827282    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpq5k\" (UniqueName: \"kubernetes.io/projected/7176f57c-9916-41a9-a871-4d86a885ac7e-kube-api-access-cpq5k\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:09:55.024251 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.024219    2579 generic.go:356] "Generic (PLEG): container finished" podID="7176f57c-9916-41a9-a871-4d86a885ac7e" containerID="1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365" exitCode=0
Jul 05 20:09:55.024609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.024266    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"
Jul 05 20:09:55.024609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.024301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw" event={"ID":"7176f57c-9916-41a9-a871-4d86a885ac7e","Type":"ContainerDied","Data":"1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365"}
Jul 05 20:09:55.024609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.024345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw" event={"ID":"7176f57c-9916-41a9-a871-4d86a885ac7e","Type":"ContainerDied","Data":"93e37341840196fe0ef1fc6624883a2c6441a564b81a0a0d503ac518664fae6d"}
Jul 05 20:09:55.024609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.024364    2579 scope.go:117] "RemoveContainer" containerID="1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365"
Jul 05 20:09:55.032862 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.032846    2579 scope.go:117] "RemoveContainer" containerID="1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365"
Jul 05 20:09:55.033115 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:09:55.033095    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365\": container with ID starting with 1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365 not found: ID does not exist" containerID="1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365"
Jul 05 20:09:55.033200 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.033123    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365"} err="failed to get container status \"1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365\": rpc error: code = NotFound desc = could not find container \"1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365\": container with ID starting with 1ca269fb4abd704d80a52bf4c65271938b8359cc83bd0cfad31da4b6b07e4365 not found: ID does not exist"
Jul 05 20:09:55.045856 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.045835    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"]
Jul 05 20:09:55.048067 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.048050    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/auth-test-model-65fb4d-kserve-5999c7db75-v9tfw"]
Jul 05 20:09:55.618172 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.618140    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7176f57c-9916-41a9-a871-4d86a885ac7e" path="/var/lib/kubelet/pods/7176f57c-9916-41a9-a871-4d86a885ac7e/volumes"
Jul 05 20:09:55.618534 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:09:55.618521    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85929dc6-010f-40ed-9894-6874a0dc7e87" path="/var/lib/kubelet/pods/85929dc6-010f-40ed-9894-6874a0dc7e87/volumes"
Jul 05 20:10:28.898068 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898034    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"]
Jul 05 20:10:28.898516 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898409    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7176f57c-9916-41a9-a871-4d86a885ac7e" containerName="main"
Jul 05 20:10:28.898516 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898420    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7176f57c-9916-41a9-a871-4d86a885ac7e" containerName="main"
Jul 05 20:10:28.898516 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898437    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85929dc6-010f-40ed-9894-6874a0dc7e87" containerName="main"
Jul 05 20:10:28.898516 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898443    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85929dc6-010f-40ed-9894-6874a0dc7e87" containerName="main"
Jul 05 20:10:28.898516 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898497    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85929dc6-010f-40ed-9894-6874a0dc7e87" containerName="main"
Jul 05 20:10:28.898516 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.898505    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7176f57c-9916-41a9-a871-4d86a885ac7e" containerName="main"
Jul 05 20:10:28.901541 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.901526    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:28.905887 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.905866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"default-dockercfg-fzptz\""
Jul 05 20:10:28.905887 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.905875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"sub-test-model-65fb4d-kserve-self-signed-certs\""
Jul 05 20:10:28.906088 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.905894    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"openshift-service-ca.crt\""
Jul 05 20:10:28.906088 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.905927    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"kube-root-ca.crt\""
Jul 05 20:10:28.911620 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.911600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"]
Jul 05 20:10:28.930987 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:28.930958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:10:29.004260 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.004234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-home\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.004371 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.004262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-dshm\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.004371 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.004355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tmp-dir\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.004449 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.004403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tls-certs\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.004449 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.004425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7njt\" (UniqueName: \"kubernetes.io/projected/476301d0-edf5-4ecd-ba59-3bff656c1e0e-kube-api-access-d7njt\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.004514 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.004464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-model-cache\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105045 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-home\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105045 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-dshm\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105239 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tmp-dir\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105239 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tls-certs\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105239 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7njt\" (UniqueName: \"kubernetes.io/projected/476301d0-edf5-4ecd-ba59-3bff656c1e0e-kube-api-access-d7njt\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105403 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-model-cache\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105481 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105459    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-home\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105542 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105524    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tmp-dir\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.105639 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.105614    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-model-cache\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.107255 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.107229    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-dshm\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.107585 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.107566    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tls-certs\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.112876 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.112854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7njt\" (UniqueName: \"kubernetes.io/projected/476301d0-edf5-4ecd-ba59-3bff656c1e0e-kube-api-access-d7njt\") pod \"sub-test-model-65fb4d-kserve-64f6897685-wjxtn\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") " pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.211638 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.211563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:29.345651 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:29.343786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"]
Jul 05 20:10:29.346206 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:10:29.346177    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod476301d0_edf5_4ecd_ba59_3bff656c1e0e.slice/crio-ab3f5b249421dcfaf867db5ded1bb5a3e7d1db13ca21a5331f474ab3ac4b0b27 WatchSource:0}: Error finding container ab3f5b249421dcfaf867db5ded1bb5a3e7d1db13ca21a5331f474ab3ac4b0b27: Status 404 returned error can't find the container with id ab3f5b249421dcfaf867db5ded1bb5a3e7d1db13ca21a5331f474ab3ac4b0b27
Jul 05 20:10:30.203752 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:30.203721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" event={"ID":"476301d0-edf5-4ecd-ba59-3bff656c1e0e","Type":"ContainerStarted","Data":"c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47"}
Jul 05 20:10:30.204120 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:30.203759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" event={"ID":"476301d0-edf5-4ecd-ba59-3bff656c1e0e","Type":"ContainerStarted","Data":"ab3f5b249421dcfaf867db5ded1bb5a3e7d1db13ca21a5331f474ab3ac4b0b27"}
Jul 05 20:10:30.223566 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:30.223514    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" podStartSLOduration=2.223499453 podStartE2EDuration="2.223499453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:10:30.221373586 +0000 UTC m=+2275.043864268" watchObservedRunningTime="2026-07-05 20:10:30.223499453 +0000 UTC m=+2275.045990134"
Jul 05 20:10:39.212610 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:39.212572    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:39.213018 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:39.212630    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:39.226453 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:39.226429    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:10:39.263057 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:10:39.263028    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:11:03.023873 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:03.023825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:04.070745 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:04.070712    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"]
Jul 05 20:11:04.088422 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:04.088397    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:12.196720 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.196688    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"]
Jul 05 20:11:12.200094 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.200079    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.204746 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.204725    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"kube-root-ca.crt\""
Jul 05 20:11:12.206177 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.206154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"default-dockercfg-rkkhx\""
Jul 05 20:11:12.206177 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.206175    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"openshift-service-ca.crt\""
Jul 05 20:11:12.206690 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.206455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"rate-test-model-d9296f-kserve-self-signed-certs\""
Jul 05 20:11:12.226110 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.226090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"]
Jul 05 20:11:12.267349 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.267323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-home\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.267470 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.267358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tls-certs\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.267470 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.267387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tmp-dir\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.267593 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.267502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-model-cache\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.267681 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.267600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7mzt\" (UniqueName: \"kubernetes.io/projected/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-kube-api-access-x7mzt\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.267681 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.267631    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-dshm\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.268442 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.268419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:12.368435 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7mzt\" (UniqueName: \"kubernetes.io/projected/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-kube-api-access-x7mzt\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368435 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-dshm\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368589 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-home\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368589 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tls-certs\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368672 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tmp-dir\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368672 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-model-cache\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368913 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368895    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-home\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.368981 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368941    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tmp-dir\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.369023 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.368977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-model-cache\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.370647 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.370627    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-dshm\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.370958 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.370941    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tls-certs\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.378182 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.378159    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7mzt\" (UniqueName: \"kubernetes.io/projected/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-kube-api-access-x7mzt\") pod \"rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") " pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.509185 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.509152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:12.640157 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:12.640130    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"]
Jul 05 20:11:12.641935 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:11:12.641906    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf550e8dc_ffdf_409e_94b0_55d46bfdb9ac.slice/crio-28c27886e1a066c2a19c50ef0087f2b756eead6d0174f19a2e9b1c510a3e1a5c WatchSource:0}: Error finding container 28c27886e1a066c2a19c50ef0087f2b756eead6d0174f19a2e9b1c510a3e1a5c: Status 404 returned error can't find the container with id 28c27886e1a066c2a19c50ef0087f2b756eead6d0174f19a2e9b1c510a3e1a5c
Jul 05 20:11:13.439593 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:13.439557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8" event={"ID":"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac","Type":"ContainerStarted","Data":"b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec"}
Jul 05 20:11:13.439991 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:13.439600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8" event={"ID":"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac","Type":"ContainerStarted","Data":"28c27886e1a066c2a19c50ef0087f2b756eead6d0174f19a2e9b1c510a3e1a5c"}
Jul 05 20:11:13.457816 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:13.457751    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8" podStartSLOduration=1.4577360320000001 podStartE2EDuration="1.457736032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:11:13.456625331 +0000 UTC m=+2318.279116014" watchObservedRunningTime="2026-07-05 20:11:13.457736032 +0000 UTC m=+2318.280226714"
Jul 05 20:11:19.091257 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.091216    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" podUID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" containerName="main" containerID="cri-o://c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47" gracePeriod=45
Jul 05 20:11:19.253420 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.253385    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" podUID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": dial tcp 10.134.0.68:8000: connect: connection refused"
Jul 05 20:11:19.341148 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.341122    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:11:19.426522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426450    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tls-certs\") pod \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") "
Jul 05 20:11:19.426522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426497    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-model-cache\") pod \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") "
Jul 05 20:11:19.426522 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426525    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-home\") pod \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") "
Jul 05 20:11:19.426744 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426550    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-dshm\") pod \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") "
Jul 05 20:11:19.426744 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7njt\" (UniqueName: \"kubernetes.io/projected/476301d0-edf5-4ecd-ba59-3bff656c1e0e-kube-api-access-d7njt\") pod \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") "
Jul 05 20:11:19.426744 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426588    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tmp-dir\") pod \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\" (UID: \"476301d0-edf5-4ecd-ba59-3bff656c1e0e\") "
Jul 05 20:11:19.426933 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426848    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-home" (OuterVolumeSpecName: "home") pod "476301d0-edf5-4ecd-ba59-3bff656c1e0e" (UID: "476301d0-edf5-4ecd-ba59-3bff656c1e0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:19.426993 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426949    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "476301d0-edf5-4ecd-ba59-3bff656c1e0e" (UID: "476301d0-edf5-4ecd-ba59-3bff656c1e0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:19.427053 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.426998    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "476301d0-edf5-4ecd-ba59-3bff656c1e0e" (UID: "476301d0-edf5-4ecd-ba59-3bff656c1e0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:19.427053 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.427045    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-model-cache\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:11:19.427133 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.427064    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-home\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:11:19.428666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.428637    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "476301d0-edf5-4ecd-ba59-3bff656c1e0e" (UID: "476301d0-edf5-4ecd-ba59-3bff656c1e0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:11:19.428666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.428639    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-dshm" (OuterVolumeSpecName: "dshm") pod "476301d0-edf5-4ecd-ba59-3bff656c1e0e" (UID: "476301d0-edf5-4ecd-ba59-3bff656c1e0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:19.428666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.428634    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/476301d0-edf5-4ecd-ba59-3bff656c1e0e-kube-api-access-d7njt" (OuterVolumeSpecName: "kube-api-access-d7njt") pod "476301d0-edf5-4ecd-ba59-3bff656c1e0e" (UID: "476301d0-edf5-4ecd-ba59-3bff656c1e0e"). InnerVolumeSpecName "kube-api-access-d7njt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:11:19.471874 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.471846    2579 generic.go:356] "Generic (PLEG): container finished" podID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" containerID="c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47" exitCode=0
Jul 05 20:11:19.471989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.471888    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"
Jul 05 20:11:19.471989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.471934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" event={"ID":"476301d0-edf5-4ecd-ba59-3bff656c1e0e","Type":"ContainerDied","Data":"c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47"}
Jul 05 20:11:19.471989 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.471971    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn" event={"ID":"476301d0-edf5-4ecd-ba59-3bff656c1e0e","Type":"ContainerDied","Data":"ab3f5b249421dcfaf867db5ded1bb5a3e7d1db13ca21a5331f474ab3ac4b0b27"}
Jul 05 20:11:19.472095 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.471993    2579 scope.go:117] "RemoveContainer" containerID="c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47"
Jul 05 20:11:19.480930 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.480837    2579 scope.go:117] "RemoveContainer" containerID="c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47"
Jul 05 20:11:19.481098 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:11:19.481081    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47\": container with ID starting with c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47 not found: ID does not exist" containerID="c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47"
Jul 05 20:11:19.481156 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.481107    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47"} err="failed to get container status \"c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47\": rpc error: code = NotFound desc = could not find container \"c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47\": container with ID starting with c680bf918e3bc6a021ecc6351129a6d2bad036397d5d2f91de2cd6d0993dfe47 not found: ID does not exist"
Jul 05 20:11:19.493207 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.493187    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"]
Jul 05 20:11:19.496730 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.496710    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/sub-test-model-65fb4d-kserve-64f6897685-wjxtn"]
Jul 05 20:11:19.528154 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.528135    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tls-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:11:19.528154 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.528152    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-dshm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:11:19.528263 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.528161    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7njt\" (UniqueName: \"kubernetes.io/projected/476301d0-edf5-4ecd-ba59-3bff656c1e0e-kube-api-access-d7njt\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:11:19.528263 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.528170    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476301d0-edf5-4ecd-ba59-3bff656c1e0e-tmp-dir\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:11:19.617552 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:19.617529    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" path="/var/lib/kubelet/pods/476301d0-edf5-4ecd-ba59-3bff656c1e0e/volumes"
Jul 05 20:11:22.229324 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:22.229292    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:22.510244 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:22.510214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:22.510416 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:22.510262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:22.522865 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:22.522841    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:23.505182 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:23.505152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:11:29.787771 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:29.787692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:29.891433 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:29.891394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:48.589023 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.588989    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"]
Jul 05 20:11:48.589418 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.589382    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" containerName="main"
Jul 05 20:11:48.589418 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.589393    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" containerName="main"
Jul 05 20:11:48.589490 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.589451    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="476301d0-edf5-4ecd-ba59-3bff656c1e0e" containerName="main"
Jul 05 20:11:48.592404 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.592386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.595439 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.595417    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"kube-root-ca.crt\""
Jul 05 20:11:48.595562 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.595444    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"openshift-service-ca.crt\""
Jul 05 20:11:48.597113 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.597094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"rate-test-model-65fb4d-kserve-self-signed-certs\""
Jul 05 20:11:48.597192 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.597100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-65fb4d\"/\"default-dockercfg-fzptz\""
Jul 05 20:11:48.603343 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.603320    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"]
Jul 05 20:11:48.616132 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.616099    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:11:48.668410 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.668351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-home\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.668517 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.668414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlp2x\" (UniqueName: \"kubernetes.io/projected/1f12b31a-1f3a-4410-b990-5c50f56b36f3-kube-api-access-dlp2x\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.668517 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.668513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tmp-dir\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.668652 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.668537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tls-certs\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.668652 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.668580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-model-cache\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.668788 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.668746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-dshm\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.769928 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.769896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tls-certs\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770100 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.769938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-model-cache\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770100 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-dshm\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770223 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-home\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770223 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlp2x\" (UniqueName: \"kubernetes.io/projected/1f12b31a-1f3a-4410-b990-5c50f56b36f3-kube-api-access-dlp2x\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770331 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tmp-dir\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770395 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770336    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-model-cache\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770544 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770523    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-home\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.770625 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.770594    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tmp-dir\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.772241 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.772218    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-dshm\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.772634 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.772614    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tls-certs\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.778335 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.778315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlp2x\" (UniqueName: \"kubernetes.io/projected/1f12b31a-1f3a-4410-b990-5c50f56b36f3-kube-api-access-dlp2x\") pod \"rate-test-model-65fb4d-kserve-664f58cd7-flmdq\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") " pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:48.902598 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:48.902572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:49.038135 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:49.038107    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"]
Jul 05 20:11:49.039883 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:11:49.039857    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f12b31a_1f3a_4410_b990_5c50f56b36f3.slice/crio-aa87a1a9066b4ef014aa33362745ca08552319fec3e9f8c1859000e653cd893a WatchSource:0}: Error finding container aa87a1a9066b4ef014aa33362745ca08552319fec3e9f8c1859000e653cd893a: Status 404 returned error can't find the container with id aa87a1a9066b4ef014aa33362745ca08552319fec3e9f8c1859000e653cd893a
Jul 05 20:11:49.629478 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:49.629440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq" event={"ID":"1f12b31a-1f3a-4410-b990-5c50f56b36f3","Type":"ContainerStarted","Data":"60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d"}
Jul 05 20:11:49.629478 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:49.629478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq" event={"ID":"1f12b31a-1f3a-4410-b990-5c50f56b36f3","Type":"ContainerStarted","Data":"aa87a1a9066b4ef014aa33362745ca08552319fec3e9f8c1859000e653cd893a"}
Jul 05 20:11:49.647730 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:49.647685    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq" podStartSLOduration=1.647670754 podStartE2EDuration="1.647670754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:11:49.645388954 +0000 UTC m=+2354.467879638" watchObservedRunningTime="2026-07-05 20:11:49.647670754 +0000 UTC m=+2354.470161436"
Jul 05 20:11:58.903033 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:58.903003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:58.903524 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:58.903294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:58.915691 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:58.915664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:11:59.689424 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:11:59.689398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:12:16.976944 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:16.976895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:17.077957 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:17.077911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:24.954646 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:24.954600    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:25.055366 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:25.055333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:30.311749 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:30.311709    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"]
Jul 05 20:12:30.332685 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:30.332657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:31.193678 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:31.193647    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"]
Jul 05 20:12:31.210782 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:31.210757    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:32.320931 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:32.320893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:32.727260 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:32.727180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:32.827531 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:32.827498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:32.930978 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:32.930947    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"]
Jul 05 20:12:32.931224 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:32.931195    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc" podUID="0505c284-245f-4d6d-b337-f42d7ddfc32d" containerName="maas-api" containerID="cri-o://f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7" gracePeriod=30
Jul 05 20:12:32.959219 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:32.959195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:33.364825 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.364786    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:12:33.466039 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.465962    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0505c284-245f-4d6d-b337-f42d7ddfc32d-openshift-service-ca\") pod \"0505c284-245f-4d6d-b337-f42d7ddfc32d\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") "
Jul 05 20:12:33.466039 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.466024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0505c284-245f-4d6d-b337-f42d7ddfc32d-maas-api-tls\") pod \"0505c284-245f-4d6d-b337-f42d7ddfc32d\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") "
Jul 05 20:12:33.466258 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.466085    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft22w\" (UniqueName: \"kubernetes.io/projected/0505c284-245f-4d6d-b337-f42d7ddfc32d-kube-api-access-ft22w\") pod \"0505c284-245f-4d6d-b337-f42d7ddfc32d\" (UID: \"0505c284-245f-4d6d-b337-f42d7ddfc32d\") "
Jul 05 20:12:33.466382 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.466360    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0505c284-245f-4d6d-b337-f42d7ddfc32d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0505c284-245f-4d6d-b337-f42d7ddfc32d" (UID: "0505c284-245f-4d6d-b337-f42d7ddfc32d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:12:33.468084 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.468067    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0505c284-245f-4d6d-b337-f42d7ddfc32d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0505c284-245f-4d6d-b337-f42d7ddfc32d" (UID: "0505c284-245f-4d6d-b337-f42d7ddfc32d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:12:33.468171 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.468152    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0505c284-245f-4d6d-b337-f42d7ddfc32d-kube-api-access-ft22w" (OuterVolumeSpecName: "kube-api-access-ft22w") pod "0505c284-245f-4d6d-b337-f42d7ddfc32d" (UID: "0505c284-245f-4d6d-b337-f42d7ddfc32d"). InnerVolumeSpecName "kube-api-access-ft22w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:12:33.567200 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.567173    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft22w\" (UniqueName: \"kubernetes.io/projected/0505c284-245f-4d6d-b337-f42d7ddfc32d-kube-api-access-ft22w\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:33.567200 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.567196    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0505c284-245f-4d6d-b337-f42d7ddfc32d-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:33.567335 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.567212    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0505c284-245f-4d6d-b337-f42d7ddfc32d-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:33.858218 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.858188    2579 generic.go:356] "Generic (PLEG): container finished" podID="0505c284-245f-4d6d-b337-f42d7ddfc32d" containerID="f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7" exitCode=0
Jul 05 20:12:33.858352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.858228    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"
Jul 05 20:12:33.858352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.858245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc" event={"ID":"0505c284-245f-4d6d-b337-f42d7ddfc32d","Type":"ContainerDied","Data":"f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7"}
Jul 05 20:12:33.858352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.858291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc" event={"ID":"0505c284-245f-4d6d-b337-f42d7ddfc32d","Type":"ContainerDied","Data":"f8c615e2230220453b7af42d9e6b340bed360a9b828c4aa4f040cc2348c2cf63"}
Jul 05 20:12:33.858352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.858317    2579 scope.go:117] "RemoveContainer" containerID="f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7"
Jul 05 20:12:33.867176 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.867149    2579 scope.go:117] "RemoveContainer" containerID="f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7"
Jul 05 20:12:33.867417 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:12:33.867398    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7\": container with ID starting with f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7 not found: ID does not exist" containerID="f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7"
Jul 05 20:12:33.867483 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.867432    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7"} err="failed to get container status \"f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7\": rpc error: code = NotFound desc = could not find container \"f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7\": container with ID starting with f295966677694ef83c7064c28ac30140ddf53901af0571860790bb017eef98d7 not found: ID does not exist"
Jul 05 20:12:33.881367 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.881334    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"]
Jul 05 20:12:33.881493 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:33.881382    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-d9296f-856649b4dd-95nwc"]
Jul 05 20:12:35.619645 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:35.619612    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0505c284-245f-4d6d-b337-f42d7ddfc32d" path="/var/lib/kubelet/pods/0505c284-245f-4d6d-b337-f42d7ddfc32d/volumes"
Jul 05 20:12:37.807609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:37.807580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:12:45.332238 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.332194    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8" podUID="f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" containerName="main" containerID="cri-o://b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec" gracePeriod=45
Jul 05 20:12:45.581701 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.581677    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:12:45.670601 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-home\") pod \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") "
Jul 05 20:12:45.670601 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-dshm\") pod \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") "
Jul 05 20:12:45.670601 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670599    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tmp-dir\") pod \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") "
Jul 05 20:12:45.670886 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7mzt\" (UniqueName: \"kubernetes.io/projected/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-kube-api-access-x7mzt\") pod \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") "
Jul 05 20:12:45.670886 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tls-certs\") pod \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") "
Jul 05 20:12:45.670886 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-model-cache\") pod \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\" (UID: \"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac\") "
Jul 05 20:12:45.670886 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670862    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-home" (OuterVolumeSpecName: "home") pod "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" (UID: "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:45.671078 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.670878    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" (UID: "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:45.671078 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.671054    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" (UID: "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:45.671208 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.671187    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-model-cache\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:45.671274 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.671214    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-home\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:45.671274 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.671227    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tmp-dir\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:45.672852 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.672826    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-kube-api-access-x7mzt" (OuterVolumeSpecName: "kube-api-access-x7mzt") pod "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" (UID: "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac"). InnerVolumeSpecName "kube-api-access-x7mzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:12:45.672852 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.672832    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" (UID: "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:12:45.673010 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.672993    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-dshm" (OuterVolumeSpecName: "dshm") pod "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" (UID: "f550e8dc-ffdf-409e-94b0-55d46bfdb9ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:45.771612 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.771590    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-dshm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:45.771612 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.771611    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7mzt\" (UniqueName: \"kubernetes.io/projected/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-kube-api-access-x7mzt\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:45.771750 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.771622    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac-tls-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:45.925236 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.925155    2579 generic.go:356] "Generic (PLEG): container finished" podID="f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" containerID="b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec" exitCode=0
Jul 05 20:12:45.925236 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.925204    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"
Jul 05 20:12:45.925414 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.925252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8" event={"ID":"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac","Type":"ContainerDied","Data":"b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec"}
Jul 05 20:12:45.925414 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.925297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8" event={"ID":"f550e8dc-ffdf-409e-94b0-55d46bfdb9ac","Type":"ContainerDied","Data":"28c27886e1a066c2a19c50ef0087f2b756eead6d0174f19a2e9b1c510a3e1a5c"}
Jul 05 20:12:45.925414 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.925316    2579 scope.go:117] "RemoveContainer" containerID="b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec"
Jul 05 20:12:45.934320 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.934301    2579 scope.go:117] "RemoveContainer" containerID="b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec"
Jul 05 20:12:45.934596 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:12:45.934575    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec\": container with ID starting with b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec not found: ID does not exist" containerID="b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec"
Jul 05 20:12:45.934649 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.934604    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec"} err="failed to get container status \"b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec\": rpc error: code = NotFound desc = could not find container \"b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec\": container with ID starting with b7b9a6f0081849ed2ae5fe3ef3ae29bda35d22bbf17e91e4891bd7ff59dd69ec not found: ID does not exist"
Jul 05 20:12:45.946659 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.946624    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"]
Jul 05 20:12:45.952204 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:45.952184    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/rate-test-model-d9296f-kserve-7cb7fcf659-2kfw8"]
Jul 05 20:12:46.213821 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.213716    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq" podUID="1f12b31a-1f3a-4410-b990-5c50f56b36f3" containerName="main" containerID="cri-o://60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d" gracePeriod=45
Jul 05 20:12:46.456747 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.456719    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:12:46.581508 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581478    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-model-cache\") pod \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") "
Jul 05 20:12:46.581666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581537    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-dshm\") pod \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") "
Jul 05 20:12:46.581666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tmp-dir\") pod \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") "
Jul 05 20:12:46.581666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlp2x\" (UniqueName: \"kubernetes.io/projected/1f12b31a-1f3a-4410-b990-5c50f56b36f3-kube-api-access-dlp2x\") pod \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") "
Jul 05 20:12:46.581666 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-home\") pod \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") "
Jul 05 20:12:46.581927 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581686    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tls-certs\") pod \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\" (UID: \"1f12b31a-1f3a-4410-b990-5c50f56b36f3\") "
Jul 05 20:12:46.581927 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581780    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f12b31a-1f3a-4410-b990-5c50f56b36f3" (UID: "1f12b31a-1f3a-4410-b990-5c50f56b36f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:46.581927 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581877    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f12b31a-1f3a-4410-b990-5c50f56b36f3" (UID: "1f12b31a-1f3a-4410-b990-5c50f56b36f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:46.582065 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581984    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-home" (OuterVolumeSpecName: "home") pod "1f12b31a-1f3a-4410-b990-5c50f56b36f3" (UID: "1f12b31a-1f3a-4410-b990-5c50f56b36f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:46.582065 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.581996    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-model-cache\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:46.582065 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.582014    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tmp-dir\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:46.583614 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.583592    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-dshm" (OuterVolumeSpecName: "dshm") pod "1f12b31a-1f3a-4410-b990-5c50f56b36f3" (UID: "1f12b31a-1f3a-4410-b990-5c50f56b36f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:12:46.583715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.583635    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f12b31a-1f3a-4410-b990-5c50f56b36f3-kube-api-access-dlp2x" (OuterVolumeSpecName: "kube-api-access-dlp2x") pod "1f12b31a-1f3a-4410-b990-5c50f56b36f3" (UID: "1f12b31a-1f3a-4410-b990-5c50f56b36f3"). InnerVolumeSpecName "kube-api-access-dlp2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:12:46.583715 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.583649    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f12b31a-1f3a-4410-b990-5c50f56b36f3" (UID: "1f12b31a-1f3a-4410-b990-5c50f56b36f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:12:46.682916 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.682893    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlp2x\" (UniqueName: \"kubernetes.io/projected/1f12b31a-1f3a-4410-b990-5c50f56b36f3-kube-api-access-dlp2x\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:46.682916 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.682912    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-home\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:46.683066 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.682922    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f12b31a-1f3a-4410-b990-5c50f56b36f3-tls-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:46.683066 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.682931    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f12b31a-1f3a-4410-b990-5c50f56b36f3-dshm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:12:46.931744 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.931655    2579 generic.go:356] "Generic (PLEG): container finished" podID="1f12b31a-1f3a-4410-b990-5c50f56b36f3" containerID="60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d" exitCode=0
Jul 05 20:12:46.931744 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.931704    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"
Jul 05 20:12:46.931972 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.931743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq" event={"ID":"1f12b31a-1f3a-4410-b990-5c50f56b36f3","Type":"ContainerDied","Data":"60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d"}
Jul 05 20:12:46.931972 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.931793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq" event={"ID":"1f12b31a-1f3a-4410-b990-5c50f56b36f3","Type":"ContainerDied","Data":"aa87a1a9066b4ef014aa33362745ca08552319fec3e9f8c1859000e653cd893a"}
Jul 05 20:12:46.931972 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.931840    2579 scope.go:117] "RemoveContainer" containerID="60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d"
Jul 05 20:12:46.940706 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.940691    2579 scope.go:117] "RemoveContainer" containerID="60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d"
Jul 05 20:12:46.940987 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:12:46.940968    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d\": container with ID starting with 60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d not found: ID does not exist" containerID="60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d"
Jul 05 20:12:46.941039 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.940995    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d"} err="failed to get container status \"60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d\": rpc error: code = NotFound desc = could not find container \"60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d\": container with ID starting with 60f9af90e376873b4430acd685fb760b6479522164904dd035f362e44dcab35d not found: ID does not exist"
Jul 05 20:12:46.953829 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.953788    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"]
Jul 05 20:12:46.959729 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:46.959709    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-65fb4d/rate-test-model-65fb4d-kserve-664f58cd7-flmdq"]
Jul 05 20:12:47.618307 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:47.618276    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f12b31a-1f3a-4410-b990-5c50f56b36f3" path="/var/lib/kubelet/pods/1f12b31a-1f3a-4410-b990-5c50f56b36f3/volumes"
Jul 05 20:12:47.618785 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:12:47.618767    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" path="/var/lib/kubelet/pods/f550e8dc-ffdf-409e-94b0-55d46bfdb9ac/volumes"
Jul 05 20:13:13.793704 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:13.793674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:14.538621 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:14.538593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:14.804041 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:14.803964    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:15.038323 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:15.038289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:15.374038 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:15.374011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:15.729648 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:15.729571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:15.830344 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:15.830315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:15.930871 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:15.930838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:16.029997 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.029966    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"]
Jul 05 20:13:16.030254 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.030227    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" podUID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" containerName="maas-api" containerID="cri-o://1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf" gracePeriod=30
Jul 05 20:13:16.055431 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.055411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:16.124466 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.124428    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" podUID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.65:8443/health\": dial tcp 10.134.0.65:8443: connect: connection refused"
Jul 05 20:13:16.281462 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.281416    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:13:16.421891 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.421859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmzg8\" (UniqueName: \"kubernetes.io/projected/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-kube-api-access-nmzg8\") pod \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") "
Jul 05 20:13:16.421891 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.421898    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-openshift-service-ca\") pod \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") "
Jul 05 20:13:16.422076 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.421954    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls\") pod \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\" (UID: \"b2de9e77-b1c9-4496-9c3d-79d766ab96a7\") "
Jul 05 20:13:16.422343 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.422315    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b2de9e77-b1c9-4496-9c3d-79d766ab96a7" (UID: "b2de9e77-b1c9-4496-9c3d-79d766ab96a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 20:13:16.423950 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.423921    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-kube-api-access-nmzg8" (OuterVolumeSpecName: "kube-api-access-nmzg8") pod "b2de9e77-b1c9-4496-9c3d-79d766ab96a7" (UID: "b2de9e77-b1c9-4496-9c3d-79d766ab96a7"). InnerVolumeSpecName "kube-api-access-nmzg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:13:16.423950 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.423929    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b2de9e77-b1c9-4496-9c3d-79d766ab96a7" (UID: "b2de9e77-b1c9-4496-9c3d-79d766ab96a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:13:16.522923 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.522900    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:13:16.522923 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.522921    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmzg8\" (UniqueName: \"kubernetes.io/projected/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-kube-api-access-nmzg8\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:13:16.523118 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:16.522930    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2de9e77-b1c9-4496-9c3d-79d766ab96a7-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 05 20:13:17.096633 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.096601    2579 generic.go:356] "Generic (PLEG): container finished" podID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" containerID="1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf" exitCode=0
Jul 05 20:13:17.097058 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.096640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" event={"ID":"b2de9e77-b1c9-4496-9c3d-79d766ab96a7","Type":"ContainerDied","Data":"1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf"}
Jul 05 20:13:17.097058 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.096719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw" event={"ID":"b2de9e77-b1c9-4496-9c3d-79d766ab96a7","Type":"ContainerDied","Data":"0e61dca2072f951815fb4ff99b916140beb9bbedaddca2f6089eaf1ee01825bb"}
Jul 05 20:13:17.097058 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.096653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"
Jul 05 20:13:17.097058 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.096741    2579 scope.go:117] "RemoveContainer" containerID="1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf"
Jul 05 20:13:17.109103 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.109078    2579 scope.go:117] "RemoveContainer" containerID="1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf"
Jul 05 20:13:17.109442 ip-10-0-134-29 kubenswrapper[2579]: E0705 20:13:17.109423    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf\": container with ID starting with 1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf not found: ID does not exist" containerID="1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf"
Jul 05 20:13:17.109509 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.109450    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf"} err="failed to get container status \"1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf\": rpc error: code = NotFound desc = could not find container \"1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf\": container with ID starting with 1b25a81b4ac38941f4935e32a7723b89186aab1101a9e85abcdc24da9c262ebf not found: ID does not exist"
Jul 05 20:13:17.119759 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.119738    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"]
Jul 05 20:13:17.124175 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.124149    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-65fb4d-855ffc9d5b-lt4sw"]
Jul 05 20:13:17.618707 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:17.618677    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" path="/var/lib/kubelet/pods/b2de9e77-b1c9-4496-9c3d-79d766ab96a7/volumes"
Jul 05 20:13:21.560770 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:21.560739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:21.675731 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:21.675698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:21.853102 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:21.853006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:22.063699 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:22.063665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:22.494550 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:22.494524    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c7d669ff5-pzm9m_81816504-cc9a-4dbb-a605-618e06b84f71/authorino/0.log"
Jul 05 20:13:27.352918 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:27.352885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-868fb55c58-xhrrh_af357c79-2298-4856-bca9-95120a3c6cab/maas-api/0.log"
Jul 05 20:13:27.694181 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:27.694107    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d47c8d5b4-h9x6r_7b48b231-dabf-4a88-9e3b-6e8464d10c41/manager/0.log"
Jul 05 20:13:28.024859 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:28.024838    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-9cq5g_db7ee14b-4652-4271-ae3a-e84be0366b2d/copy-manifests/0.log"
Jul 05 20:13:28.030714 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:28.030691    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-9cq5g_db7ee14b-4652-4271-ae3a-e84be0366b2d/manager/0.log"
Jul 05 20:13:28.395849 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:28.395757    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5n4bv_e44b0bf9-f327-463e-a86c-2d08a056d996/postgres/0.log"
Jul 05 20:13:29.166296 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.166268    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb_ac459dd3-7f8d-4a24-8a32-0a6302b5f569/util/0.log"
Jul 05 20:13:29.172350 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.172325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb_ac459dd3-7f8d-4a24-8a32-0a6302b5f569/pull/0.log"
Jul 05 20:13:29.177605 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.177586    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb_ac459dd3-7f8d-4a24-8a32-0a6302b5f569/extract/0.log"
Jul 05 20:13:29.289657 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.289638    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h_c2c206bb-4053-4c92-aa06-85c7e0d9f5df/util/0.log"
Jul 05 20:13:29.295175 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.295157    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h_c2c206bb-4053-4c92-aa06-85c7e0d9f5df/pull/0.log"
Jul 05 20:13:29.300148 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.300133    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h_c2c206bb-4053-4c92-aa06-85c7e0d9f5df/extract/0.log"
Jul 05 20:13:29.424080 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.424028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8_d0753d03-6989-4cfe-8373-27eddefdc749/util/0.log"
Jul 05 20:13:29.429502 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.429488    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8_d0753d03-6989-4cfe-8373-27eddefdc749/pull/0.log"
Jul 05 20:13:29.434807 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.434781    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8_d0753d03-6989-4cfe-8373-27eddefdc749/extract/0.log"
Jul 05 20:13:29.543880 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.543862    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp_13a272e1-a136-4d52-a27c-c71f63ba7d2c/util/0.log"
Jul 05 20:13:29.550031 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.550014    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp_13a272e1-a136-4d52-a27c-c71f63ba7d2c/pull/0.log"
Jul 05 20:13:29.555290 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.555276    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp_13a272e1-a136-4d52-a27c-c71f63ba7d2c/extract/0.log"
Jul 05 20:13:29.674003 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.673977    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c7d669ff5-pzm9m_81816504-cc9a-4dbb-a605-618e06b84f71/authorino/0.log"
Jul 05 20:13:29.905107 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:29.905080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4rvff_22544d28-e424-4104-8399-28db8385bc07/manager/0.log"
Jul 05 20:13:30.137420 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:30.137387    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k6lnm_4f31c1fe-4669-4b74-b038-958f150ae92b/registry-server/0.log"
Jul 05 20:13:30.499227 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:30.499198    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pgs8w_0652f4d8-2a53-468d-9344-f001130addad/manager/0.log"
Jul 05 20:13:30.833621 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:30.833557    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lf5bd_4a3b5088-251f-4daa-8a1e-73d2cff04040/istio-proxy/0.log"
Jul 05 20:13:31.287621 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:31.287598    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/1.log"
Jul 05 20:13:31.409139 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:31.409115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dfg79_b0c2ccd6-a0df-4753-8401-534ddc467f26/payload-pre-processing/0.log"
Jul 05 20:13:31.527653 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:31.527618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mxbvl_525d16b5-426e-4591-8f25-a01402bd913f/payload-processing/0.log"
Jul 05 20:13:31.971386 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:31.971358    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2qwtv_7e7ea43b-97e1-42b7-9957-224c69f758e8/main/0.log"
Jul 05 20:13:32.188115 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:32.188090    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zqpwr_8d4746d2-1f3b-4d6c-87f0-bd223fe5e600/main/0.log"
Jul 05 20:13:36.646960 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.646926    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hb8xk/must-gather-pgfc4"]
Jul 05 20:13:36.647314 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647281    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0505c284-245f-4d6d-b337-f42d7ddfc32d" containerName="maas-api"
Jul 05 20:13:36.647314 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647291    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0505c284-245f-4d6d-b337-f42d7ddfc32d" containerName="maas-api"
Jul 05 20:13:36.647314 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647301    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" containerName="maas-api"
Jul 05 20:13:36.647314 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647306    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" containerName="maas-api"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647317    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f12b31a-1f3a-4410-b990-5c50f56b36f3" containerName="main"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647323    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f12b31a-1f3a-4410-b990-5c50f56b36f3" containerName="main"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647337    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" containerName="main"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647343    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" containerName="main"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647392    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f550e8dc-ffdf-409e-94b0-55d46bfdb9ac" containerName="main"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647402    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0505c284-245f-4d6d-b337-f42d7ddfc32d" containerName="maas-api"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647407    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de9e77-b1c9-4496-9c3d-79d766ab96a7" containerName="maas-api"
Jul 05 20:13:36.647444 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.647414    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f12b31a-1f3a-4410-b990-5c50f56b36f3" containerName="main"
Jul 05 20:13:36.652073 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.652054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.654909 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.654888    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hb8xk\"/\"default-dockercfg-9prf5\""
Jul 05 20:13:36.655038 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.654935    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb8xk\"/\"kube-root-ca.crt\""
Jul 05 20:13:36.656168 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.656149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb8xk\"/\"openshift-service-ca.crt\""
Jul 05 20:13:36.659910 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.659887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/must-gather-pgfc4"]
Jul 05 20:13:36.663935 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.663915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:36.683079 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.683059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/29b3d7dc-6754-43f0-824a-27801388468c-must-gather-output\") pod \"must-gather-pgfc4\" (UID: \"29b3d7dc-6754-43f0-824a-27801388468c\") " pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.683169 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.683091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk5dx\" (UniqueName: \"kubernetes.io/projected/29b3d7dc-6754-43f0-824a-27801388468c-kube-api-access-bk5dx\") pod \"must-gather-pgfc4\" (UID: \"29b3d7dc-6754-43f0-824a-27801388468c\") " pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.760960 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.760938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log" limit=1024
Jul 05 20:13:36.784297 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.784277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/29b3d7dc-6754-43f0-824a-27801388468c-must-gather-output\") pod \"must-gather-pgfc4\" (UID: \"29b3d7dc-6754-43f0-824a-27801388468c\") " pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.784402 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.784305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk5dx\" (UniqueName: \"kubernetes.io/projected/29b3d7dc-6754-43f0-824a-27801388468c-kube-api-access-bk5dx\") pod \"must-gather-pgfc4\" (UID: \"29b3d7dc-6754-43f0-824a-27801388468c\") " pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.784579 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.784562    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/29b3d7dc-6754-43f0-824a-27801388468c-must-gather-output\") pod \"must-gather-pgfc4\" (UID: \"29b3d7dc-6754-43f0-824a-27801388468c\") " pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.792480 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.792458    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk5dx\" (UniqueName: \"kubernetes.io/projected/29b3d7dc-6754-43f0-824a-27801388468c-kube-api-access-bk5dx\") pod \"must-gather-pgfc4\" (UID: \"29b3d7dc-6754-43f0-824a-27801388468c\") " pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:36.961826 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:36.961720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/must-gather-pgfc4"
Jul 05 20:13:37.088722 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:37.088696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/must-gather-pgfc4"]
Jul 05 20:13:37.090237 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:13:37.090210    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29b3d7dc_6754_43f0_824a_27801388468c.slice/crio-b6671fbc28e42448a0a22a478d8edf15189ca110cc5e0241231ce6c5fe4df8bc WatchSource:0}: Error finding container b6671fbc28e42448a0a22a478d8edf15189ca110cc5e0241231ce6c5fe4df8bc: Status 404 returned error can't find the container with id b6671fbc28e42448a0a22a478d8edf15189ca110cc5e0241231ce6c5fe4df8bc
Jul 05 20:13:37.092273 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:37.092252    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 20:13:37.199853 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:37.199824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/must-gather-pgfc4" event={"ID":"29b3d7dc-6754-43f0-824a-27801388468c","Type":"ContainerStarted","Data":"b6671fbc28e42448a0a22a478d8edf15189ca110cc5e0241231ce6c5fe4df8bc"}
Jul 05 20:13:38.207779 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:38.207681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/must-gather-pgfc4" event={"ID":"29b3d7dc-6754-43f0-824a-27801388468c","Type":"ContainerStarted","Data":"864a120140fe189d89702cddec4d479c1faeb6b1c01cad8df1dc895f0a16e1b4"}
Jul 05 20:13:38.207779 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:38.207727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/must-gather-pgfc4" event={"ID":"29b3d7dc-6754-43f0-824a-27801388468c","Type":"ContainerStarted","Data":"bf072cda5212990977fa2d0872c2691032e8ba7837079356807220046eb78a04"}
Jul 05 20:13:38.223794 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:38.223740    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hb8xk/must-gather-pgfc4" podStartSLOduration=1.408687022 podStartE2EDuration="2.223724254s" totalImagesPullingTime="815.037232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:13:38.223172216 +0000 UTC m=+2463.045662914" watchObservedRunningTime="2026-07-05 20:13:38.223724254 +0000 UTC m=+2463.046214935"
Jul 05 20:13:39.505273 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:39.505211    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kjtpp_97bae834-6b1d-43b6-ac09-ccffa217d9af/global-pull-secret-syncer/0.log"
Jul 05 20:13:39.555169 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:39.555138    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-27jnz_a982052a-2fc3-41f9-9f98-9dcd36feb199/konnectivity-agent/0.log"
Jul 05 20:13:39.663058 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:39.663031    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-29.ec2.internal_301d2e284fa3bf2b30f75ef544be44ae/haproxy/0.log"
Jul 05 20:13:44.162610 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.162573    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb_ac459dd3-7f8d-4a24-8a32-0a6302b5f569/extract/0.log"
Jul 05 20:13:44.186727 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.186640    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb_ac459dd3-7f8d-4a24-8a32-0a6302b5f569/util/0.log"
Jul 05 20:13:44.298382 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.298343    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5wjb_ac459dd3-7f8d-4a24-8a32-0a6302b5f569/pull/0.log"
Jul 05 20:13:44.323409 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.323360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h_c2c206bb-4053-4c92-aa06-85c7e0d9f5df/extract/0.log"
Jul 05 20:13:44.343880 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.343843    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h_c2c206bb-4053-4c92-aa06-85c7e0d9f5df/util/0.log"
Jul 05 20:13:44.380919 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.380873    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06fm9h_c2c206bb-4053-4c92-aa06-85c7e0d9f5df/pull/0.log"
Jul 05 20:13:44.412734 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.412651    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8_d0753d03-6989-4cfe-8373-27eddefdc749/extract/0.log"
Jul 05 20:13:44.441273 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.441248    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8_d0753d03-6989-4cfe-8373-27eddefdc749/util/0.log"
Jul 05 20:13:44.464447 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.464412    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737vqj8_d0753d03-6989-4cfe-8373-27eddefdc749/pull/0.log"
Jul 05 20:13:44.489246 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.489193    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp_13a272e1-a136-4d52-a27c-c71f63ba7d2c/extract/0.log"
Jul 05 20:13:44.510480 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.510452    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp_13a272e1-a136-4d52-a27c-c71f63ba7d2c/util/0.log"
Jul 05 20:13:44.536455 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.536424    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lhqp_13a272e1-a136-4d52-a27c-c71f63ba7d2c/pull/0.log"
Jul 05 20:13:44.904822 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.902298    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c7d669ff5-pzm9m_81816504-cc9a-4dbb-a605-618e06b84f71/authorino/0.log"
Jul 05 20:13:44.962824 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:44.962773    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4rvff_22544d28-e424-4104-8399-28db8385bc07/manager/0.log"
Jul 05 20:13:45.027447 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:45.026358    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k6lnm_4f31c1fe-4669-4b74-b038-958f150ae92b/registry-server/0.log"
Jul 05 20:13:45.299819 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:45.299716    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pgs8w_0652f4d8-2a53-468d-9344-f001130addad/manager/0.log"
Jul 05 20:13:47.479346 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:47.479308    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thcwj_4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4/node-exporter/0.log"
Jul 05 20:13:47.502076 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:47.502046    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thcwj_4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4/kube-rbac-proxy/0.log"
Jul 05 20:13:47.523354 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:47.523326    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thcwj_4b7e6a65-d8df-4a08-b4f5-36058ddcbbc4/init-textfile/0.log"
Jul 05 20:13:47.551935 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:47.551877    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-7fvx6_0a959acd-5ea9-4fab-a618-265582f1db3c/kube-rbac-proxy-main/0.log"
Jul 05 20:13:47.571523 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:47.571493    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-7fvx6_0a959acd-5ea9-4fab-a618-265582f1db3c/kube-rbac-proxy-self/0.log"
Jul 05 20:13:47.591187 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:47.591152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-7fvx6_0a959acd-5ea9-4fab-a618-265582f1db3c/openshift-state-metrics/0.log"
Jul 05 20:13:48.123140 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:48.123112    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fb8579844-97gvn_d01bd35a-3f45-4052-bf08-eb1f77ed441a/thanos-query/0.log"
Jul 05 20:13:48.160549 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:48.160525    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fb8579844-97gvn_d01bd35a-3f45-4052-bf08-eb1f77ed441a/kube-rbac-proxy-web/0.log"
Jul 05 20:13:48.199760 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:48.199732    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fb8579844-97gvn_d01bd35a-3f45-4052-bf08-eb1f77ed441a/kube-rbac-proxy/0.log"
Jul 05 20:13:48.221825 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:48.221772    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fb8579844-97gvn_d01bd35a-3f45-4052-bf08-eb1f77ed441a/prom-label-proxy/0.log"
Jul 05 20:13:48.242841 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:48.242791    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fb8579844-97gvn_d01bd35a-3f45-4052-bf08-eb1f77ed441a/kube-rbac-proxy-rules/0.log"
Jul 05 20:13:48.264608 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:48.264579    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fb8579844-97gvn_d01bd35a-3f45-4052-bf08-eb1f77ed441a/kube-rbac-proxy-metrics/0.log"
Jul 05 20:13:49.037462 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.035470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"]
Jul 05 20:13:49.041618 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.041592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.050760 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.050007    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"]
Jul 05 20:13:49.118823 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.118297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-proc\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.118823 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.118350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-lib-modules\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.118823 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.118441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkc6j\" (UniqueName: \"kubernetes.io/projected/0346a3b3-b0b0-412f-a985-b5aab92deb8c-kube-api-access-kkc6j\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.118823 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.118469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-podres\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.118823 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.118536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-sys\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.219609 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.219567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-sys\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.219837 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.219650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-proc\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.219837 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.219682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-lib-modules\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.219837 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.219786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkc6j\" (UniqueName: \"kubernetes.io/projected/0346a3b3-b0b0-412f-a985-b5aab92deb8c-kube-api-access-kkc6j\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.219837 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.219836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-podres\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.220101 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.220018    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-podres\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.220101 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.220030    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-proc\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.220101 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.220095    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-sys\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.220262 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.220132    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0346a3b3-b0b0-412f-a985-b5aab92deb8c-lib-modules\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.231834 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.231786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkc6j\" (UniqueName: \"kubernetes.io/projected/0346a3b3-b0b0-412f-a985-b5aab92deb8c-kube-api-access-kkc6j\") pod \"perf-node-gather-daemonset-j7glh\" (UID: \"0346a3b3-b0b0-412f-a985-b5aab92deb8c\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.356457 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.356371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:49.537751 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:49.537710    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"]
Jul 05 20:13:49.545773 ip-10-0-134-29 kubenswrapper[2579]: W0705 20:13:49.545733    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0346a3b3_b0b0_412f_a985_b5aab92deb8c.slice/crio-986888d2b0359601bc54db60cf56d1d27b05154ab9f2e587542697b8ecd0074d WatchSource:0}: Error finding container 986888d2b0359601bc54db60cf56d1d27b05154ab9f2e587542697b8ecd0074d: Status 404 returned error can't find the container with id 986888d2b0359601bc54db60cf56d1d27b05154ab9f2e587542697b8ecd0074d
Jul 05 20:13:50.307952 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:50.307917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh" event={"ID":"0346a3b3-b0b0-412f-a985-b5aab92deb8c","Type":"ContainerStarted","Data":"abba35bc106e4248f1c1a2fecd13baaeb4e1980ab1c273cc107a70d5774cad03"}
Jul 05 20:13:50.308352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:50.307975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh" event={"ID":"0346a3b3-b0b0-412f-a985-b5aab92deb8c","Type":"ContainerStarted","Data":"986888d2b0359601bc54db60cf56d1d27b05154ab9f2e587542697b8ecd0074d"}
Jul 05 20:13:50.308352 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:50.308094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:50.325010 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:50.324952    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh" podStartSLOduration=1.324929897 podStartE2EDuration="1.324929897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 20:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:13:50.322416578 +0000 UTC m=+2475.144907260" watchObservedRunningTime="2026-07-05 20:13:50.324929897 +0000 UTC m=+2475.147420580"
Jul 05 20:13:50.458301 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:50.458270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c899977f6-g2kjj_c970216e-d9ff-4ff6-ac9a-0905a29019e6/console/0.log"
Jul 05 20:13:52.052576 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:52.052539    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tpfml_d6c5c9dc-5704-49d3-a473-7aa826f59d1d/dns/0.log"
Jul 05 20:13:52.071031 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:52.071005    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tpfml_d6c5c9dc-5704-49d3-a473-7aa826f59d1d/kube-rbac-proxy/0.log"
Jul 05 20:13:52.134547 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:52.134522    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpbpw_b228f734-4eb4-4d85-8da0-a8457c88c0e8/dns-node-resolver/0.log"
Jul 05 20:13:52.635403 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:52.635372    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79f9564f79-xjpzv_831954ee-ac37-481c-a808-9132997dcc54/registry/0.log"
Jul 05 20:13:52.655219 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:52.655196    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bnxd_05f77337-2ea3-4f03-a1dd-ab57d8f5e697/node-ca/0.log"
Jul 05 20:13:53.552732 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:53.552703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lf5bd_4a3b5088-251f-4daa-8a1e-73d2cff04040/istio-proxy/0.log"
Jul 05 20:13:53.734076 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:53.734042    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/0.log"
Jul 05 20:13:53.771111 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:53.771082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/1.log"
Jul 05 20:13:53.806428 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:53.806351    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dfg79_b0c2ccd6-a0df-4753-8401-534ddc467f26/payload-pre-processing/0.log"
Jul 05 20:13:53.862608 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:53.862573    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mxbvl_525d16b5-426e-4591-8f25-a01402bd913f/payload-processing/0.log"
Jul 05 20:13:54.550033 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:54.550004    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9gnz_3cc50911-f31c-41c6-b83d-ce95e11ce8fc/serve-healthcheck-canary/0.log"
Jul 05 20:13:55.070631 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:55.070602    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhplh_65c11bab-e792-4a12-a4fb-6bffc6dabfab/kube-rbac-proxy/0.log"
Jul 05 20:13:55.089019 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:55.088991    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhplh_65c11bab-e792-4a12-a4fb-6bffc6dabfab/exporter/0.log"
Jul 05 20:13:55.108086 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:55.108062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhplh_65c11bab-e792-4a12-a4fb-6bffc6dabfab/extractor/0.log"
Jul 05 20:13:56.327379 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:56.327350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-j7glh"
Jul 05 20:13:57.344219 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:57.344192    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-868fb55c58-xhrrh_af357c79-2298-4856-bca9-95120a3c6cab/maas-api/0.log"
Jul 05 20:13:57.521837 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:57.521780    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d47c8d5b4-h9x6r_7b48b231-dabf-4a88-9e3b-6e8464d10c41/manager/0.log"
Jul 05 20:13:57.633431 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:57.633331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-9cq5g_db7ee14b-4652-4271-ae3a-e84be0366b2d/manager/0.log"
Jul 05 20:13:57.651893 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:57.651868    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-9cq5g_db7ee14b-4652-4271-ae3a-e84be0366b2d/copy-manifests/0.log"
Jul 05 20:13:57.808150 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:57.808127    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5n4bv_e44b0bf9-f327-463e-a86c-2d08a056d996/postgres/0.log"
Jul 05 20:13:59.275464 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:59.275438    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-644c79ff99-cl59k_4126125e-3a43-4f7f-9290-28413216c691/manager/0.log"
Jul 05 20:13:59.455399 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:59.455302    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lf5bd_4a3b5088-251f-4daa-8a1e-73d2cff04040/istio-proxy/0.log"
Jul 05 20:13:59.598589 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:59.598560    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/0.log"
Jul 05 20:13:59.637361 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:59.637329    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/1.log"
Jul 05 20:13:59.661450 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:59.661411    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dfg79_b0c2ccd6-a0df-4753-8401-534ddc467f26/payload-pre-processing/0.log"
Jul 05 20:13:59.710754 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:13:59.710676    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mxbvl_525d16b5-426e-4591-8f25-a01402bd913f/payload-processing/0.log"
Jul 05 20:14:00.866297 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:00.866222    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lf5bd_4a3b5088-251f-4daa-8a1e-73d2cff04040/istio-proxy/0.log"
Jul 05 20:14:01.015915 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:01.015883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/0.log"
Jul 05 20:14:01.052327 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:01.052263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7ppqs_f37e863c-27a5-4596-aaf5-fafac05cb182/istio-proxy/1.log"
Jul 05 20:14:01.075039 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:01.075013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dfg79_b0c2ccd6-a0df-4753-8401-534ddc467f26/payload-pre-processing/0.log"
Jul 05 20:14:01.121733 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:01.121636    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mxbvl_525d16b5-426e-4591-8f25-a01402bd913f/payload-processing/0.log"
Jul 05 20:14:04.115461 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:04.115413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-rvh77_6e6a143e-c3ec-4fc5-bdf8-98787e670ede/migrator/0.log"
Jul 05 20:14:04.135862 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:04.135838    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-rvh77_6e6a143e-c3ec-4fc5-bdf8-98787e670ede/graceful-termination/0.log"
Jul 05 20:14:05.397307 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.397278    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/kube-multus-additional-cni-plugins/0.log"
Jul 05 20:14:05.416360 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.416335    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/egress-router-binary-copy/0.log"
Jul 05 20:14:05.436321 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.436290    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/cni-plugins/0.log"
Jul 05 20:14:05.455388 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.455365    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/bond-cni-plugin/0.log"
Jul 05 20:14:05.473969 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.473945    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/routeoverride-cni/0.log"
Jul 05 20:14:05.492951 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.492930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/whereabouts-cni-bincopy/0.log"
Jul 05 20:14:05.511091 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.511070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckqjg_1ed620df-38be-4e21-9cce-e6b2f75a09d5/whereabouts-cni/0.log"
Jul 05 20:14:05.835791 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.835757    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fqs67_ed6ee0c6-6fd1-4229-a772-be0061011a8b/kube-multus/0.log"
Jul 05 20:14:05.964301 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.964270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r749c_c317b1c2-a657-4090-a84f-eda551f5e8c7/network-metrics-daemon/0.log"
Jul 05 20:14:05.982456 ip-10-0-134-29 kubenswrapper[2579]: I0705 20:14:05.982430    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r749c_c317b1c2-a657-4090-a84f-eda551f5e8c7/kube-rbac-proxy/0.log"