Jul 20 17:56:08.669107 ip-10-0-138-227 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 17:56:10.881398 ip-10-0-138-227 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 17:56:10.881398 ip-10-0-138-227 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 17:56:10.881398 ip-10-0-138-227 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 17:56:10.881398 ip-10-0-138-227 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 17:56:10.881398 ip-10-0-138-227 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 17:56:10.883026 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.882942    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 17:56:10.886949 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886936    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:56:10.886949 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886949    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886953    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886957    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886960    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886963    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886966    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886969    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886971    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886974    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886977    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886980    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886984    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886988    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886991    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886994    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.886997    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887000    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887002    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887005    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:56:10.887009 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887008    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887010    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887013    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887016    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887019    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887022    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887040    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887044    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887046    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887049    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887051    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887054    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887057    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887060    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887064    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887067    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887070    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887073    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887076    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887079    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:56:10.887450 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887082    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887084    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887087    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887090    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887092    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887097    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887099    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887102    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887104    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887106    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887109    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887111    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887114    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887118    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887121    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887124    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887127    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887130    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887133    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:56:10.887912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887135    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887138    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887141    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887146    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887150    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887152    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887155    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887158    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887160    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887163    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887166    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887168    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887171    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887173    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887176    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887179    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887181    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887184    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887187    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:56:10.888429 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887189    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887192    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887195    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887197    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887199    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887202    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887205    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887208    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887211    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887214    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887216    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887219    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887221    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887223    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887226    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887228    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887231    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887234    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887236    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887239    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:56:10.888871 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887961    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887968    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887971    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887975    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887977    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887981    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887984    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887987    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887990    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887993    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.887995    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888000    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888004    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888007    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888010    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888012    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888015    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888018    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888021    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888024    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:56:10.889388 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888027    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888031    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888035    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888039    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888042    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888044    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888047    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888050    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888052    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888055    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888057    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888060    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888063    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888065    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888068    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888070    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888072    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888075    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888077    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:56:10.889878 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888080    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888083    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888085    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888088    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888091    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888097    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888099    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888102    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888104    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888107    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888109    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888112    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888115    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888119    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888122    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888125    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888128    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888131    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:56:10.890390 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888133    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888136    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888139    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888141    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888144    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888147    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888149    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888152    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888154    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888157    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888159    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888162    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888164    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888166    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888170    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888172    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888178    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888180    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888183    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888186    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:56:10.890847 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888188    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888191    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888194    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888197    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888200    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888202    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888205    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888207    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888210    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888212    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888215    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888217    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888220    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888222    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888225    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888228    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888230    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888233    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888235    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888238    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:56:10.891355 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888240    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888603    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888608    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888611    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888614    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888617    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888622    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888625    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888629    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888631    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888634    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888637    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888640    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888643    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888645    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888648    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888650    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888653    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888655    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888658    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:56:10.891934 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888660    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888663    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888665    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888668    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888670    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888672    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888675    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888677    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888680    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888683    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888685    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888688    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888690    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888693    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888695    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888697    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888700    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888702    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888706    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888709    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:56:10.892445 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888712    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888715    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888719    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888722    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888726    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888729    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888731    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888734    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888737    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888740    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888743    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888746    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888750    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888752    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888755    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888757    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888759    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888762    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888764    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888767    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:56:10.892933 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888769    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888772    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888775    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888777    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888780    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888783    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888787    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888790    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888792    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888795    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888799    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888802    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888806    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888808    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888810    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888813    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888816    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888819    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888822    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:56:10.893415 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888824    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888827    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888830    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888834    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888837    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888840    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888843    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888846    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888849    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888852    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888854    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888856    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888860    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888862    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888865    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888867    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888883    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888887    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:56:10.893857 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888893    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.888896    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.888973    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.888980    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.888987    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.888991    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.888997    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889000    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889003    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889008    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889011    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889014    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889018    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889021    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889024    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889027    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889030    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889033    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889035    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889038    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889042    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889045    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889048    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889051    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 17:56:10.894313 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889054    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889062    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889065    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889068    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889071    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889074    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889077    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889079    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889082    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889085    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889089    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889092    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889095    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889098    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889103    2562 flags.go:64] FLAG: --enable-server="true"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889106    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889110    2562 flags.go:64] FLAG: --event-burst="100"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889113    2562 flags.go:64] FLAG: --event-qps="50"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889116    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889119    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889122    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889126    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889129    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889132    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889135    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 20 17:56:10.894888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889138    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889141    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889144    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889146    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889149    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889152    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889155    2562 flags.go:64] FLAG: --feature-gates=""
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889158    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889161    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889164    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889167    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889170    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889173    2562 flags.go:64] FLAG: --help="false"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889176    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-227.ec2.internal"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889179    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889182    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889185    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889188    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889191    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889194    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889197    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889201    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889204    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 17:56:10.895527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889207    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889210    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889213    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889216    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889218    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889222    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889225    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889227    2562 flags.go:64] FLAG: --lock-file=""
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889230    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889233    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889236    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889241    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889244    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889247    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889249    2562 flags.go:64] FLAG: --logging-format="text"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889252    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889255    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889258    2562 flags.go:64] FLAG: --manifest-url=""
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889261    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889265    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889267    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889271    2562 flags.go:64] FLAG: --max-pods="110"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889274    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889277    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889280    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 17:56:10.896165 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889283    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889286    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889289    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889292    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889299    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889303    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889306    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889308    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889311    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889316    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889319    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889322    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889325    2562 flags.go:64] FLAG: --port="10250"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889328    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889331    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b30b165729f020b0"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889334    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889337    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889340    2562 flags.go:64] FLAG: --register-node="true"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889343    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889346    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889349    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889351    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889354    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889358    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889361    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 17:56:10.896771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889364    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889366    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889369    2562 flags.go:64] FLAG: --runonce="false"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889372    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889375    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889378    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889380    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889383    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889386    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889389    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889394    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889397    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889401    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889404    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889407    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889410    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889413    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889416    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889421    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889423    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889426    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889430    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889433    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889436    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889439    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 17:56:10.897377 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889442    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889444    2562 flags.go:64] FLAG: --v="2"
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889448    2562 flags.go:64] FLAG: --version="false"
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889452    2562 flags.go:64] FLAG: --vmodule=""
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889456    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889459    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889569    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889573    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889576    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889580    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889583    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889585    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889588    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889591    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889594    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889596    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889599    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889602    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889605    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889608    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889611    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:56:10.897983 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889614    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889616    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889619    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889621    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889624    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889627    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889629    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889632    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889635    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889637    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889640    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889643    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889645    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889648    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889650    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889653    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889655    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889658    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889660    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889663    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:56:10.898490 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889665    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889667    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889670    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889672    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889675    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889678    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889680    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889683    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889686    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889689    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889692    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889695    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889699    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889702    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889705    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889708    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889711    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889713    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889716    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:56:10.899075 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889719    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889722    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889725    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889731    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889734    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889736    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889739    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889741    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889744    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889746    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889749    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889751    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889754    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889757    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889760    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889763    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889766    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889769    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889772    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:56:10.899568 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889775    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889777    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889781    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889784    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889787    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889790    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889793    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889796    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889799    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889801    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889804    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889806    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889809    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889812    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889814    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889817    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889819    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889822    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889825    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889827    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:56:10.900027 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889829    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889833    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889837    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889839    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889842    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.889844    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.889849    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.896264    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.896277    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.896291    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.896300    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896352    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896357    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896360    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:56:10.900499 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896363    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896366    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896369    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896372    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896374    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896377    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896379    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896382    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896385    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896387    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896390    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896393    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896395    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896398    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896400    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896402    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896405    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896407    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896410    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896412    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:56:10.900839 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896415    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896417    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896420    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896423    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896425    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896428    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896432    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896434    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896437    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896439    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896442    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896444    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896447    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896449    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896452    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896455    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896458    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896460    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896463    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896466    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:56:10.901330 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896468    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896471    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896474    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896477    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896481    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896484    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896487    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896490    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896493    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896496    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896499    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896501    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896504    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896507    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896509    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896512    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896515    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896517    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896521    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:56:10.901808 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896524    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896527    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896530    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896532    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896535    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896538    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896540    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896543    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896545    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896548    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896550    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896553    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896555    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896558    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896560    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896563    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896565    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896568    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896571    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896573    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:56:10.902269 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896576    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896578    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896582    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896586    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896588    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896591    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896594    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896596    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896599    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896601    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896604    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896607    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896610    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896613    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896616    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896620    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:56:10.902723 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896623    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.896628    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896737    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896741    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896744    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896747    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896750    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896753    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896756    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896759    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896763    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896766    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896770    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896773    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:56:10.903235 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896777    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896780    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896783    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896786    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896789    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896791    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896794    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896797    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896799    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896801    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896804    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896807    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896809    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896812    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896815    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896818    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896821    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896823    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896826    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896828    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:56:10.903584 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896831    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896833    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896836    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896839    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896841    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896843    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896846    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896848    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896851    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896853    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896856    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896858    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896860    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896863    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896866    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896868    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896870    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896873    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896875    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896878    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:56:10.904085 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896880    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896883    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896886    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896888    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896891    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896894    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896896    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896899    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896903    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896906    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896909    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896912    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896931    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896934    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896937    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896940    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896942    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896945    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896947    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:56:10.904670 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896950    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896952    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896955    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896957    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896960    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896963    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896965    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896968    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896970    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896973    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896975    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896978    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896980    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896982    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896985    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896987    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896990    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896992    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896995    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:56:10.905137 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.896998    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897000    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897003    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897006    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897009    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897012    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897014    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897017    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:10.897019    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.897024    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.897121    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.898957    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.900090    2562 server.go:1019] "Starting client certificate rotation"
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.900190    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 17:56:10.905585 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.900227    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 17:56:10.905947 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.903167    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 17:56:10.906947 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.906934    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 17:56:10.917304 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.917279    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 20 17:56:10.919167 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.919148    2562 log.go:25] "Validated CRI v1 image API"
Jul 20 17:56:10.922569 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.922555    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 17:56:10.925236 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.925218    2562 fs.go:135] Filesystem UUIDs: map[4557258f-c17a-4e7d-9f5e-4a3f45315cf2:/dev/nvme0n1p3 5da08aa9-f6c6-484c-9bb8-21c06843d437:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 20 17:56:10.925311 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.925235    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 17:56:10.925621 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.925598    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 17:56:10.930254 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.930148    2562 manager.go:216] Machine: {Timestamp:2026-07-20 17:56:10.928819645 +0000 UTC m=+0.294797215 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098535 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec210c2d0a7cc9e5e013fd660afa8894 SystemUUID:ec210c2d-0a7c-c9e5-e013-fd660afa8894 BootID:3cd6ab80-b5fc-4809-b872-22f3433fe81c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:cc:ca:0e:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:cc:ca:0e:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:5a:3a:f8:d9:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 17:56:10.930254 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.930252    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 17:56:10.930378 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.930327    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 17:56:10.933063 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.933038    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 17:56:10.933202 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.933065    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 17:56:10.933709 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.933700    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 17:56:10.933744 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.933710    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 17:56:10.933744 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.933722    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 17:56:10.935084 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.935074    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 17:56:10.936163 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.936152    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 17:56:10.938754 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938744    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 17:56:10.938870 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938861    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 17:56:10.938905 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938892    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 17:56:10.938948 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938905    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 17:56:10.938948 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938933    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 17:56:10.938948 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938946    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 20 17:56:10.939066 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.938958    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 17:56:10.939293 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.939282    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 17:56:10.939327 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.939299    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 17:56:10.942841 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.942826    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 17:56:10.944109 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.944096    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 17:56:10.944161 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.944126    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 17:56:10.945071 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945058    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 17:56:10.945115 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945080    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 17:56:10.945115 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945090    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 17:56:10.945115 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945101    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 17:56:10.945115 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945114    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945124    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945137    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945146    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945156    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945165    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945189    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 17:56:10.945239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945198    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 17:56:10.945908 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945898    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 17:56:10.945954 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.945909    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 17:56:10.949223 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.949209    2562 server.go:1268] "Started kubelet"
Jul 20 17:56:10.949978 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.949319    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 17:56:10.950082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.949481    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 17:56:10.950096 ip-10-0-138-227 systemd[1]: Started Kubernetes Kubelet.
Jul 20 17:56:10.950251 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.950232    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 17:56:10.953382 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.953358    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 17:56:10.954216 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.954079    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-227.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 17:56:10.954216 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.954164    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 17:56:10.954374 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.954258    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 17:56:10.955552 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.955534    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 17:56:10.956416 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.956395    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-swmfz"
Jul 20 17:56:10.957424 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.957405    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 17:56:10.959764 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.958929    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-227.ec2.internal.18c4111d8c2f208e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-227.ec2.internal,UID:ip-10-0-138-227.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-227.ec2.internal,},FirstTimestamp:2026-07-20 17:56:10.949181582 +0000 UTC m=+0.315159151,LastTimestamp:2026-07-20 17:56:10.949181582 +0000 UTC m=+0.315159151,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-227.ec2.internal,}"
Jul 20 17:56:10.961967 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.961953    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 17:56:10.962031 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.962015    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 17:56:10.962089 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.961954    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-swmfz"
Jul 20 17:56:10.962141 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.962121    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:10.962593 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.962576    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 17:56:10.962593 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.962595    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 17:56:10.962731 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.962580    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 17:56:10.962731 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.962698    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 17:56:10.962731 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.962706    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 17:56:10.963045 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963022    2562 factory.go:153] Registering CRI-O factory
Jul 20 17:56:10.963157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963049    2562 factory.go:223] Registration of the crio container factory successfully
Jul 20 17:56:10.963157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963104    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 17:56:10.963157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963115    2562 factory.go:55] Registering systemd factory
Jul 20 17:56:10.963157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963123    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 20 17:56:10.963157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963143    2562 factory.go:103] Registering Raw factory
Jul 20 17:56:10.963157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963156    2562 manager.go:1196] Started watching for new ooms in manager
Jul 20 17:56:10.963853 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.963840    2562 manager.go:349] Starting recovery of all containers
Jul 20 17:56:10.964883 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.964773    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 17:56:10.964883 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.964853    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 17:56:10.973904 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.973806    2562 manager.go:354] Recovery completed
Jul 20 17:56:10.975119 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:10.975102    2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 20 17:56:10.978036 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.978023    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:10.980105 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.980078    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:10.980105 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.980106    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:10.980366 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.980337    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:10.981146 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.981130    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 17:56:10.981146 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.981144    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 17:56:10.981146 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.981160    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 17:56:10.981561 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.981542    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:10.982235 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.982207    2562 policy_none.go:49] "None policy: Start"
Jul 20 17:56:10.982235 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.982231    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 17:56:10.982359 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.982247    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 17:56:10.982460 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.982443    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:10.982519 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.982477    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:10.982519 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.982511    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:10.983382 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:10.983368    2562 policy_none.go:47] "Start"
Jul 20 17:56:11.025535 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.025518    2562 manager.go:337] "Starting Device Plugin manager"
Jul 20 17:56:11.025596 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.025548    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 17:56:11.025596 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.025558    2562 server.go:87] "Starting device plugin registration server"
Jul 20 17:56:11.025794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.025782    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 17:56:11.025833 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.025797    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 17:56:11.025946 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.025905    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 17:56:11.026043 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.026010    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 17:56:11.026043 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.026020    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 17:56:11.026523 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.026502    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 17:56:11.026591 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.026557    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.123446 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.123363    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 17:56:11.124527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.124508    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 17:56:11.124615 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.124552    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 17:56:11.124615 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.124580    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 17:56:11.124703 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.124620    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 17:56:11.125952 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.125935    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:11.127355 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.127337    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:56:11.127453 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.127367    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:11.127453 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.127390    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:11.127453 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.127399    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:11.127453 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.127426    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.133117 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.133102    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.133182 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.133123    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-227.ec2.internal\": node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.150265 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.150238    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.224764 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.224719    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"]
Jul 20 17:56:11.224940 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.224808    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:11.225770 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.225754    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:11.225870 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.225782    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:11.225870 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.225792    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:11.227231 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227219    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:11.227341 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.227384 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227364    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:11.227897 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227880    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:11.228001 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227903    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:11.228001 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227936    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:11.228001 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.227983    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:11.228110 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.228004    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:11.228110 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.228014    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:11.229188 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.229175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.229249 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.229199    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:56:11.229933 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.229904    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:56:11.229996 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.229942    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:56:11.229996 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.229957    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:56:11.250375 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.250356    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.251610 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.251590    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-227.ec2.internal\" not found" node="ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.255971 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.255957    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-227.ec2.internal\" not found" node="ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.264530 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.264512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2e50227d65fda4050a8a8dd57637707-config\") pod \"kube-apiserver-proxy-ip-10-0-138-227.ec2.internal\" (UID: \"e2e50227d65fda4050a8a8dd57637707\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.264583 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.264537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c41f37e7a40aac129466553a91e6d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal\" (UID: \"8c41f37e7a40aac129466553a91e6d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.264583 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.264556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c41f37e7a40aac129466553a91e6d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal\" (UID: \"8c41f37e7a40aac129466553a91e6d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.350833 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.350804    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.365158 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.365133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2e50227d65fda4050a8a8dd57637707-config\") pod \"kube-apiserver-proxy-ip-10-0-138-227.ec2.internal\" (UID: \"e2e50227d65fda4050a8a8dd57637707\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.365257 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.365164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c41f37e7a40aac129466553a91e6d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal\" (UID: \"8c41f37e7a40aac129466553a91e6d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.365257 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.365185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c41f37e7a40aac129466553a91e6d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal\" (UID: \"8c41f37e7a40aac129466553a91e6d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.365257 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.365232    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c41f37e7a40aac129466553a91e6d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal\" (UID: \"8c41f37e7a40aac129466553a91e6d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.365358 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.365250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2e50227d65fda4050a8a8dd57637707-config\") pod \"kube-apiserver-proxy-ip-10-0-138-227.ec2.internal\" (UID: \"e2e50227d65fda4050a8a8dd57637707\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.365358 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.365274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c41f37e7a40aac129466553a91e6d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal\" (UID: \"8c41f37e7a40aac129466553a91e6d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.451892 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.451836    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.552882 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.552840    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.553957 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.553943    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.559595 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.559577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:11.653563 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.653525    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.754066 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.753978    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.854462 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.854427    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.881811 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.881782    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:56:11.900500 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.900474    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 17:56:11.900627 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.900609    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 17:56:11.900684 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.900662    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 17:56:11.955014 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:11.954970    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-227.ec2.internal\" not found"
Jul 20 17:56:11.967414 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.967380    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 17:51:10 +0000 UTC" deadline="2028-05-06 18:56:29.320895654 +0000 UTC"
Jul 20 17:56:11.967414 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.967406    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15745h0m17.353492196s"
Jul 20 17:56:11.981764 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.981739    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:56:11.981955 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:11.981941    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:56:12.063109 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.063022    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:12.075737 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.075713    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 17:56:12.076694 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.076681    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal"
Jul 20 17:56:12.087376 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.087356    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 17:56:12.219912 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:12.219868    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c41f37e7a40aac129466553a91e6d57.slice/crio-e98ff8bd87bac70705a1672152a284752b8d66046c1194611af53349668edc83 WatchSource:0}: Error finding container e98ff8bd87bac70705a1672152a284752b8d66046c1194611af53349668edc83: Status 404 returned error can't find the container with id e98ff8bd87bac70705a1672152a284752b8d66046c1194611af53349668edc83
Jul 20 17:56:12.225501 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.225487    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 17:56:12.252476 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:12.252442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e50227d65fda4050a8a8dd57637707.slice/crio-54ca3e0baffdb323aee2e940f94f145b35ef43d831bc719b84c514fe40f36a59 WatchSource:0}: Error finding container 54ca3e0baffdb323aee2e940f94f145b35ef43d831bc719b84c514fe40f36a59: Status 404 returned error can't find the container with id 54ca3e0baffdb323aee2e940f94f145b35ef43d831bc719b84c514fe40f36a59
Jul 20 17:56:12.940556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.940524    2562 apiserver.go:52] "Watching apiserver"
Jul 20 17:56:12.948785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.948756    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 17:56:12.949324 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.949296    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-n6z62","kube-system/global-pull-secret-syncer-4ngwk","kube-system/konnectivity-agent-k5hxb","kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zhjsj","openshift-image-registry/node-ca-7nb5w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal","openshift-multus/multus-ctfsr","openshift-multus/network-metrics-daemon-lf44f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566","openshift-dns/node-resolver-fh7nh","openshift-multus/multus-additional-cni-plugins-nbkbs","openshift-network-diagnostics/network-check-target-2l8st","openshift-network-operator/iptables-alerter-kk8t4"]
Jul 20 17:56:12.950848 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.950824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:12.950962 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:12.950908    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:12.952515 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.952491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:12.952612 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:12.952567    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:12.953956 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.953931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:12.955242 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.955223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.957198 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.957178    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 17:56:12.957499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.957449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.957581 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.957511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 17:56:12.957707 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.957689    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.958484 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.958463    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 17:56:12.958694 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.958678    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6jj8h\""
Jul 20 17:56:12.958860 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.958843    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 17:56:12.958933 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.958893    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.959756 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.959737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:12.960287 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.960266    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 17:56:12.960287 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.960281    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dkn9l\""
Jul 20 17:56:12.960545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.960525    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.960621 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.960590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6m6xv\""
Jul 20 17:56:12.960792 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.960774    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 17:56:12.960858 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.960839    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.961168 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.961151    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:12.962353 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.962210    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.963110 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.962989    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 17:56:12.963110 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.963075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.963819 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.963653    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.963819 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.963688    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 17:56:12.965123 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.965091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:12.965215 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:12.965164    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:12.966290 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.966270    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.966753 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.966565    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jl7wq\""
Jul 20 17:56:12.966850 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.966772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mn7cb\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967340    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967402    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967460    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967662    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967688    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nf987\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.967778    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 17:56:12.968794 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.968637    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:12.970018 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.969998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:12.972785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.971487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7mp5\""
Jul 20 17:56:12.972785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.971756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:12.972785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.971834    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.972785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.972121    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 17:56:12.972785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.972131    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.972785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.972772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974122    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-slash\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974239    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lmvvp\""
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-cni-bin\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-netns\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-systemd\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-run-netns\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-systemd\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974373    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.974429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-cni-netd\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-cnibin\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4nt\" (UniqueName: \"kubernetes.io/projected/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-kube-api-access-gx4nt\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-systemd-units\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-modprobe-d\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovnkube-config\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-hostroot\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-daemon-config\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysconfig\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-iptables-alerter-script\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-socket-dir-parent\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvsfg\" (UniqueName: \"kubernetes.io/projected/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-kube-api-access-zvsfg\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:12.975052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.974982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-cni-bin\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovn-node-metrics-cert\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-kubelet\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975373    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-etc-kubernetes\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-kubernetes\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-etc-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-ovn\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-cni-binary-copy\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-cni-multus\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysctl-d\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-run\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-serviceca\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-log-socket\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975623    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7hjbp\""
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-host-slash\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:12.975662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-system-cni-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-cni-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64hf5\" (UniqueName: \"kubernetes.io/projected/700c7c9c-ee82-4111-bb57-3880047df00f-kube-api-access-64hf5\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-host\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975851    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e87f8a3-cd47-49ee-be63-c2927fcb7979-kubelet-config\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.975953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e87f8a3-cd47-49ee-be63-c2927fcb7979-dbus\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-kubelet\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-env-overrides\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovnkube-script-lib\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-multus-certs\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.976502 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqx2\" (UniqueName: \"kubernetes.io/projected/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-kube-api-access-rnqx2\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c50b271-9096-4c8e-b160-88a39aae285e-tmp\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/258a9c5e-92b3-40c1-9b7e-7f6c0e24a312-konnectivity-ca\") pod \"konnectivity-agent-k5hxb\" (UID: \"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312\") " pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-var-lib-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/258a9c5e-92b3-40c1-9b7e-7f6c0e24a312-agent-certs\") pod \"konnectivity-agent-k5hxb\" (UID: \"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312\") " pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtj7b\" (UniqueName: \"kubernetes.io/projected/1c50b271-9096-4c8e-b160-88a39aae285e-kube-api-access-jtj7b\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-os-release\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-conf-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-sys\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-k8s-cni-cncf-io\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysctl-conf\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.976993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c50b271-9096-4c8e-b160-88a39aae285e-etc-tuned\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.977019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwmr\" (UniqueName: \"kubernetes.io/projected/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-kube-api-access-nhwmr\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.977578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.977040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-host\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.977055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:12.977578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.977069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-node-log\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:12.977578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.977087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-lib-modules\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.977578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.977115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-var-lib-kubelet\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:12.995397 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:12.995374    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 17:56:13.024553 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.024531    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-49kqc"
Jul 20 17:56:13.033482 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.033460    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-49kqc"
Jul 20 17:56:13.063613 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.063584    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 17:56:13.077440 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-systemd\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.077440 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-run-netns\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-systemd\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-cni-netd\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-cnibin\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-systemd\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-systemd\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-run-netns\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4nt\" (UniqueName: \"kubernetes.io/projected/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-kube-api-access-gx4nt\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-cni-netd\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-cnibin\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.077648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkqt2\" (UniqueName: \"kubernetes.io/projected/d62d765d-1537-438b-b941-aded13f94331-kube-api-access-lkqt2\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-systemd-units\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-modprobe-d\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovnkube-config\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-systemd-units\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-hostroot\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-daemon-config\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysconfig\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077809    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-hostroot\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-modprobe-d\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-iptables-alerter-script\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-socket-dir-parent\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysconfig\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvsfg\" (UniqueName: \"kubernetes.io/projected/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-kube-api-access-zvsfg\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.077980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-socket-dir-parent\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.078275 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-cni-bin\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovn-node-metrics-cert\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-cni-bin\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-kubelet\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078131    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-kubelet\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-etc-kubernetes\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-kubernetes\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-sys-fs\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-etc-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-ovn\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-cni-binary-copy\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-cni-multus\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysctl-d\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-run\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.079082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-serviceca\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-log-socket\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078426    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-host-slash\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-system-cni-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovnkube-config\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-cni-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64hf5\" (UniqueName: \"kubernetes.io/projected/700c7c9c-ee82-4111-bb57-3880047df00f-kube-api-access-64hf5\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-host\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-daemon-config\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e87f8a3-cd47-49ee-be63-c2927fcb7979-kubelet-config\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e87f8a3-cd47-49ee-be63-c2927fcb7979-kubelet-config\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e87f8a3-cd47-49ee-be63-c2927fcb7979-dbus\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-run\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-kubelet\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-log-socket\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-env-overrides\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-etc-kubernetes\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.079763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovnkube-script-lib\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-kubernetes\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-multus-certs\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078751    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-cni-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-system-cni-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqx2\" (UniqueName: \"kubernetes.io/projected/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-kube-api-access-rnqx2\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-multus-certs\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078839    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-run-ovn\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078877    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-iptables-alerter-script\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-cni-multus\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-host-slash\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-host\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c50b271-9096-4c8e-b160-88a39aae285e-tmp\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-etc-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079455    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovnkube-script-lib\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.080635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-cnibin\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/258a9c5e-92b3-40c1-9b7e-7f6c0e24a312-konnectivity-ca\") pod \"konnectivity-agent-k5hxb\" (UID: \"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312\") " pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079839    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-cni-binary-copy\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.078670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysctl-d\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.079993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-serviceca\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e87f8a3-cd47-49ee-be63-c2927fcb7979-dbus\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-kubelet\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-var-lib-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/258a9c5e-92b3-40c1-9b7e-7f6c0e24a312-agent-certs\") pod \"konnectivity-agent-k5hxb\" (UID: \"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312\") " pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtj7b\" (UniqueName: \"kubernetes.io/projected/1c50b271-9096-4c8e-b160-88a39aae285e-kube-api-access-jtj7b\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-system-cni-dir\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-env-overrides\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.080432    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-var-lib-openvswitch\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.080498    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:56:13.580478262 +0000 UTC m=+2.946455832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:13.081525 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-os-release\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-conf-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/258a9c5e-92b3-40c1-9b7e-7f6c0e24a312-konnectivity-ca\") pod \"konnectivity-agent-k5hxb\" (UID: \"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312\") " pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-device-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-multus-conf-dir\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.080737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-os-release\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-sys\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239fc666-92b4-4452-900b-482d4c7e2ba4-tmp-dir\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7x2\" (UniqueName: \"kubernetes.io/projected/239fc666-92b4-4452-900b-482d4c7e2ba4-kube-api-access-dg7x2\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-os-release\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-cni-binary-copy\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m26f\" (UniqueName: \"kubernetes.io/projected/48d620a1-cb24-421a-bc76-ca5fa32d9663-kube-api-access-7m26f\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-k8s-cni-cncf-io\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysctl-conf\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c50b271-9096-4c8e-b160-88a39aae285e-etc-tuned\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwmr\" (UniqueName: \"kubernetes.io/projected/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-kube-api-access-nhwmr\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-host\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.082360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-node-log\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-lib-modules\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-var-lib-kubelet\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-sys\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-slash\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081701    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-host-slash\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081744    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-node-log\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.081852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-etc-sysctl-conf\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-lib-modules\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-ovn-node-metrics-cert\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-k8s-cni-cncf-io\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082555    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-host\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c50b271-9096-4c8e-b160-88a39aae285e-var-lib-kubelet\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.082678    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.082733    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:13.582718585 +0000 UTC m=+2.948696155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-cni-bin\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.083233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-socket-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/258a9c5e-92b3-40c1-9b7e-7f6c0e24a312-agent-certs\") pod \"konnectivity-agent-k5hxb\" (UID: \"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312\") " pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-registration-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-etc-selinux\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.082987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-var-lib-cni-bin\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.083015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.083057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-netns\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.083085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/239fc666-92b4-4452-900b-482d4c7e2ba4-hosts-file\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.083185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-host-run-netns\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.084094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.083793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c50b271-9096-4c8e-b160-88a39aae285e-etc-tuned\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.084808 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.084712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c50b271-9096-4c8e-b160-88a39aae285e-tmp\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.091426 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.091407    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvsfg\" (UniqueName: \"kubernetes.io/projected/c436eb21-6a9d-42b0-b279-e6f0fd9a2472-kube-api-access-zvsfg\") pod \"iptables-alerter-kk8t4\" (UID: \"c436eb21-6a9d-42b0-b279-e6f0fd9a2472\") " pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.092535 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.092517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4nt\" (UniqueName: \"kubernetes.io/projected/665c3b1c-31b8-4b1b-946f-04a54c4e2e4a-kube-api-access-gx4nt\") pod \"node-ca-7nb5w\" (UID: \"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a\") " pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.096283 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.096257    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:13.096389 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.096286    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:13.096389 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.096301    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:13.096389 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.096352    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:13.596336997 +0000 UTC m=+2.962314560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:13.097440 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.097414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtj7b\" (UniqueName: \"kubernetes.io/projected/1c50b271-9096-4c8e-b160-88a39aae285e-kube-api-access-jtj7b\") pod \"tuned-zhjsj\" (UID: \"1c50b271-9096-4c8e-b160-88a39aae285e\") " pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.098272 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.098241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64hf5\" (UniqueName: \"kubernetes.io/projected/700c7c9c-ee82-4111-bb57-3880047df00f-kube-api-access-64hf5\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:13.098554 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.098534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwmr\" (UniqueName: \"kubernetes.io/projected/6fcf9b7d-5fa6-4050-a34c-dec7da328da7-kube-api-access-nhwmr\") pod \"ovnkube-node-n6z62\" (UID: \"6fcf9b7d-5fa6-4050-a34c-dec7da328da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.098749 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.098726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqx2\" (UniqueName: \"kubernetes.io/projected/2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1-kube-api-access-rnqx2\") pod \"multus-ctfsr\" (UID: \"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1\") " pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.129817 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.129768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal" event={"ID":"e2e50227d65fda4050a8a8dd57637707","Type":"ContainerStarted","Data":"54ca3e0baffdb323aee2e940f94f145b35ef43d831bc719b84c514fe40f36a59"}
Jul 20 17:56:13.130697 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.130675    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal" event={"ID":"8c41f37e7a40aac129466553a91e6d57","Type":"ContainerStarted","Data":"e98ff8bd87bac70705a1672152a284752b8d66046c1194611af53349668edc83"}
Jul 20 17:56:13.184172 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-socket-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184172 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-registration-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-etc-selinux\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/239fc666-92b4-4452-900b-482d4c7e2ba4-hosts-file\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkqt2\" (UniqueName: \"kubernetes.io/projected/d62d765d-1537-438b-b941-aded13f94331-kube-api-access-lkqt2\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184280    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-registration-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184328    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-socket-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184328    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-etc-selinux\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/239fc666-92b4-4452-900b-482d4c7e2ba4-hosts-file\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.184381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-sys-fs\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-sys-fs\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-cnibin\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184445    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-system-cni-dir\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-system-cni-dir\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-cnibin\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-device-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239fc666-92b4-4452-900b-482d4c7e2ba4-tmp-dir\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d62d765d-1537-438b-b941-aded13f94331-device-dir\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7x2\" (UniqueName: \"kubernetes.io/projected/239fc666-92b4-4452-900b-482d4c7e2ba4-kube-api-access-dg7x2\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-os-release\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-cni-binary-copy\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m26f\" (UniqueName: \"kubernetes.io/projected/48d620a1-cb24-421a-bc76-ca5fa32d9663-kube-api-access-7m26f\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.184872 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48d620a1-cb24-421a-bc76-ca5fa32d9663-os-release\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.185407 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184809    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.185407 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239fc666-92b4-4452-900b-482d4c7e2ba4-tmp-dir\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.185407 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.184944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.185407 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.185113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d620a1-cb24-421a-bc76-ca5fa32d9663-cni-binary-copy\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.197082 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.197019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7x2\" (UniqueName: \"kubernetes.io/projected/239fc666-92b4-4452-900b-482d4c7e2ba4-kube-api-access-dg7x2\") pod \"node-resolver-fh7nh\" (UID: \"239fc666-92b4-4452-900b-482d4c7e2ba4\") " pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.197206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.197084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkqt2\" (UniqueName: \"kubernetes.io/projected/d62d765d-1537-438b-b941-aded13f94331-kube-api-access-lkqt2\") pod \"aws-ebs-csi-driver-node-5x566\" (UID: \"d62d765d-1537-438b-b941-aded13f94331\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.198247 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.198230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m26f\" (UniqueName: \"kubernetes.io/projected/48d620a1-cb24-421a-bc76-ca5fa32d9663-kube-api-access-7m26f\") pod \"multus-additional-cni-plugins-nbkbs\" (UID: \"48d620a1-cb24-421a-bc76-ca5fa32d9663\") " pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.269934 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.269901    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:13.278435 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.278411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:13.287350 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.287325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhjsj"
Jul 20 17:56:13.293003 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.292984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nb5w"
Jul 20 17:56:13.301620 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.301600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kk8t4"
Jul 20 17:56:13.308782 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.308759    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctfsr"
Jul 20 17:56:13.316486 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.316463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566"
Jul 20 17:56:13.323164 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.323141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fh7nh"
Jul 20 17:56:13.328075 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.328055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nbkbs"
Jul 20 17:56:13.331608 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.331590    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:56:13.587634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.587550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:13.587634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.587598    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:13.587854 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.587721    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:13.587854 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.587734    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:13.587854 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.587787    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:56:14.587764528 +0000 UTC m=+3.953742086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:13.587854 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.587810    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:14.587799491 +0000 UTC m=+3.953777049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:13.688132 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.688100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:13.688300 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.688242    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:13.688300 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.688259    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:13.688300 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.688269    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:13.688403 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:13.688313    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:14.688301069 +0000 UTC m=+4.054278626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:13.845038 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.844999    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c50b271_9096_4c8e_b160_88a39aae285e.slice/crio-24689276d997814a7c8e6cba45c866de31651f97a66e861c94ab2209ca01da0b WatchSource:0}: Error finding container 24689276d997814a7c8e6cba45c866de31651f97a66e861c94ab2209ca01da0b: Status 404 returned error can't find the container with id 24689276d997814a7c8e6cba45c866de31651f97a66e861c94ab2209ca01da0b
Jul 20 17:56:13.845299 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.845274    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62d765d_1537_438b_b941_aded13f94331.slice/crio-b3795e1771a319b7f7aaa575cfa6096b392b973886f3cc3f88ad0bf9bc71f7cd WatchSource:0}: Error finding container b3795e1771a319b7f7aaa575cfa6096b392b973886f3cc3f88ad0bf9bc71f7cd: Status 404 returned error can't find the container with id b3795e1771a319b7f7aaa575cfa6096b392b973886f3cc3f88ad0bf9bc71f7cd
Jul 20 17:56:13.848342 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.847834    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2edebb93_79b7_4a0b_9f4b_ab67a60c4cb1.slice/crio-57a57f85d822de0813955fd283a19deaf188c4447598da7499065317ba139037 WatchSource:0}: Error finding container 57a57f85d822de0813955fd283a19deaf188c4447598da7499065317ba139037: Status 404 returned error can't find the container with id 57a57f85d822de0813955fd283a19deaf188c4447598da7499065317ba139037
Jul 20 17:56:13.850004 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.849975    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239fc666_92b4_4452_900b_482d4c7e2ba4.slice/crio-03c8fd15636431c2b49cf1af207d61c8f832308b87ac7fc57c85637b301b1aba WatchSource:0}: Error finding container 03c8fd15636431c2b49cf1af207d61c8f832308b87ac7fc57c85637b301b1aba: Status 404 returned error can't find the container with id 03c8fd15636431c2b49cf1af207d61c8f832308b87ac7fc57c85637b301b1aba
Jul 20 17:56:13.850999 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.850975    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665c3b1c_31b8_4b1b_946f_04a54c4e2e4a.slice/crio-f3c275643324c6461f518e914dba115ad13895c5da3d7c9d6d5ae680fc14a0d4 WatchSource:0}: Error finding container f3c275643324c6461f518e914dba115ad13895c5da3d7c9d6d5ae680fc14a0d4: Status 404 returned error can't find the container with id f3c275643324c6461f518e914dba115ad13895c5da3d7c9d6d5ae680fc14a0d4
Jul 20 17:56:13.851638 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.851543    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc436eb21_6a9d_42b0_b279_e6f0fd9a2472.slice/crio-12c6e8bbfdb5d76cf8041f914d949c047e10419e8bac59e1c6c8fc2019573ea7 WatchSource:0}: Error finding container 12c6e8bbfdb5d76cf8041f914d949c047e10419e8bac59e1c6c8fc2019573ea7: Status 404 returned error can't find the container with id 12c6e8bbfdb5d76cf8041f914d949c047e10419e8bac59e1c6c8fc2019573ea7
Jul 20 17:56:13.853575 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.853442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258a9c5e_92b3_40c1_9b7e_7f6c0e24a312.slice/crio-3728dfa2c1ee4a9a69bf1fed84b02e6588d93954b2223cb7f6d4bd0520c62417 WatchSource:0}: Error finding container 3728dfa2c1ee4a9a69bf1fed84b02e6588d93954b2223cb7f6d4bd0520c62417: Status 404 returned error can't find the container with id 3728dfa2c1ee4a9a69bf1fed84b02e6588d93954b2223cb7f6d4bd0520c62417
Jul 20 17:56:13.854319 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.854298    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fcf9b7d_5fa6_4050_a34c_dec7da328da7.slice/crio-edd6b792430c8b5e5b263bea884e33a8d34ef83c706a4b1aaf90dbfa97615bcc WatchSource:0}: Error finding container edd6b792430c8b5e5b263bea884e33a8d34ef83c706a4b1aaf90dbfa97615bcc: Status 404 returned error can't find the container with id edd6b792430c8b5e5b263bea884e33a8d34ef83c706a4b1aaf90dbfa97615bcc
Jul 20 17:56:13.855863 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:13.855840    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d620a1_cb24_421a_bc76_ca5fa32d9663.slice/crio-8b286de86bdd9d458e5e190e96f8d32a081b36cb7a947a167829004bb71f9874 WatchSource:0}: Error finding container 8b286de86bdd9d458e5e190e96f8d32a081b36cb7a947a167829004bb71f9874: Status 404 returned error can't find the container with id 8b286de86bdd9d458e5e190e96f8d32a081b36cb7a947a167829004bb71f9874
Jul 20 17:56:13.945863 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:13.945837    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:56:14.035391 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.035322    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 17:51:13 +0000 UTC" deadline="2028-04-15 05:07:20.15969915 +0000 UTC"
Jul 20 17:56:14.035391 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.035375    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15227h11m6.124326598s"
Jul 20 17:56:14.125040 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.124815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:14.125159 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.124860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:14.125159 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.125110    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:14.125159 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.125138    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:14.134804 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.134778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nb5w" event={"ID":"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a","Type":"ContainerStarted","Data":"f3c275643324c6461f518e914dba115ad13895c5da3d7c9d6d5ae680fc14a0d4"}
Jul 20 17:56:14.135732 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.135712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fh7nh" event={"ID":"239fc666-92b4-4452-900b-482d4c7e2ba4","Type":"ContainerStarted","Data":"03c8fd15636431c2b49cf1af207d61c8f832308b87ac7fc57c85637b301b1aba"}
Jul 20 17:56:14.136735 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.136708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566" event={"ID":"d62d765d-1537-438b-b941-aded13f94331","Type":"ContainerStarted","Data":"b3795e1771a319b7f7aaa575cfa6096b392b973886f3cc3f88ad0bf9bc71f7cd"}
Jul 20 17:56:14.137623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.137604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhjsj" event={"ID":"1c50b271-9096-4c8e-b160-88a39aae285e","Type":"ContainerStarted","Data":"24689276d997814a7c8e6cba45c866de31651f97a66e861c94ab2209ca01da0b"}
Jul 20 17:56:14.138600 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.138575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerStarted","Data":"8b286de86bdd9d458e5e190e96f8d32a081b36cb7a947a167829004bb71f9874"}
Jul 20 17:56:14.139454 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.139437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctfsr" event={"ID":"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1","Type":"ContainerStarted","Data":"57a57f85d822de0813955fd283a19deaf188c4447598da7499065317ba139037"}
Jul 20 17:56:14.141134 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.141104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal" event={"ID":"e2e50227d65fda4050a8a8dd57637707","Type":"ContainerStarted","Data":"72a41c870944db37488a0d7f3a437c3425b97c3b1fa06b697e67dc4b9be79ba2"}
Jul 20 17:56:14.142146 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.142129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"edd6b792430c8b5e5b263bea884e33a8d34ef83c706a4b1aaf90dbfa97615bcc"}
Jul 20 17:56:14.143075 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.143057    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k5hxb" event={"ID":"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312","Type":"ContainerStarted","Data":"3728dfa2c1ee4a9a69bf1fed84b02e6588d93954b2223cb7f6d4bd0520c62417"}
Jul 20 17:56:14.143910 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.143895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kk8t4" event={"ID":"c436eb21-6a9d-42b0-b279-e6f0fd9a2472","Type":"ContainerStarted","Data":"12c6e8bbfdb5d76cf8041f914d949c047e10419e8bac59e1c6c8fc2019573ea7"}
Jul 20 17:56:14.157053 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.157017    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-227.ec2.internal" podStartSLOduration=2.157006597 podStartE2EDuration="2.157006597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:14.156750297 +0000 UTC m=+3.522727887" watchObservedRunningTime="2026-07-20 17:56:14.157006597 +0000 UTC m=+3.522984176"
Jul 20 17:56:14.595431 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.595335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:14.595431 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.595395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:14.595662 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.595540    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:14.595662 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.595599    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:16.595581896 +0000 UTC m=+5.961559456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:14.596022 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.596003    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:14.596113 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.596055    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:56:16.596040662 +0000 UTC m=+5.962018220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:14.697490 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:14.696833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:14.697490 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.697047    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:14.697490 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.697069    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:14.697490 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.697082    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:14.697490 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:14.697139    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:16.697121835 +0000 UTC m=+6.063099415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:15.035616 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:15.035535    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 17:51:13 +0000 UTC" deadline="2027-12-25 19:20:03.592093602 +0000 UTC"
Jul 20 17:56:15.035616 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:15.035575    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12553h23m48.556523089s"
Jul 20 17:56:15.131936 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:15.130140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:15.131936 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:15.130285    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:16.125324 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:16.125292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:16.125804 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.125419    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:16.125804 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:16.125798    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:16.125950 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.125901    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:16.614239 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:16.614155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:16.614407 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:16.614266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:16.614407 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.614394    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:16.614510 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.614464    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:56:20.61444468 +0000 UTC m=+9.980422237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:16.614891 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.614848    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:16.614992 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.614897    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:20.614882258 +0000 UTC m=+9.980859817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:16.716209 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:16.715538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:16.716209 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.715756    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:16.716209 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.715780    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:16.716209 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.715793    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:16.716209 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:16.715851    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:20.715833182 +0000 UTC m=+10.081810742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:17.127951 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:17.127904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:17.128402 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:17.128064    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:18.125616 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:18.125581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:18.125790 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:18.125630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:18.125790 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:18.125727    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:18.125911 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:18.125809    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:19.125124 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:19.125094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:19.125575 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:19.125252    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:20.125381 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:20.125331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:20.125815 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:20.125334    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:20.125815 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.125495    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:20.125815 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.125555    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:20.655716 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:20.655677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:20.655911 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:20.655744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:20.655911 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.655863    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:20.655911 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.655894    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:20.656104 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.655956    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:56:28.655934238 +0000 UTC m=+18.021911801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:20.656104 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.655975    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:28.655966702 +0000 UTC m=+18.021944260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:20.756584 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:20.756547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:20.756724 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.756711    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:20.756773 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.756732    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:20.756773 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.756746    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:20.756842 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:20.756808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:28.756789901 +0000 UTC m=+18.122767464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:21.126868 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:21.126601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:21.126868 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:21.126735    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:22.125695 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:22.125609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:22.125695 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:22.125638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:22.125893 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:22.125795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:22.125970 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:22.125892    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:23.125534 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:23.125502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:23.126021 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:23.125681    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:24.124935 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:24.124890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:24.125106 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:24.124890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:24.125106 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:24.125041    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:24.125106 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:24.125072    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:25.125290 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:25.125258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:25.125761 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:25.125398    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:26.124776 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:26.124737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:26.124776 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:26.124761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:26.125022 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:26.124858    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:26.125086 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:26.125023    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:27.125414 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:27.125383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:27.125876 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:27.125504    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:28.125648 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:28.125613    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:28.126113 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:28.125613    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:28.126113 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.125715    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:28.126113 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.125795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:28.720459 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:28.720417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:28.720734 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:28.720472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:28.720734 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.720584    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:28.720734 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.720585    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:28.720734 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.720653    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:44.72063268 +0000 UTC m=+34.086610243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:28.720734 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.720671    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:56:44.720661241 +0000 UTC m=+34.086638803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:28.821692 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:28.821648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:28.821861 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.821806    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:28.821861 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.821834    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:28.821861 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.821846    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:28.822033 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:28.821904    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:44.821890759 +0000 UTC m=+34.187868316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:29.125017 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:29.124939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:29.125175 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:29.125087    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:30.124828 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:30.124791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:30.125283 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:30.124791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:30.125283 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:30.124905    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:30.125283 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:30.125042    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:31.126357 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:31.126321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:31.126839 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:31.126488    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:32.125613 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:32.125580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:32.125792 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:32.125713    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:32.125792 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:32.125747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:32.125901 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:32.125822    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:33.126008 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.125555    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:33.126008 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:33.125954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:33.193652 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.193604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k5hxb" event={"ID":"258a9c5e-92b3-40c1-9b7e-7f6c0e24a312","Type":"ContainerStarted","Data":"3b2695674393f71b071cac724224a64da1431b464c438b7ba86f47582019aa24"}
Jul 20 17:56:33.194996 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.194969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nb5w" event={"ID":"665c3b1c-31b8-4b1b-946f-04a54c4e2e4a","Type":"ContainerStarted","Data":"d54515e842f165824d1a2e4bd54b1e1b3e506dfe9d96399bd7633b9201e76edd"}
Jul 20 17:56:33.196354 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.196332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fh7nh" event={"ID":"239fc666-92b4-4452-900b-482d4c7e2ba4","Type":"ContainerStarted","Data":"e418374bec4785a38e43683a2c98ad0199db9a0ddc910c4cf5ee5db1de487eae"}
Jul 20 17:56:33.197747 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.197710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566" event={"ID":"d62d765d-1537-438b-b941-aded13f94331","Type":"ContainerStarted","Data":"6939ae1eae4db59c1b7a577c2f0fdafc9ccb68b5fcfc13888e009b549c830204"}
Jul 20 17:56:33.199188 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.199167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhjsj" event={"ID":"1c50b271-9096-4c8e-b160-88a39aae285e","Type":"ContainerStarted","Data":"26fe2abed4ebfcf54b098e62ae543dbeb5bb20218e90c6d56ddb79f73a73213e"}
Jul 20 17:56:33.200433 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.200414    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c41f37e7a40aac129466553a91e6d57" containerID="1549f9462396d1d385b2488f7de9527623687fa96873aaaf9f44daf44fb309dc" exitCode=0
Jul 20 17:56:33.200506 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.200475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal" event={"ID":"8c41f37e7a40aac129466553a91e6d57","Type":"ContainerDied","Data":"1549f9462396d1d385b2488f7de9527623687fa96873aaaf9f44daf44fb309dc"}
Jul 20 17:56:33.201857 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.201839    2562 generic.go:356] "Generic (PLEG): container finished" podID="48d620a1-cb24-421a-bc76-ca5fa32d9663" containerID="d571624cd672cdebf707582379b0756d2f62df38f293b7626c1dccea8bf1950c" exitCode=0
Jul 20 17:56:33.201967 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.201910    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerDied","Data":"d571624cd672cdebf707582379b0756d2f62df38f293b7626c1dccea8bf1950c"}
Jul 20 17:56:33.203351 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.203327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctfsr" event={"ID":"2edebb93-79b7-4a0b-9f4b-ab67a60c4cb1","Type":"ContainerStarted","Data":"25c017fb656698f511a48d225c23b352e4cad9cc25d436e1ff4e57aa00d240b4"}
Jul 20 17:56:33.205209 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.205190    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"7f136b1dd0707721845a78e9db7fa56c1e7207908e08f81c1b8b58d04865aa74"}
Jul 20 17:56:33.205280 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.205244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"88136222fccbbecc1d5a41ec1c8fe0aefb920085cbea44177dd3b996f306724a"}
Jul 20 17:56:33.205280 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.205275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"a670edfa41fa50750032f354a57bf763e93f9d2cd1e2f287eb8a97fc5ddcabf4"}
Jul 20 17:56:33.209397 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.209351    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k5hxb" podStartSLOduration=11.686896645000001 podStartE2EDuration="22.209335954s" totalImagesPullingTime="10.522439309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:33.209307725 +0000 UTC m=+22.575285321" watchObservedRunningTime="2026-07-20 17:56:33.209335954 +0000 UTC m=+22.575313538"
Jul 20 17:56:33.227471 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.227420    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zhjsj" podStartSLOduration=3.327257683 podStartE2EDuration="22.227404021s" totalImagesPullingTime="18.900146338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:33.227120936 +0000 UTC m=+22.593098534" watchObservedRunningTime="2026-07-20 17:56:33.227404021 +0000 UTC m=+22.593381600"
Jul 20 17:56:33.245964 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.245714    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7nb5w" podStartSLOduration=3.355861147 podStartE2EDuration="22.245697498s" totalImagesPullingTime="18.889836351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:33.245287956 +0000 UTC m=+22.611265571" watchObservedRunningTime="2026-07-20 17:56:33.245697498 +0000 UTC m=+22.611675079"
Jul 20 17:56:33.262494 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.262452    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ctfsr" podStartSLOduration=3.315412246 podStartE2EDuration="22.262431864s" totalImagesPullingTime="18.947019618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:33.262362346 +0000 UTC m=+22.628339925" watchObservedRunningTime="2026-07-20 17:56:33.262431864 +0000 UTC m=+22.628409444"
Jul 20 17:56:33.301243 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.301195    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fh7nh" podStartSLOduration=3.699304525 podStartE2EDuration="22.301179233s" totalImagesPullingTime="18.601874708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:33.279872398 +0000 UTC m=+22.645849978" watchObservedRunningTime="2026-07-20 17:56:33.301179233 +0000 UTC m=+22.667156861"
Jul 20 17:56:33.409499 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.409465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:33.505493 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.505446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:33.705344 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:33.705247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:34.125657 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.125624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:34.125837 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.125624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:34.125837 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:34.125754    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:34.125970 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:34.125866    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:34.208767 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.208735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal" event={"ID":"8c41f37e7a40aac129466553a91e6d57","Type":"ContainerStarted","Data":"4f5321e0716865744cbaf9383e1dc76d6fbdd83b0a807763e2848f24830acec5"}
Jul 20 17:56:34.211439 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.211411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"7376db8d00fdb25de51ea5e9fa05561450529e047328cb96bb78391ea98f45c3"}
Jul 20 17:56:34.211556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.211492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"70b1aff5df59c772f25f2c6bf5d609b0f1032c8f08f79629e5a16d7169c25777"}
Jul 20 17:56:34.211556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.211541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"11620cd748e4dd45aa9358b973d4fd0d2aeac5ff75bc65696580ec1111a3002b"}
Jul 20 17:56:34.212804 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.212783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kk8t4" event={"ID":"c436eb21-6a9d-42b0-b279-e6f0fd9a2472","Type":"ContainerStarted","Data":"f5ac87b73d9acff22cc4c605c4b343500260e0844b364db309a8004e211e1e3b"}
Jul 20 17:56:34.239029 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.238983    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-227.ec2.internal" podStartSLOduration=22.238968928 podStartE2EDuration="22.238968928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:34.224737891 +0000 UTC m=+23.590715470" watchObservedRunningTime="2026-07-20 17:56:34.238968928 +0000 UTC m=+23.604946506"
Jul 20 17:56:34.375971 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.375892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:34.635536 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.635476    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 17:56:34.771392 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.771354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:34.828997 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:34.828959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:35.041002 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.040833    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T17:56:34.635496866Z","UUID":"998b0072-49fa-4860-95ac-12720003581a","Handler":null,"Name":"","Endpoint":""}
Jul 20 17:56:35.042682 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.042656    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 17:56:35.042836 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.042701    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 17:56:35.125080 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.125041    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:35.125318 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:35.125156    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:35.217657 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.217621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566" event={"ID":"d62d765d-1537-438b-b941-aded13f94331","Type":"ContainerStarted","Data":"2c14bd6e46fb741c59cd9d9558f3913972ae22299b1cf54be9dc8e1e5f64f9a9"}
Jul 20 17:56:35.545305 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.545254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:35.935970 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.935940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:35.993587 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:35.993551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:36.125336 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.125301    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:36.125336 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.125334    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:36.125583 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:36.125434    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:36.125583 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:36.125562    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:36.211845 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.211761    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:36.212362 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.212345    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:36.222422 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.222392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"256cf7727983419cb82b58989b4753560d777ebe8af83f9b3e3f0495d3e8d0c5"}
Jul 20 17:56:36.224303 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.224282    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566" event={"ID":"d62d765d-1537-438b-b941-aded13f94331","Type":"ContainerStarted","Data":"f514861e773aa2a890d8552a8921daf9516ed37f353616b92d66dc6af4bca014"}
Jul 20 17:56:36.224450 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.224432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:36.224909 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.224892    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k5hxb"
Jul 20 17:56:36.227854 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.227810    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kk8t4" podStartSLOduration=6.335885884 podStartE2EDuration="25.227795575s" totalImagesPullingTime="18.891909691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:34.238737544 +0000 UTC m=+23.604715122" watchObservedRunningTime="2026-07-20 17:56:36.227795575 +0000 UTC m=+25.593773155"
Jul 20 17:56:36.243859 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.243820    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5x566" podStartSLOduration=3.68924327 podStartE2EDuration="25.243804806s" totalImagesPullingTime="21.554561536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:36.243636358 +0000 UTC m=+25.609613949" watchObservedRunningTime="2026-07-20 17:56:36.243804806 +0000 UTC m=+25.609782387"
Jul 20 17:56:36.317563 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.317517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:36.728649 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.728602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:36.783763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:36.783715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:37.125601 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:37.125553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:37.125771 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:37.125744    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:37.138686 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:37.138659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:37.198056 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:37.198018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:38.125846 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:38.125672    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:38.126221 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:38.125672    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:38.126221 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:38.125945    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:38.126221 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:38.126036    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:38.694428 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:38.694355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:39.124904 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.124873    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:39.125080 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:39.125029    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:39.241934 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.241832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" event={"ID":"6fcf9b7d-5fa6-4050-a34c-dec7da328da7","Type":"ContainerStarted","Data":"56e7b5d9327d9dff14565ed6ed0f44f3cdce342d1ebb1f6b711f4094f1a5d2cf"}
Jul 20 17:56:39.242833 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.242140    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:39.243695 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.243672    2562 generic.go:356] "Generic (PLEG): container finished" podID="48d620a1-cb24-421a-bc76-ca5fa32d9663" containerID="c239e72b76d09f34566d0758e8afe5f37b928fe919b30e02430bfa0d9176aa92" exitCode=0
Jul 20 17:56:39.243805 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.243704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerDied","Data":"c239e72b76d09f34566d0758e8afe5f37b928fe919b30e02430bfa0d9176aa92"}
Jul 20 17:56:39.257775 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.257753    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:39.270633 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:39.270582    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62" podStartSLOduration=9.310667918 podStartE2EDuration="28.270568546s" totalImagesPullingTime="18.959900628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:39.270423371 +0000 UTC m=+28.636400964" watchObservedRunningTime="2026-07-20 17:56:39.270568546 +0000 UTC m=+28.636546124"
Jul 20 17:56:40.125619 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.125444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:40.125810 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.125444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:40.125810 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:40.125719    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:40.125810 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:40.125775    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:40.246355 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.246327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:40.246788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.246402    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:40.262273 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.262246    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:56:40.270173 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.270143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4ngwk"]
Jul 20 17:56:40.270323 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.270240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:40.270379 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:40.270334    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:40.273064 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.273042    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2l8st"]
Jul 20 17:56:40.273164 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.273128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:40.273241 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:40.273221    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:40.285182 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.285081    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lf44f"]
Jul 20 17:56:40.285311 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:40.285198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:40.285311 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:40.285297    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:41.250177 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:41.250149    2562 generic.go:356] "Generic (PLEG): container finished" podID="48d620a1-cb24-421a-bc76-ca5fa32d9663" containerID="1a8949c45eb11fcf67cef410012202b54e0e8a363c37636312bbad784ac97f32" exitCode=0
Jul 20 17:56:41.250459 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:41.250235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerDied","Data":"1a8949c45eb11fcf67cef410012202b54e0e8a363c37636312bbad784ac97f32"}
Jul 20 17:56:41.723588 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:41.723559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:41.785046 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:41.784991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:42.125485 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:42.125453    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:42.125631 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:42.125468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:42.125631 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:42.125564    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:42.125631 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:42.125569    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:42.125776 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:42.125630    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:42.125776 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:42.125711    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:43.257610 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:43.257412    2562 generic.go:356] "Generic (PLEG): container finished" podID="48d620a1-cb24-421a-bc76-ca5fa32d9663" containerID="1d46778a7c9012112ca3eba4522cd3a1772ed8c9797cf398a031d9ebfef39dc2" exitCode=0
Jul 20 17:56:43.257610 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:43.257500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerDied","Data":"1d46778a7c9012112ca3eba4522cd3a1772ed8c9797cf398a031d9ebfef39dc2"}
Jul 20 17:56:44.125474 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:44.125442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:44.125634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:44.125442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:44.125634 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.125560    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ngwk" podUID="7e87f8a3-cd47-49ee-be63-c2927fcb7979"
Jul 20 17:56:44.125634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:44.125442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:44.125634 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.125619    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf44f" podUID="700c7c9c-ee82-4111-bb57-3880047df00f"
Jul 20 17:56:44.125851 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.125697    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l8st" podUID="da571bd4-177c-4775-85f6-3d25d5311de3"
Jul 20 17:56:44.743859 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:44.743814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:44.743859 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:44.743867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:44.744302 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.743972    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:44.744302 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.743989    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:44.744302 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.744026    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret podName:7e87f8a3-cd47-49ee-be63-c2927fcb7979 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:16.744011291 +0000 UTC m=+66.109988848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret") pod "global-pull-secret-syncer-4ngwk" (UID: "7e87f8a3-cd47-49ee-be63-c2927fcb7979") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:56:44.744302 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.744040    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:57:16.744033776 +0000 UTC m=+66.110011332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:56:44.845028 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:44.844999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:44.845195 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.845125    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:56:44.845195 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.845143    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:56:44.845195 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.845151    2562 projected.go:196] Error preparing data for projected volume kube-api-access-kjnxv for pod openshift-network-diagnostics/network-check-target-2l8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:44.845290 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:44.845201    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv podName:da571bd4-177c-4775-85f6-3d25d5311de3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:16.845186654 +0000 UTC m=+66.211164230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjnxv" (UniqueName: "kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv") pod "network-check-target-2l8st" (UID: "da571bd4-177c-4775-85f6-3d25d5311de3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:56:45.505060 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.505034    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-227.ec2.internal" event="NodeReady"
Jul 20 17:56:45.505215 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.505177    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 17:56:45.553709 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.553630    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xfhzz"]
Jul 20 17:56:45.555880 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.555834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.556656 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.556636    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jb7wt"]
Jul 20 17:56:45.558527 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.558507    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.559092 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.559041    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 17:56:45.559092 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.559081    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m6nkv\""
Jul 20 17:56:45.559526 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.559502    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 17:56:45.561222 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.561203    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 17:56:45.561387 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.561365    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 17:56:45.561461 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.561404    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9mph2\""
Jul 20 17:56:45.561461 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.561451    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 17:56:45.568259 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.568232    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jb7wt"]
Jul 20 17:56:45.573185 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.573053    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xfhzz"]
Jul 20 17:56:45.651854 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.651783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.651854 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.651826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52773415-b6f1-4a86-9bfa-d23c15838389-tmp-dir\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.652190 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.651869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52773415-b6f1-4a86-9bfa-d23c15838389-config-volume\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.652190 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.651892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsx2p\" (UniqueName: \"kubernetes.io/projected/52773415-b6f1-4a86-9bfa-d23c15838389-kube-api-access-fsx2p\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.753204 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.753161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52773415-b6f1-4a86-9bfa-d23c15838389-config-volume\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.753204 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.753195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsx2p\" (UniqueName: \"kubernetes.io/projected/52773415-b6f1-4a86-9bfa-d23c15838389-kube-api-access-fsx2p\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.753788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.753287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.753788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.753320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52773415-b6f1-4a86-9bfa-d23c15838389-tmp-dir\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.753788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.753345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fa31b52-0023-490e-af0a-44e4ebda95ba-cert\") pod \"ingress-canary-jb7wt\" (UID: \"9fa31b52-0023-490e-af0a-44e4ebda95ba\") " pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.753788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.753429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkhc\" (UniqueName: \"kubernetes.io/projected/9fa31b52-0023-490e-af0a-44e4ebda95ba-kube-api-access-skkhc\") pod \"ingress-canary-jb7wt\" (UID: \"9fa31b52-0023-490e-af0a-44e4ebda95ba\") " pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.753788 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:45.753466    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:56:45.754065 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:45.754016    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:46.253867638 +0000 UTC m=+35.619845203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:56:45.754205 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.754181    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52773415-b6f1-4a86-9bfa-d23c15838389-tmp-dir\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.754548 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.754521    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52773415-b6f1-4a86-9bfa-d23c15838389-config-volume\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.767464 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.767437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsx2p\" (UniqueName: \"kubernetes.io/projected/52773415-b6f1-4a86-9bfa-d23c15838389-kube-api-access-fsx2p\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:45.855385 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.855295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkhc\" (UniqueName: \"kubernetes.io/projected/9fa31b52-0023-490e-af0a-44e4ebda95ba-kube-api-access-skkhc\") pod \"ingress-canary-jb7wt\" (UID: \"9fa31b52-0023-490e-af0a-44e4ebda95ba\") " pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.855536 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.855453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fa31b52-0023-490e-af0a-44e4ebda95ba-cert\") pod \"ingress-canary-jb7wt\" (UID: \"9fa31b52-0023-490e-af0a-44e4ebda95ba\") " pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.857949 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.857909    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fa31b52-0023-490e-af0a-44e4ebda95ba-cert\") pod \"ingress-canary-jb7wt\" (UID: \"9fa31b52-0023-490e-af0a-44e4ebda95ba\") " pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.864382 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.864348    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkhc\" (UniqueName: \"kubernetes.io/projected/9fa31b52-0023-490e-af0a-44e4ebda95ba-kube-api-access-skkhc\") pod \"ingress-canary-jb7wt\" (UID: \"9fa31b52-0023-490e-af0a-44e4ebda95ba\") " pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:45.875302 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:45.875273    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jb7wt"
Jul 20 17:56:46.030906 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.030874    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jb7wt"]
Jul 20 17:56:46.034892 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:56:46.034861    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa31b52_0023_490e_af0a_44e4ebda95ba.slice/crio-5ac9d6915f63ab736b6154f35b3488752fec04fecb4973be6b8586b610243dcf WatchSource:0}: Error finding container 5ac9d6915f63ab736b6154f35b3488752fec04fecb4973be6b8586b610243dcf: Status 404 returned error can't find the container with id 5ac9d6915f63ab736b6154f35b3488752fec04fecb4973be6b8586b610243dcf
Jul 20 17:56:46.125446 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.125357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:56:46.125446 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.125380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:56:46.125667 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.125364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:56:46.128594 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.128573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 17:56:46.128720 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.128667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 17:56:46.128787 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.128739    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rwl6b\""
Jul 20 17:56:46.128907 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.128801    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 17:56:46.128907 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.128842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nnhlg\""
Jul 20 17:56:46.128907 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.128866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 17:56:46.258725 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.258684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:46.258958 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:46.258828    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:56:46.258958 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:46.258937    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:47.25889949 +0000 UTC m=+36.624877049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:56:46.266117 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:46.266085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jb7wt" event={"ID":"9fa31b52-0023-490e-af0a-44e4ebda95ba","Type":"ContainerStarted","Data":"5ac9d6915f63ab736b6154f35b3488752fec04fecb4973be6b8586b610243dcf"}
Jul 20 17:56:47.265865 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:47.265831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:47.266750 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:47.265976    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:56:47.266750 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:47.266045    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:49.266027056 +0000 UTC m=+38.632004616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:56:49.281636 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:49.281435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:49.282114 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:49.281600    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:56:49.282114 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:49.281764    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:56:53.281746913 +0000 UTC m=+42.647724470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:56:50.246357 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.246272    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:50.277398 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.277364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jb7wt" event={"ID":"9fa31b52-0023-490e-af0a-44e4ebda95ba","Type":"ContainerStarted","Data":"fa895ca26f1537d2c6c4968780cc76cb040b4259b91b6e4bd3f3c6ed25129623"}
Jul 20 17:56:50.279981 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.279956    2562 generic.go:356] "Generic (PLEG): container finished" podID="48d620a1-cb24-421a-bc76-ca5fa32d9663" containerID="3a7abf35b6c3f70443f55f87620552ce69d37f35a07b368e3cbb9a92c5bdc46d" exitCode=0
Jul 20 17:56:50.280091 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.279994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerDied","Data":"3a7abf35b6c3f70443f55f87620552ce69d37f35a07b368e3cbb9a92c5bdc46d"}
Jul 20 17:56:50.295910 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.295034    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jb7wt" podStartSLOduration=1.5272943749999999 podStartE2EDuration="5.295014856s" totalImagesPullingTime="3.767720481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:50.294424984 +0000 UTC m=+39.660402565" watchObservedRunningTime="2026-07-20 17:56:50.295014856 +0000 UTC m=+39.660992413"
Jul 20 17:56:50.327854 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.327817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:50.700139 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:50.700102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:51.285026 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:51.284997    2562 generic.go:356] "Generic (PLEG): container finished" podID="48d620a1-cb24-421a-bc76-ca5fa32d9663" containerID="8a74b8a244860ded32e7ced8fffc1b2d41126f14388d88b256d711e1996903ce" exitCode=0
Jul 20 17:56:51.285200 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:51.285085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerDied","Data":"8a74b8a244860ded32e7ced8fffc1b2d41126f14388d88b256d711e1996903ce"}
Jul 20 17:56:51.625790 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:51.625704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:51.680103 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:51.680074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:52.290691 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:52.290661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" event={"ID":"48d620a1-cb24-421a-bc76-ca5fa32d9663","Type":"ContainerStarted","Data":"f5f9231b2495ae8a3b1733df47a4c992d0f9200f3d640cbbdcbaea7d51b46b73"}
Jul 20 17:56:52.314569 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:52.314521    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nbkbs" podStartSLOduration=8.194123361 podStartE2EDuration="41.314506198s" totalImagesPullingTime="33.120382837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:52.31282543 +0000 UTC m=+41.678803029" watchObservedRunningTime="2026-07-20 17:56:52.314506198 +0000 UTC m=+41.680483777"
Jul 20 17:56:52.435097 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:52.435055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:52.534498 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:52.534467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:52.781743 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:52.781710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:52.855705 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:52.855673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:53.309629 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:53.309594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:56:53.309802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:53.309717    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:56:53.309802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:56:53.309787    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:01.309767782 +0000 UTC m=+50.675745343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:56:55.569209 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:55.569170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:55.626640 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:56:55.626601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:01.360900 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:01.360860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:57:01.361459 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:01.361043    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:57:01.361459 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:01.361135    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:17.361112097 +0000 UTC m=+66.727089662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:57:07.497713 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:07.497677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:09.320475 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:09.320442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:12.267310 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:12.267285    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6z62"
Jul 20 17:57:12.441595 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:12.441557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:12.691491 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:12.691399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:13.392578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:13.392545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:13.462742 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:13.462706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:16.765805 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.765750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:57:16.765805 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.765811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:57:16.768784 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.768754    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 17:57:16.768784 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.768783    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 17:57:16.776881 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:16.776856    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 17:57:16.776986 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:16.776953    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs podName:700c7c9c-ee82-4111-bb57-3880047df00f nodeName:}" failed. No retries permitted until 2026-07-20 17:58:20.776931382 +0000 UTC m=+130.142908954 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs") pod "network-metrics-daemon-lf44f" (UID: "700c7c9c-ee82-4111-bb57-3880047df00f") : secret "metrics-daemon-secret" not found
Jul 20 17:57:16.780293 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.780275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e87f8a3-cd47-49ee-be63-c2927fcb7979-original-pull-secret\") pod \"global-pull-secret-syncer-4ngwk\" (UID: \"7e87f8a3-cd47-49ee-be63-c2927fcb7979\") " pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:57:16.866760 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.866709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:57:16.869602 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.869585    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 17:57:16.880375 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.880351    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 17:57:16.890846 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:16.890823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnxv\" (UniqueName: \"kubernetes.io/projected/da571bd4-177c-4775-85f6-3d25d5311de3-kube-api-access-kjnxv\") pod \"network-check-target-2l8st\" (UID: \"da571bd4-177c-4775-85f6-3d25d5311de3\") " pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:57:17.044675 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.044581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ngwk"
Jul 20 17:57:17.053151 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.053126    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rwl6b\""
Jul 20 17:57:17.060640 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.060619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:57:17.175798 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.175767    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4ngwk"]
Jul 20 17:57:17.178439 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:57:17.178413    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e87f8a3_cd47_49ee_be63_c2927fcb7979.slice/crio-84758577cf9e19578b8ba56f8ef28980f74ec31e879b20e094febc97dc2b5173 WatchSource:0}: Error finding container 84758577cf9e19578b8ba56f8ef28980f74ec31e879b20e094febc97dc2b5173: Status 404 returned error can't find the container with id 84758577cf9e19578b8ba56f8ef28980f74ec31e879b20e094febc97dc2b5173
Jul 20 17:57:17.192081 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.192054    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2l8st"]
Jul 20 17:57:17.195103 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:57:17.195074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda571bd4_177c_4775_85f6_3d25d5311de3.slice/crio-55a0e8152ec51372ba942ef9ad68304a3895ddafc36f397f6bb63615eb16e5c1 WatchSource:0}: Error finding container 55a0e8152ec51372ba942ef9ad68304a3895ddafc36f397f6bb63615eb16e5c1: Status 404 returned error can't find the container with id 55a0e8152ec51372ba942ef9ad68304a3895ddafc36f397f6bb63615eb16e5c1
Jul 20 17:57:17.349566 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.349477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2l8st" event={"ID":"da571bd4-177c-4775-85f6-3d25d5311de3","Type":"ContainerStarted","Data":"55a0e8152ec51372ba942ef9ad68304a3895ddafc36f397f6bb63615eb16e5c1"}
Jul 20 17:57:17.350549 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.350522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4ngwk" event={"ID":"7e87f8a3-cd47-49ee-be63-c2927fcb7979","Type":"ContainerStarted","Data":"84758577cf9e19578b8ba56f8ef28980f74ec31e879b20e094febc97dc2b5173"}
Jul 20 17:57:17.370704 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:17.370679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:57:17.370802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:17.370789    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:57:17.370854 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:17.370846    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:49.370830682 +0000 UTC m=+98.736808239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:57:22.365375 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:22.365342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2l8st" event={"ID":"da571bd4-177c-4775-85f6-3d25d5311de3","Type":"ContainerStarted","Data":"65ba18fdb9dbe1255a62c7a82da61a86e8aee891a13ad64dbdb1eb9a4e083277"}
Jul 20 17:57:22.365778 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:22.365467    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:57:22.366826 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:22.366805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4ngwk" event={"ID":"7e87f8a3-cd47-49ee-be63-c2927fcb7979","Type":"ContainerStarted","Data":"a4a740f982344680fe3b7d9261c95361036ac52fbc443ff9682ce40ce5247ecd"}
Jul 20 17:57:22.389270 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:22.389227    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2l8st" podStartSLOduration=66.65464379 podStartE2EDuration="1m11.389214379s" totalImagesPullingTime="4.734570589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:57:22.388568845 +0000 UTC m=+71.754546441" watchObservedRunningTime="2026-07-20 17:57:22.389214379 +0000 UTC m=+71.755191957"
Jul 20 17:57:35.867589 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:35.867556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:40.532575 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.532520    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4ngwk" podStartSLOduration=84.775838583 podStartE2EDuration="1m29.532503142s" totalImagesPullingTime="4.756664559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:57:22.406757755 +0000 UTC m=+71.772735335" watchObservedRunningTime="2026-07-20 17:57:40.532503142 +0000 UTC m=+89.898480720"
Jul 20 17:57:40.533039 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.532841    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84b9f6bdc8-jsqhx"]
Jul 20 17:57:40.535603 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.535585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.542228 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.542199    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 17:57:40.542367 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.542347    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 17:57:40.542445 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.542205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bs4zp\""
Jul 20 17:57:40.545503 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.545440    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 17:57:40.545503 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.545457    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 17:57:40.545899 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.545883    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 17:57:40.546870 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.546857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 17:57:40.568292 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.568269    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84b9f6bdc8-jsqhx"]
Jul 20 17:57:40.626206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.626175    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"]
Jul 20 17:57:40.626434 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.626411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.626479 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.626445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqghs\" (UniqueName: \"kubernetes.io/projected/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-kube-api-access-jqghs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.626479 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.626472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-default-certificate\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.626565 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.626542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.626602 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.626588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-stats-auth\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.628016 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.628003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.630659 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.630636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 17:57:40.630756 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.630740    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 17:57:40.631765 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.631748    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 17:57:40.631830 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.631815    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tzqnj\""
Jul 20 17:57:40.631927 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.631876    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 17:57:40.637415 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.637395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"]
Jul 20 17:57:40.720423 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.720387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:40.727093 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-default-certificate\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.727237 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7c52581-b3d6-4579-8217-61140f17d5f3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.727237 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.727237 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fss9\" (UniqueName: \"kubernetes.io/projected/e7c52581-b3d6-4579-8217-61140f17d5f3-kube-api-access-4fss9\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.727237 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-stats-auth\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.727393 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:40.727255    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:41.227235008 +0000 UTC m=+90.593212582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : configmap references non-existent config key: service-ca.crt
Jul 20 17:57:40.727393 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.727500 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.727500 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.727430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqghs\" (UniqueName: \"kubernetes.io/projected/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-kube-api-access-jqghs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.727594 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:40.727542    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:57:40.727642 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:40.727609    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:41.22759026 +0000 UTC m=+90.593567832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : secret "router-metrics-certs-default" not found
Jul 20 17:57:40.729532 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.729513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-stats-auth\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.729532 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.729526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-default-certificate\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.737322 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.737303    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqghs\" (UniqueName: \"kubernetes.io/projected/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-kube-api-access-jqghs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:40.821558 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.821466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:40.828433 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.828408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.828541 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.828456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7c52581-b3d6-4579-8217-61140f17d5f3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.828541 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.828498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fss9\" (UniqueName: \"kubernetes.io/projected/e7c52581-b3d6-4579-8217-61140f17d5f3-kube-api-access-4fss9\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.828610 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:40.828557    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:40.828643 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:40.828630    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls podName:e7c52581-b3d6-4579-8217-61140f17d5f3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:41.328611046 +0000 UTC m=+90.694588614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8n2j9" (UID: "e7c52581-b3d6-4579-8217-61140f17d5f3") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:40.829206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.829187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7c52581-b3d6-4579-8217-61140f17d5f3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:40.837291 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:40.837262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fss9\" (UniqueName: \"kubernetes.io/projected/e7c52581-b3d6-4579-8217-61140f17d5f3-kube-api-access-4fss9\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:41.232084 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:41.231994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:41.232084 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:41.232050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:41.232266 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:41.232138    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:57:41.232266 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:41.232178    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:42.232164912 +0000 UTC m=+91.598142469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : configmap references non-existent config key: service-ca.crt
Jul 20 17:57:41.232266 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:41.232198    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:42.232185421 +0000 UTC m=+91.598162977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : secret "router-metrics-certs-default" not found
Jul 20 17:57:41.333008 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:41.332968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:41.333257 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:41.333109    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:41.333257 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:41.333172    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls podName:e7c52581-b3d6-4579-8217-61140f17d5f3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:42.333156458 +0000 UTC m=+91.699134016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8n2j9" (UID: "e7c52581-b3d6-4579-8217-61140f17d5f3") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:42.238961 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.238906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:42.239355 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.238986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:42.239355 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.239074    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:57:42.239355 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.239134    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:44.239119827 +0000 UTC m=+93.605097384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : configmap references non-existent config key: service-ca.crt
Jul 20 17:57:42.239355 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.239150    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:44.239143776 +0000 UTC m=+93.605121332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : secret "router-metrics-certs-default" not found
Jul 20 17:57:42.339508 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.339460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:42.339707 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.339629    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:42.339772 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.339709    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls podName:e7c52581-b3d6-4579-8217-61140f17d5f3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:44.339690306 +0000 UTC m=+93.705667865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8n2j9" (UID: "e7c52581-b3d6-4579-8217-61140f17d5f3") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:42.507782 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.507748    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"]
Jul 20 17:57:42.510007 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.509989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:42.514542 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.514509    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 17:57:42.514542 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.514532    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 17:57:42.515515 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.515496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:57:42.515515 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.515510    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rztx7\""
Jul 20 17:57:42.523279 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.523256    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"]
Jul 20 17:57:42.641749 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.641709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:42.641749 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.641748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7v7\" (UniqueName: \"kubernetes.io/projected/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-kube-api-access-6x7v7\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:42.742323 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.742275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:42.742323 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.742328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7v7\" (UniqueName: \"kubernetes.io/projected/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-kube-api-access-6x7v7\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:42.742498 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.742438    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 17:57:42.742533 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:42.742515    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls podName:50b8d0ec-8f68-4bff-a9bd-edbd36297e4e nodeName:}" failed. No retries permitted until 2026-07-20 17:57:43.242496314 +0000 UTC m=+92.608473882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2httt" (UID: "50b8d0ec-8f68-4bff-a9bd-edbd36297e4e") : secret "samples-operator-tls" not found
Jul 20 17:57:42.752042 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:42.752011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7v7\" (UniqueName: \"kubernetes.io/projected/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-kube-api-access-6x7v7\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:43.247738 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:43.247696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:43.248271 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:43.247874    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 17:57:43.248271 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:43.247980    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls podName:50b8d0ec-8f68-4bff-a9bd-edbd36297e4e nodeName:}" failed. No retries permitted until 2026-07-20 17:57:44.24795832 +0000 UTC m=+93.613935880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2httt" (UID: "50b8d0ec-8f68-4bff-a9bd-edbd36297e4e") : secret "samples-operator-tls" not found
Jul 20 17:57:44.256635 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:44.256599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:44.256714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:44.256746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.256787    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:48.256769817 +0000 UTC m=+97.622747374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : configmap references non-existent config key: service-ca.crt
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.256826    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.256839    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.256892    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls podName:50b8d0ec-8f68-4bff-a9bd-edbd36297e4e nodeName:}" failed. No retries permitted until 2026-07-20 17:57:46.256874349 +0000 UTC m=+95.622851925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2httt" (UID: "50b8d0ec-8f68-4bff-a9bd-edbd36297e4e") : secret "samples-operator-tls" not found
Jul 20 17:57:44.257057 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.256943    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:48.256910862 +0000 UTC m=+97.622888425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : secret "router-metrics-certs-default" not found
Jul 20 17:57:44.357421 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:44.357378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:44.357575 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.357500    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:44.357575 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:44.357559    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls podName:e7c52581-b3d6-4579-8217-61140f17d5f3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:48.357541342 +0000 UTC m=+97.723518898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8n2j9" (UID: "e7c52581-b3d6-4579-8217-61140f17d5f3") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:44.862699 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:44.862662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:45.103021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.102988    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ckczl"]
Jul 20 17:57:45.105098 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.105079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.109393 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.109370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 17:57:45.110594 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.110573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 17:57:45.110826 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.110810    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 17:57:45.111726 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.111667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krpk2\""
Jul 20 17:57:45.112409 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.112388    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 17:57:45.128679 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.128621    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ckczl"]
Jul 20 17:57:45.149534 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.149506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:45.162725 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.162694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-data-volume\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.162725 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.162724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.162879 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.162746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxjv\" (UniqueName: \"kubernetes.io/projected/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-api-access-wlxjv\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.162879 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.162769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.162879 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.162811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-crio-socket\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.206875 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.206847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:45.264261 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-data-volume\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.264261 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxjv\" (UniqueName: \"kubernetes.io/projected/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-api-access-wlxjv\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-crio-socket\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.264421    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.264445    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-crio-socket\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.264488    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:45.764472815 +0000 UTC m=+95.130450375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.264527    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:45.764511269 +0000 UTC m=+95.130488825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : configmap "kube-rbac-proxy" not found
Jul 20 17:57:45.264655 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.264601    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-data-volume\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.273024 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.273006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxjv\" (UniqueName: \"kubernetes.io/projected/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-api-access-wlxjv\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.769187 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.769149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.769384 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:45.769196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:45.769384 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.769272    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:57:45.769384 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.769293    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:45.769384 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.769330    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:46.76931121 +0000 UTC m=+96.135288771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : configmap "kube-rbac-proxy" not found
Jul 20 17:57:45.769384 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:45.769366    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:46.769353127 +0000 UTC m=+96.135330684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:46.274658 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:46.274614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:46.275100 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:46.274767    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 17:57:46.275100 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:46.274829    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls podName:50b8d0ec-8f68-4bff-a9bd-edbd36297e4e nodeName:}" failed. No retries permitted until 2026-07-20 17:57:50.274813366 +0000 UTC m=+99.640790924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2httt" (UID: "50b8d0ec-8f68-4bff-a9bd-edbd36297e4e") : secret "samples-operator-tls" not found
Jul 20 17:57:46.777979 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:46.777947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:46.778223 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:46.777994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:46.778223 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:46.778105    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:46.778223 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:46.778168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:48.778154703 +0000 UTC m=+98.144132263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:46.778223 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:46.778105    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:57:46.778376 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:46.778230    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:48.778219406 +0000 UTC m=+98.144196966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : configmap "kube-rbac-proxy" not found
Jul 20 17:57:46.883338 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:46.883312    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fh7nh_239fc666-92b4-4452-900b-482d4c7e2ba4/dns-node-resolver/0.log"
Jul 20 17:57:47.687833 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:47.687806    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nb5w_665c3b1c-31b8-4b1b-946f-04a54c4e2e4a/node-ca/0.log"
Jul 20 17:57:48.290251 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:48.290211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:48.290428 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:48.290282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:48.290428 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.290358    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:57:48.290498 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.290432    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:56.290412563 +0000 UTC m=+105.656390120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : secret "router-metrics-certs-default" not found
Jul 20 17:57:48.290498 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.290447    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:56.290440673 +0000 UTC m=+105.656418229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : configmap references non-existent config key: service-ca.crt
Jul 20 17:57:48.390704 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:48.390648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:48.390885 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.390804    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:48.390885 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.390874    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls podName:e7c52581-b3d6-4579-8217-61140f17d5f3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:56.390856688 +0000 UTC m=+105.756834250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8n2j9" (UID: "e7c52581-b3d6-4579-8217-61140f17d5f3") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:48.794338 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:48.794291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:48.794802 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:48.794353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:48.794802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.794441    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:48.794802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.794463    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:57:48.794802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.794504    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:52.794487816 +0000 UTC m=+102.160465381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:48.794802 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:48.794521    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:57:52.79451377 +0000 UTC m=+102.160491327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : configmap "kube-rbac-proxy" not found
Jul 20 17:57:48.880418 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:48.880385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jb7wt_9fa31b52-0023-490e-af0a-44e4ebda95ba/serve-healthcheck-canary/0.log"
Jul 20 17:57:49.399661 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:49.399607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:57:49.399849 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:49.399752    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:57:49.399849 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:49.399815    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls podName:52773415-b6f1-4a86-9bfa-d23c15838389 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:53.399800418 +0000 UTC m=+162.765777976 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls") pod "dns-default-xfhzz" (UID: "52773415-b6f1-4a86-9bfa-d23c15838389") : secret "dns-default-metrics-tls" not found
Jul 20 17:57:50.307326 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:50.307294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:50.307675 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:50.307441    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 17:57:50.307675 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:50.307510    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls podName:50b8d0ec-8f68-4bff-a9bd-edbd36297e4e nodeName:}" failed. No retries permitted until 2026-07-20 17:57:58.307489603 +0000 UTC m=+107.673467160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2httt" (UID: "50b8d0ec-8f68-4bff-a9bd-edbd36297e4e") : secret "samples-operator-tls" not found
Jul 20 17:57:51.246890 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:51.246846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:51.357825 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:51.357791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:51.471340 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:51.471314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:52.256399 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:52.256343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:52.355900 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:52.355874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:52.825896 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:52.825869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:52.826272 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:52.825905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:57:52.826272 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:52.826007    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:57:52.826272 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:52.826029    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:52.826272 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:52.826060    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:00.826048093 +0000 UTC m=+110.192025650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : configmap "kube-rbac-proxy" not found
Jul 20 17:57:52.826272 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:52.826084    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:00.826072147 +0000 UTC m=+110.192049703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:57:53.239518 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.237932    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"]
Jul 20 17:57:53.270447 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.270415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"]
Jul 20 17:57:53.270590 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.270519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:53.273411 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.273390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 17:57:53.273411 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.273399    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 17:57:53.274299 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.274283    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hcwmq\""
Jul 20 17:57:53.370821 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.370797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2l8st"
Jul 20 17:57:53.430520 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.430491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:53.430659 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.430534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:53.531568 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.531544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:53.531691 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.531580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:53.531732 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:53.531700    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 17:57:53.531781 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:53.531770    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert podName:1b98c485-ea08-4fe9-af14-3f6ae4316a6f nodeName:}" failed. No retries permitted until 2026-07-20 17:57:54.031753726 +0000 UTC m=+103.397731284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kvdv5" (UID: "1b98c485-ea08-4fe9-af14-3f6ae4316a6f") : secret "networking-console-plugin-cert" not found
Jul 20 17:57:53.532199 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:53.532180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:54.036020 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:54.035983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:54.036402 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:54.036134    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 17:57:54.036402 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:54.036212    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert podName:1b98c485-ea08-4fe9-af14-3f6ae4316a6f nodeName:}" failed. No retries permitted until 2026-07-20 17:57:55.03619455 +0000 UTC m=+104.402172107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kvdv5" (UID: "1b98c485-ea08-4fe9-af14-3f6ae4316a6f") : secret "networking-console-plugin-cert" not found
Jul 20 17:57:54.630581 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:54.630549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:54.754149 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:54.754116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:54.862462 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:54.862426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:54.931664 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:54.931582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:55.044534 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:55.044497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:55.044955 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:55.044617    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 17:57:55.044955 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:55.044671    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert podName:1b98c485-ea08-4fe9-af14-3f6ae4316a6f nodeName:}" failed. No retries permitted until 2026-07-20 17:57:57.044657683 +0000 UTC m=+106.410635240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kvdv5" (UID: "1b98c485-ea08-4fe9-af14-3f6ae4316a6f") : secret "networking-console-plugin-cert" not found
Jul 20 17:57:55.387251 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:55.387220    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:55.538744 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:55.538707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:56.353734 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.353695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:56.354118 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:56.353865    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:12.353844732 +0000 UTC m=+121.719822311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : configmap references non-existent config key: service-ca.crt
Jul 20 17:57:56.354118 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.353940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:57:56.354118 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:56.354060    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:57:56.354118 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:56.354098    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs podName:209f363a-7c84-4e3b-8c5a-b05d7237b8c2 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:12.354089017 +0000 UTC m=+121.720066577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs") pod "router-default-84b9f6bdc8-jsqhx" (UID: "209f363a-7c84-4e3b-8c5a-b05d7237b8c2") : secret "router-metrics-certs-default" not found
Jul 20 17:57:56.454771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.454741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:57:56.454945 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:56.454877    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:56.454990 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:56.454955    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls podName:e7c52581-b3d6-4579-8217-61140f17d5f3 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:12.454939218 +0000 UTC m=+121.820916776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8n2j9" (UID: "e7c52581-b3d6-4579-8217-61140f17d5f3") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:57:56.935789 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.935752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-5c77g"]
Jul 20 17:57:56.937994 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.937978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:56.940613 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.940588    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 17:57:56.940735 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.940679    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 17:57:56.940788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.940733    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cqw8s\""
Jul 20 17:57:56.941686 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.941648    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 17:57:56.941774 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.941668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 17:57:56.945840 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:56.945822    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-5c77g"]
Jul 20 17:57:57.060160 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.060119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:57:57.060312 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.060178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/79e45db9-2861-4070-b971-bc8ae3a6c992-signing-cabundle\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.060312 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.060198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/79e45db9-2861-4070-b971-bc8ae3a6c992-signing-key\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.060312 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.060214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2mj\" (UniqueName: \"kubernetes.io/projected/79e45db9-2861-4070-b971-bc8ae3a6c992-kube-api-access-pf2mj\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.060312 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:57.060290    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 17:57:57.060462 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:57.060360    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert podName:1b98c485-ea08-4fe9-af14-3f6ae4316a6f nodeName:}" failed. No retries permitted until 2026-07-20 17:58:01.06034138 +0000 UTC m=+110.426318937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kvdv5" (UID: "1b98c485-ea08-4fe9-af14-3f6ae4316a6f") : secret "networking-console-plugin-cert" not found
Jul 20 17:57:57.160684 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.160653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/79e45db9-2861-4070-b971-bc8ae3a6c992-signing-cabundle\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.160684 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.160686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/79e45db9-2861-4070-b971-bc8ae3a6c992-signing-key\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.160958 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.160709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2mj\" (UniqueName: \"kubernetes.io/projected/79e45db9-2861-4070-b971-bc8ae3a6c992-kube-api-access-pf2mj\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.161432 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.161405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/79e45db9-2861-4070-b971-bc8ae3a6c992-signing-cabundle\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.161628 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.161580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:57.163285 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.163266    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/79e45db9-2861-4070-b971-bc8ae3a6c992-signing-key\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.168726 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.168702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2mj\" (UniqueName: \"kubernetes.io/projected/79e45db9-2861-4070-b971-bc8ae3a6c992-kube-api-access-pf2mj\") pod \"service-ca-58598695f7-5c77g\" (UID: \"79e45db9-2861-4070-b971-bc8ae3a6c992\") " pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.221688 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.221583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:57.246589 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.246558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-5c77g"
Jul 20 17:57:57.364365 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.364335    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-5c77g"]
Jul 20 17:57:57.367437 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:57:57.367413    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e45db9_2861_4070_b971_bc8ae3a6c992.slice/crio-0eb075de9bd21ac63779dc0ae62df8d686c160bd84b0d357d43c499560518b06 WatchSource:0}: Error finding container 0eb075de9bd21ac63779dc0ae62df8d686c160bd84b0d357d43c499560518b06: Status 404 returned error can't find the container with id 0eb075de9bd21ac63779dc0ae62df8d686c160bd84b0d357d43c499560518b06
Jul 20 17:57:57.457265 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.457229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-5c77g" event={"ID":"79e45db9-2861-4070-b971-bc8ae3a6c992","Type":"ContainerStarted","Data":"0eb075de9bd21ac63779dc0ae62df8d686c160bd84b0d357d43c499560518b06"}
Jul 20 17:57:57.863721 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:57.863681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:58.371421 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:58.371379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:57:58.371801 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:58.371543    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 17:57:58.371801 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:57:58.371611    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls podName:50b8d0ec-8f68-4bff-a9bd-edbd36297e4e nodeName:}" failed. No retries permitted until 2026-07-20 17:58:14.371595156 +0000 UTC m=+123.737572714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2httt" (UID: "50b8d0ec-8f68-4bff-a9bd-edbd36297e4e") : secret "samples-operator-tls" not found
Jul 20 17:57:58.877855 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:58.877822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:58.946310 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:57:58.946276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:00.467410 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.467369    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-5c77g" event={"ID":"79e45db9-2861-4070-b971-bc8ae3a6c992","Type":"ContainerStarted","Data":"96a473ba48925ad47b4d1ce65b2465f8d0e8b9f4dc0234315c9a8d8938d26b13"}
Jul 20 17:58:00.486549 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.486493    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-5c77g" podStartSLOduration=2.334447354 podStartE2EDuration="4.486474392s" totalImagesPullingTime="2.152027038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:00.485765614 +0000 UTC m=+109.851743193" watchObservedRunningTime="2026-07-20 17:58:00.486474392 +0000 UTC m=+109.852451973"
Jul 20 17:58:00.486944 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.486907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:00.675474 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.675423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:00.799274 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.799216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:00.859475 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.859435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:00.893864 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.893827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:58:00.893864 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.893874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:58:00.894681 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:00.894240    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:58:00.894681 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:00.894329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls podName:4aa28908-caea-44c0-9e7f-fd1f56d5d0b3 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:16.894308024 +0000 UTC m=+126.260285596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckczl" (UID: "4aa28908-caea-44c0-9e7f-fd1f56d5d0b3") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:58:00.894681 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:00.894396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:58:01.096157 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:01.096068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:58:01.096312 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:01.096238    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 17:58:01.096357 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:01.096316    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert podName:1b98c485-ea08-4fe9-af14-3f6ae4316a6f nodeName:}" failed. No retries permitted until 2026-07-20 17:58:09.096294528 +0000 UTC m=+118.462272099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kvdv5" (UID: "1b98c485-ea08-4fe9-af14-3f6ae4316a6f") : secret "networking-console-plugin-cert" not found
Jul 20 17:58:01.112634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:01.112602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:01.207300 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:01.207258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:01.584247 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:01.584213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:01.992262 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:01.992167    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:02.178126 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:02.178092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:02.775350 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:02.775315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:03.378608 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:03.378569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:03.586436 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:03.586402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:03.780509 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:03.780474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:03.977652 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:03.977616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:04.183910 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:04.183824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:04.494340 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:04.494257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:04.991124 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:04.991082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:05.383667 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:05.383630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:05.579537 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:05.579500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:05.780588 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:05.780550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:06.448440 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:06.448407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:06.548867 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:06.548835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:06.773021 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:06.772995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:06.840337 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:06.840304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:06.903093 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:06.903063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.117695 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.117610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.218446 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.218408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.370711 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.370624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.517809 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.517783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.619276 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.619213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.738163 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.738083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.837608 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.837566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:07.978273 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:07.978249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:08.594247 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:08.594203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:08.694222 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:08.694191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:09.129703 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.129662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:09.160903 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.160871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:58:09.163231 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.163202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b98c485-ea08-4fe9-af14-3f6ae4316a6f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kvdv5\" (UID: \"1b98c485-ea08-4fe9-af14-3f6ae4316a6f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:58:09.179086 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.179062    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"
Jul 20 17:58:09.229996 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.229902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:09.303143 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.303113    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5"]
Jul 20 17:58:09.305911 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:09.305886    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b98c485_ea08_4fe9_af14_3f6ae4316a6f.slice/crio-aa836c0788a6576437970c712f075fcdfd05f4dc372900c10ea9f06d04b1ee9f WatchSource:0}: Error finding container aa836c0788a6576437970c712f075fcdfd05f4dc372900c10ea9f06d04b1ee9f: Status 404 returned error can't find the container with id aa836c0788a6576437970c712f075fcdfd05f4dc372900c10ea9f06d04b1ee9f
Jul 20 17:58:09.379557 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.379522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:09.488729 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.488658    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5" event={"ID":"1b98c485-ea08-4fe9-af14-3f6ae4316a6f","Type":"ContainerStarted","Data":"aa836c0788a6576437970c712f075fcdfd05f4dc372900c10ea9f06d04b1ee9f"}
Jul 20 17:58:09.620288 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.620259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:09.813189 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:09.813157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:10.000821 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:10.000775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:10.492785 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:10.492760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5" event={"ID":"1b98c485-ea08-4fe9-af14-3f6ae4316a6f","Type":"ContainerStarted","Data":"d4eb635603b24d4c376c0f00531d2e3c5b0c6308e197a7bb8329f77ca4eb42c5"}
Jul 20 17:58:11.030988 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:11.030952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:11.208796 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:11.208755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:11.387933 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:11.387823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:11.591440 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:11.591407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:12.388051 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.388022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:12.388432 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.388080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:12.388623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.388606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-service-ca-bundle\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:12.390318 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.390293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209f363a-7c84-4e3b-8c5a-b05d7237b8c2-metrics-certs\") pod \"router-default-84b9f6bdc8-jsqhx\" (UID: \"209f363a-7c84-4e3b-8c5a-b05d7237b8c2\") " pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:12.488611 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.488581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:58:12.490712 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.490687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c52581-b3d6-4579-8217-61140f17d5f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8n2j9\" (UID: \"e7c52581-b3d6-4579-8217-61140f17d5f3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:58:12.648301 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.648230    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bs4zp\""
Jul 20 17:58:12.655981 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.655964    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:12.742309 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.742287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tzqnj\""
Jul 20 17:58:12.747770 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.747353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"
Jul 20 17:58:12.783547 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.783504    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kvdv5" podStartSLOduration=18.664933523 podStartE2EDuration="19.783486253s" totalImagesPullingTime="1.11855273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:10.534285385 +0000 UTC m=+119.900262977" watchObservedRunningTime="2026-07-20 17:58:12.783486253 +0000 UTC m=+122.149463832"
Jul 20 17:58:12.783666 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.783650    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84b9f6bdc8-jsqhx"]
Jul 20 17:58:12.785894 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:12.785870    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209f363a_7c84_4e3b_8c5a_b05d7237b8c2.slice/crio-2ae57134c3b779379d58ec74dec6c870755069682a28162e0a1485648f91e196 WatchSource:0}: Error finding container 2ae57134c3b779379d58ec74dec6c870755069682a28162e0a1485648f91e196: Status 404 returned error can't find the container with id 2ae57134c3b779379d58ec74dec6c870755069682a28162e0a1485648f91e196
Jul 20 17:58:12.872803 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:12.872779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9"]
Jul 20 17:58:12.875886 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:12.875859    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c52581_b3d6_4579_8217_61140f17d5f3.slice/crio-8804e74fbf42801d27ca08c43464f03732d4b4988792864aa52c90653a112e8e WatchSource:0}: Error finding container 8804e74fbf42801d27ca08c43464f03732d4b4988792864aa52c90653a112e8e: Status 404 returned error can't find the container with id 8804e74fbf42801d27ca08c43464f03732d4b4988792864aa52c90653a112e8e
Jul 20 17:58:13.501820 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:13.501789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx" event={"ID":"209f363a-7c84-4e3b-8c5a-b05d7237b8c2","Type":"ContainerStarted","Data":"4bcda57f1dd6334f69abaccf4130a485f3b078b537a15d9cd5dbd324abedb6db"}
Jul 20 17:58:13.502263 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:13.501842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx" event={"ID":"209f363a-7c84-4e3b-8c5a-b05d7237b8c2","Type":"ContainerStarted","Data":"2ae57134c3b779379d58ec74dec6c870755069682a28162e0a1485648f91e196"}
Jul 20 17:58:13.502945 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:13.502907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9" event={"ID":"e7c52581-b3d6-4579-8217-61140f17d5f3","Type":"ContainerStarted","Data":"8804e74fbf42801d27ca08c43464f03732d4b4988792864aa52c90653a112e8e"}
Jul 20 17:58:13.532959 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:13.532902    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx" podStartSLOduration=33.532885981 podStartE2EDuration="33.532885981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:13.53175587 +0000 UTC m=+122.897733478" watchObservedRunningTime="2026-07-20 17:58:13.532885981 +0000 UTC m=+122.898863560"
Jul 20 17:58:13.656621 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:13.656599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:13.659571 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:13.659549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:14.009808 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.009772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:14.077816 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.077785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:14.402615 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.402528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:58:14.405216 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.405173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50b8d0ec-8f68-4bff-a9bd-edbd36297e4e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2httt\" (UID: \"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:58:14.507841 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.507811    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:14.509233 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.509212    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84b9f6bdc8-jsqhx"
Jul 20 17:58:14.621483 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.621453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rztx7\""
Jul 20 17:58:14.628767 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.628748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"
Jul 20 17:58:14.757000 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.756967    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt"]
Jul 20 17:58:14.969227 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:14.969149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:15.071362 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:15.071328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:15.169356 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:15.169325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:15.244885 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:15.244806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:15.511808 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:15.511773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9" event={"ID":"e7c52581-b3d6-4579-8217-61140f17d5f3","Type":"ContainerStarted","Data":"1a8a961a2bc17fa9db96954698207bc8a9606afdd00612c322943a6fa9db04e0"}
Jul 20 17:58:15.512945 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:15.512907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt" event={"ID":"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e","Type":"ContainerStarted","Data":"0f80e7ab95ab0b445cbc12aa92ccc6f823bbfa46e1422ee3c7b93dc3f5937b18"}
Jul 20 17:58:15.532352 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:15.532317    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8n2j9" podStartSLOduration=33.77338526 podStartE2EDuration="35.532305147s" totalImagesPullingTime="1.758919887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:15.531140734 +0000 UTC m=+124.897118296" watchObservedRunningTime="2026-07-20 17:58:15.532305147 +0000 UTC m=+124.898282725"
Jul 20 17:58:16.923717 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:16.923684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:58:16.926053 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:16.926025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa28908-caea-44c0-9e7f-fd1f56d5d0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckczl\" (UID: \"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3\") " pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:58:17.218103 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.218022    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krpk2\""
Jul 20 17:58:17.223887 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.223872    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ckczl"
Jul 20 17:58:17.362346 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.362314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ckczl"]
Jul 20 17:58:17.364990 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:17.364967    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa28908_caea_44c0_9e7f_fd1f56d5d0b3.slice/crio-48ff3482c2e8e8bc9dc3422a71ae2ecaeb70182b6f4485b4be46cc13cce1d6b6 WatchSource:0}: Error finding container 48ff3482c2e8e8bc9dc3422a71ae2ecaeb70182b6f4485b4be46cc13cce1d6b6: Status 404 returned error can't find the container with id 48ff3482c2e8e8bc9dc3422a71ae2ecaeb70182b6f4485b4be46cc13cce1d6b6
Jul 20 17:58:17.390225 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.390198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:17.499935 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.499883    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:17.521083 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.521056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt" event={"ID":"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e","Type":"ContainerStarted","Data":"700452f8aefbc553ff5af8a66e8d87ee9c366df99cb9fe28c760ece793b4af92"}
Jul 20 17:58:17.521224 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.521110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt" event={"ID":"50b8d0ec-8f68-4bff-a9bd-edbd36297e4e","Type":"ContainerStarted","Data":"d77567056169eb1d3a7de42f6476f9b2b20eedfbd420c97cbad4237eabc91f05"}
Jul 20 17:58:17.522083 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.522065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckczl" event={"ID":"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3","Type":"ContainerStarted","Data":"48ff3482c2e8e8bc9dc3422a71ae2ecaeb70182b6f4485b4be46cc13cce1d6b6"}
Jul 20 17:58:17.539035 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:17.538899    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2httt" podStartSLOduration=33.563981586 podStartE2EDuration="35.538878263s" totalImagesPullingTime="1.974896677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:17.538733717 +0000 UTC m=+126.904711297" watchObservedRunningTime="2026-07-20 17:58:17.538878263 +0000 UTC m=+126.904855842"
Jul 20 17:58:18.951036 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:18.951001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:19.036388 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:19.036353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:20.858305 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:20.858271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:58:20.860729 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:20.860704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700c7c9c-ee82-4111-bb57-3880047df00f-metrics-certs\") pod \"network-metrics-daemon-lf44f\" (UID: \"700c7c9c-ee82-4111-bb57-3880047df00f\") " pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:58:20.939719 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:20.939680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nnhlg\""
Jul 20 17:58:20.947203 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:20.947158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf44f"
Jul 20 17:58:20.966853 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:20.966819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:21.064964 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.064912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:21.415908 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.415882    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"]
Jul 20 17:58:21.427858 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.427839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.433873 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.433850    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 17:58:21.433873 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.433865    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 17:58:21.434073 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.433852    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 17:58:21.434385 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.434357    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 17:58:21.458249 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.458227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"]
Jul 20 17:58:21.461580 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.461558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a19535-d4fc-4524-aeb7-a9a77ec9c698-tmp\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.461704 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.461597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr4lp\" (UniqueName: \"kubernetes.io/projected/07a19535-d4fc-4524-aeb7-a9a77ec9c698-kube-api-access-pr4lp\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.461704 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.461636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07a19535-d4fc-4524-aeb7-a9a77ec9c698-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.520853 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.520818    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-ttwzv"]
Jul 20 17:58:21.523338 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.523308    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d79bd7776-zg7gn"]
Jul 20 17:58:21.523471 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.523395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:21.525339 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.525320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.526019 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.525997    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 17:58:21.526135 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.526076    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 17:58:21.530539 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.530489    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 17:58:21.530758 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.530741    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 17:58:21.530888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.530866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 17:58:21.531141 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.530979    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5lzmx\""
Jul 20 17:58:21.533291 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.532960    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 17:58:21.533291 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.533107    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 17:58:21.534802 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.534667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ppcz6\""
Jul 20 17:58:21.539546 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.539526    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 17:58:21.562765 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.562738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpztn\" (UniqueName: \"kubernetes.io/projected/4b14387b-9ad5-40fc-aea0-a90ec1a6ea61-kube-api-access-cpztn\") pod \"downloads-5bc67dcd46-ttwzv\" (UID: \"4b14387b-9ad5-40fc-aea0-a90ec1a6ea61\") " pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:21.562888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.562783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-console-config\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.562888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.562829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a19535-d4fc-4524-aeb7-a9a77ec9c698-tmp\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.562888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.562848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-trusted-ca-bundle\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.562888 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.562865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-oauth-config\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.563123 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.562913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr4lp\" (UniqueName: \"kubernetes.io/projected/07a19535-d4fc-4524-aeb7-a9a77ec9c698-kube-api-access-pr4lp\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.563123 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.563026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07a19535-d4fc-4524-aeb7-a9a77ec9c698-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.563226 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.563119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-serving-cert\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.563226 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.563149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-service-ca\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.563226 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.563176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smtz\" (UniqueName: \"kubernetes.io/projected/a279779a-a368-47fd-a96f-e635d3aa1342-kube-api-access-4smtz\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.563226 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.563205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-oauth-serving-cert\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.563414 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.563221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a19535-d4fc-4524-aeb7-a9a77ec9c698-tmp\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.565526 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.565503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07a19535-d4fc-4524-aeb7-a9a77ec9c698-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.571529 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.571471    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d79bd7776-zg7gn"]
Jul 20 17:58:21.605963 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.605931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr4lp\" (UniqueName: \"kubernetes.io/projected/07a19535-d4fc-4524-aeb7-a9a77ec9c698-kube-api-access-pr4lp\") pod \"klusterlet-addon-workmgr-6cc9856594-5tm5n\" (UID: \"07a19535-d4fc-4524-aeb7-a9a77ec9c698\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.615312 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.615264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-ttwzv"]
Jul 20 17:58:21.653990 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.653901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:21.663955 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.663906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-serving-cert\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.664101 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.663968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-service-ca\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.664101 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.663995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smtz\" (UniqueName: \"kubernetes.io/projected/a279779a-a368-47fd-a96f-e635d3aa1342-kube-api-access-4smtz\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.664101 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.664012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-oauth-serving-cert\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.664101 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.664082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpztn\" (UniqueName: \"kubernetes.io/projected/4b14387b-9ad5-40fc-aea0-a90ec1a6ea61-kube-api-access-cpztn\") pod \"downloads-5bc67dcd46-ttwzv\" (UID: \"4b14387b-9ad5-40fc-aea0-a90ec1a6ea61\") " pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:21.664319 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.664141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-console-config\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.664319 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.664194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-trusted-ca-bundle\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.664319 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.664216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-oauth-config\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.665052 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.665021    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-service-ca\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.665178 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.665116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-oauth-serving-cert\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.665178 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.665126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-console-config\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.665178 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.665123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-trusted-ca-bundle\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.666858 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.666838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-oauth-config\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.667008 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.666987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-serving-cert\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.705541 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.705512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpztn\" (UniqueName: \"kubernetes.io/projected/4b14387b-9ad5-40fc-aea0-a90ec1a6ea61-kube-api-access-cpztn\") pod \"downloads-5bc67dcd46-ttwzv\" (UID: \"4b14387b-9ad5-40fc-aea0-a90ec1a6ea61\") " pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:21.707024 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.707002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smtz\" (UniqueName: \"kubernetes.io/projected/a279779a-a368-47fd-a96f-e635d3aa1342-kube-api-access-4smtz\") pod \"console-d79bd7776-zg7gn\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") " pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:21.738931 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.738878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:21.803773 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.803738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:21.834311 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.834280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:21.840041 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:21.840021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:22.356547 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.356517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lf44f"]
Jul 20 17:58:22.367181 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:22.367131    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700c7c9c_ee82_4111_bb57_3880047df00f.slice/crio-e191a7e32d6778bd80dca0bac482f5ca5570cd6f6d7df648578e4cb54d0b454e WatchSource:0}: Error finding container e191a7e32d6778bd80dca0bac482f5ca5570cd6f6d7df648578e4cb54d0b454e: Status 404 returned error can't find the container with id e191a7e32d6778bd80dca0bac482f5ca5570cd6f6d7df648578e4cb54d0b454e
Jul 20 17:58:22.402094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.402070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d79bd7776-zg7gn"]
Jul 20 17:58:22.402891 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.402870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-ttwzv"]
Jul 20 17:58:22.407177 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:22.407146    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b14387b_9ad5_40fc_aea0_a90ec1a6ea61.slice/crio-99e9536d51028341187e61d876304929745a04b4eda55d14d150d0be4651d7a2 WatchSource:0}: Error finding container 99e9536d51028341187e61d876304929745a04b4eda55d14d150d0be4651d7a2: Status 404 returned error can't find the container with id 99e9536d51028341187e61d876304929745a04b4eda55d14d150d0be4651d7a2
Jul 20 17:58:22.407751 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:22.407709    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda279779a_a368_47fd_a96f_e635d3aa1342.slice/crio-5412262a8992fc6baaa178c87000a177257a1efea211bef4d7a8e72532fae99a WatchSource:0}: Error finding container 5412262a8992fc6baaa178c87000a177257a1efea211bef4d7a8e72532fae99a: Status 404 returned error can't find the container with id 5412262a8992fc6baaa178c87000a177257a1efea211bef4d7a8e72532fae99a
Jul 20 17:58:22.433624 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.433601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"]
Jul 20 17:58:22.451360 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:22.451333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a19535_d4fc_4524_aeb7_a9a77ec9c698.slice/crio-c8499523c37330ffafca2bd90191f371b462ca072167ebe4ac1e7eeab5b27977 WatchSource:0}: Error finding container c8499523c37330ffafca2bd90191f371b462ca072167ebe4ac1e7eeab5b27977: Status 404 returned error can't find the container with id c8499523c37330ffafca2bd90191f371b462ca072167ebe4ac1e7eeab5b27977
Jul 20 17:58:22.540268 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.540231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79bd7776-zg7gn" event={"ID":"a279779a-a368-47fd-a96f-e635d3aa1342","Type":"ContainerStarted","Data":"5412262a8992fc6baaa178c87000a177257a1efea211bef4d7a8e72532fae99a"}
Jul 20 17:58:22.541631 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.541606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckczl" event={"ID":"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3","Type":"ContainerStarted","Data":"1937eb8a16ba411e13cdf2dcb1bc9e91d6b21807d3a19de4ccb95bcfd0cce777"}
Jul 20 17:58:22.542750 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.542725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-ttwzv" event={"ID":"4b14387b-9ad5-40fc-aea0-a90ec1a6ea61","Type":"ContainerStarted","Data":"99e9536d51028341187e61d876304929745a04b4eda55d14d150d0be4651d7a2"}
Jul 20 17:58:22.543771 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.543753    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n" event={"ID":"07a19535-d4fc-4524-aeb7-a9a77ec9c698","Type":"ContainerStarted","Data":"c8499523c37330ffafca2bd90191f371b462ca072167ebe4ac1e7eeab5b27977"}
Jul 20 17:58:22.544796 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:22.544778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf44f" event={"ID":"700c7c9c-ee82-4111-bb57-3880047df00f","Type":"ContainerStarted","Data":"e191a7e32d6778bd80dca0bac482f5ca5570cd6f6d7df648578e4cb54d0b454e"}
Jul 20 17:58:23.172507 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:23.172475    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:23.281085 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:23.281031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:24.558798 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:24.557749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf44f" event={"ID":"700c7c9c-ee82-4111-bb57-3880047df00f","Type":"ContainerStarted","Data":"79059de7b4c022383ecc5f5c5fa0d1ab31609f28462bac3c233eb56f229a9e1d"}
Jul 20 17:58:24.558798 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:24.557855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf44f" event={"ID":"700c7c9c-ee82-4111-bb57-3880047df00f","Type":"ContainerStarted","Data":"42f8a8bfd9b5039d6453dcd162634da72e91fb6b676ec89153ec31573157c337"}
Jul 20 17:58:24.562908 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:24.562582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:24.581625 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:24.581076    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lf44f" podStartSLOduration=132.295434872 podStartE2EDuration="2m13.581053897s" totalImagesPullingTime="1.285619025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:24.579313747 +0000 UTC m=+133.945291323" watchObservedRunningTime="2026-07-20 17:58:24.581053897 +0000 UTC m=+133.947031476"
Jul 20 17:58:24.720406 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:24.720256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:24.794419 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:24.794389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:28.118787 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:28.118749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:28.234887 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:28.234848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:28.719655 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:28.719595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:28.787996 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:28.787962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:29.056493 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:29.056446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:30.592238 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.592204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckczl" event={"ID":"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3","Type":"ContainerStarted","Data":"6bc7f482af338eb13127fe6537c577a0308f691a75ed3807ac59b3efd83dab8a"}
Jul 20 17:58:30.594339 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.593914    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n" event={"ID":"07a19535-d4fc-4524-aeb7-a9a77ec9c698","Type":"ContainerStarted","Data":"03ac219eb2921163f3b1b3346949ed537e4b4084c91ecf0eadd73799466fba06"}
Jul 20 17:58:30.594339 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.594061    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:30.595861 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.595820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n"
Jul 20 17:58:30.596378 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.596342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79bd7776-zg7gn" event={"ID":"a279779a-a368-47fd-a96f-e635d3aa1342","Type":"ContainerStarted","Data":"0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2"}
Jul 20 17:58:30.613489 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.613401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc9856594-5tm5n" podStartSLOduration=1.660874945 podStartE2EDuration="9.613383285s" totalImagesPullingTime="7.95250834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:30.612101943 +0000 UTC m=+139.978079547" watchObservedRunningTime="2026-07-20 17:58:30.613383285 +0000 UTC m=+139.979360870"
Jul 20 17:58:30.653854 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:30.653798    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d79bd7776-zg7gn" podStartSLOduration=1.6762443139999998 podStartE2EDuration="9.65378393s" totalImagesPullingTime="7.977539616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:30.652210142 +0000 UTC m=+140.018187745" watchObservedRunningTime="2026-07-20 17:58:30.65378393 +0000 UTC m=+140.019761486"
Jul 20 17:58:31.450167 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:31.450130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:31.553517 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:31.553477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:31.840669 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:31.840555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:31.840669 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:31.840629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:58:31.842286 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:31.842251    2562 patch_prober.go:28] interesting pod/console-d79bd7776-zg7gn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Jul 20 17:58:31.842408 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:31.842309    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d79bd7776-zg7gn" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Jul 20 17:58:33.866333 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:33.866250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:35.619095 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:35.619055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckczl" event={"ID":"4aa28908-caea-44c0-9e7f-fd1f56d5d0b3","Type":"ContainerStarted","Data":"91a71f27d8699a1d51b0fb8831c3c9512eda1451fb8c268d968a07de99f20e8a"}
Jul 20 17:58:35.641479 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:35.641399    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ckczl" podStartSLOduration=33.148772246 podStartE2EDuration="50.64137993s" totalImagesPullingTime="17.492607684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:57:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:35.640332652 +0000 UTC m=+145.006310279" watchObservedRunningTime="2026-07-20 17:58:35.64137993 +0000 UTC m=+145.007357509"
Jul 20 17:58:36.362125 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.362086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:36.601419 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.601367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:36.653602 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.653496    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"]
Jul 20 17:58:36.657681 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.657646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.660405 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.660379    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-728vc\""
Jul 20 17:58:36.660846 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.660655    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 17:58:36.661455 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.661232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 17:58:36.664147 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.664107    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 17:58:36.665462 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.665164    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"]
Jul 20 17:58:36.669788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.669230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"]
Jul 20 17:58:36.669788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.669356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.672862 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.672424    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 17:58:36.672862 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.672644    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 17:58:36.672862 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.672665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bg42f\""
Jul 20 17:58:36.672862 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.672778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 17:58:36.695514 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.695488    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r692k"]
Jul 20 17:58:36.698862 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.698838    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"]
Jul 20 17:58:36.699284 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.699268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.702887 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.702684    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 17:58:36.703015 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.702892    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 17:58:36.703274 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.703095    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bqxsm\""
Jul 20 17:58:36.703734 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.703718    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 17:58:36.738787 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.738753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:36.799382 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88wdl\" (UniqueName: \"kubernetes.io/projected/b067cced-5894-4f28-99ab-c95b8ddf34cf-kube-api-access-88wdl\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799382 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9d22c22-3bf5-435b-9eff-e2189bfe593e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.799623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.799623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-tls\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-sys\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-textfile\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-root\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799623 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b067cced-5894-4f28-99ab-c95b8ddf34cf-metrics-client-ca\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799835 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9d22c22-3bf5-435b-9eff-e2189bfe593e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.799835 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.799835 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng7qj\" (UniqueName: \"kubernetes.io/projected/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-api-access-ng7qj\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.799835 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.799994 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.799994 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zbr\" (UniqueName: \"kubernetes.io/projected/714a59ad-a987-4bc2-9f25-bd7488aeb692-kube-api-access-j5zbr\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.799994 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.799943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.800105 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.800000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.800105 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.800026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-wtmp\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.800105 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.800062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714a59ad-a987-4bc2-9f25-bd7488aeb692-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.800246 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.800153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.900784 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.900743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.900986 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.900883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7qj\" (UniqueName: \"kubernetes.io/projected/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-api-access-ng7qj\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.900986 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.900911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.900986 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.900952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.900986 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.900985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zbr\" (UniqueName: \"kubernetes.io/projected/714a59ad-a987-4bc2-9f25-bd7488aeb692-kube-api-access-j5zbr\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-wtmp\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714a59ad-a987-4bc2-9f25-bd7488aeb692-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88wdl\" (UniqueName: \"kubernetes.io/projected/b067cced-5894-4f28-99ab-c95b8ddf34cf-kube-api-access-88wdl\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901206 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9d22c22-3bf5-435b-9eff-e2189bfe593e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-tls\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-sys\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901355    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-sys\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-textfile\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-root\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b067cced-5894-4f28-99ab-c95b8ddf34cf-metrics-client-ca\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.901475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9d22c22-3bf5-435b-9eff-e2189bfe593e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.901545 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:36.901497    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 20 17:58:36.902003 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:36.901576    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-tls podName:714a59ad-a987-4bc2-9f25-bd7488aeb692 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:37.40155567 +0000 UTC m=+146.767533228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-n4c7p" (UID: "714a59ad-a987-4bc2-9f25-bd7488aeb692") : secret "openshift-state-metrics-tls" not found
Jul 20 17:58:36.903033 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.902207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9d22c22-3bf5-435b-9eff-e2189bfe593e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.903033 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.902445    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.903033 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.902720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9d22c22-3bf5-435b-9eff-e2189bfe593e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.903033 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.902965    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.903347 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.903071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-wtmp\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.903347 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.903225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-textfile\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.903347 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:36.903316    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 17:58:36.903502 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:36.903364    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-tls podName:b067cced-5894-4f28-99ab-c95b8ddf34cf nodeName:}" failed. No retries permitted until 2026-07-20 17:58:37.403347662 +0000 UTC m=+146.769325222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-tls") pod "node-exporter-r692k" (UID: "b067cced-5894-4f28-99ab-c95b8ddf34cf") : secret "node-exporter-tls" not found
Jul 20 17:58:36.903764 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.903709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714a59ad-a987-4bc2-9f25-bd7488aeb692-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.903845 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.903778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b067cced-5894-4f28-99ab-c95b8ddf34cf-root\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.904274 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.904252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b067cced-5894-4f28-99ab-c95b8ddf34cf-metrics-client-ca\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.904507 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.904483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.904881 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.904799    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.906470 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.906428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.907353 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.907331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.913412 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.913371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88wdl\" (UniqueName: \"kubernetes.io/projected/b067cced-5894-4f28-99ab-c95b8ddf34cf-kube-api-access-88wdl\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:36.915062 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.915043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zbr\" (UniqueName: \"kubernetes.io/projected/714a59ad-a987-4bc2-9f25-bd7488aeb692-kube-api-access-j5zbr\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:36.916528 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.916487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng7qj\" (UniqueName: \"kubernetes.io/projected/a9d22c22-3bf5-435b-9eff-e2189bfe593e-kube-api-access-ng7qj\") pod \"kube-state-metrics-56c5594674-sc8pz\" (UID: \"a9d22c22-3bf5-435b-9eff-e2189bfe593e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:36.925195 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.925120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:36.984531 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:36.984494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"
Jul 20 17:58:37.025126 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.025093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:37.281237 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.281183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:37.408093 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.408055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:37.408290 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.408150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-tls\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:37.410649 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.410618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b067cced-5894-4f28-99ab-c95b8ddf34cf-node-exporter-tls\") pod \"node-exporter-r692k\" (UID: \"b067cced-5894-4f28-99ab-c95b8ddf34cf\") " pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:37.410788 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.410702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/714a59ad-a987-4bc2-9f25-bd7488aeb692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n4c7p\" (UID: \"714a59ad-a987-4bc2-9f25-bd7488aeb692\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:37.573111 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.573034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"
Jul 20 17:58:37.577198 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.577170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:37.612078 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.612049    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r692k"
Jul 20 17:58:37.678609 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.678553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:37.679605 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.679580    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 17:58:37.682753 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.682734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.685576 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.685556    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 17:58:37.685897 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.685846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 17:58:37.685897 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.685880    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 17:58:37.686094 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.685914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 17:58:37.686243 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.686159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vr2gd\""
Jul 20 17:58:37.686359 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.686316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 17:58:37.686538 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.686520    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 17:58:37.686612 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.686567    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 17:58:37.686612 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.686521    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 17:58:37.686612 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.686597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 17:58:37.702733 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.702711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 17:58:37.812621 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812621 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812852 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfc6c363-a695-445c-81e6-e996af0a8a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812852 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812852 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812998 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812998 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfc6c363-a695-445c-81e6-e996af0a8a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.812998 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.812974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7krwx\" (UniqueName: \"kubernetes.io/projected/cfc6c363-a695-445c-81e6-e996af0a8a70-kube-api-access-7krwx\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.813088 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.813027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-web-config\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.813088 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.813054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.813151 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.813083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc6c363-a695-445c-81e6-e996af0a8a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.813151 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.813135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfc6c363-a695-445c-81e6-e996af0a8a70-config-out\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.813213 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.813159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfc6c363-a695-445c-81e6-e996af0a8a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.915361 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.915361 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.915361 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfc6c363-a695-445c-81e6-e996af0a8a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915862    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfc6c363-a695-445c-81e6-e996af0a8a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7krwx\" (UniqueName: \"kubernetes.io/projected/cfc6c363-a695-445c-81e6-e996af0a8a70-kube-api-access-7krwx\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-web-config\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.915995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.916029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc6c363-a695-445c-81e6-e996af0a8a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.916071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfc6c363-a695-445c-81e6-e996af0a8a70-config-out\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.916097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfc6c363-a695-445c-81e6-e996af0a8a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.916456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfc6c363-a695-445c-81e6-e996af0a8a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:37.917369    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 20 17:58:37.917556 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:37.917435    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls podName:cfc6c363-a695-445c-81e6-e996af0a8a70 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:38.417413775 +0000 UTC m=+147.783391331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "cfc6c363-a695-445c-81e6-e996af0a8a70") : secret "alertmanager-main-tls" not found
Jul 20 17:58:37.918269 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.918114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfc6c363-a695-445c-81e6-e996af0a8a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.918991 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.918870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfc6c363-a695-445c-81e6-e996af0a8a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.919112 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.919096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.919401 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.919305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.922196 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.922145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfc6c363-a695-445c-81e6-e996af0a8a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.922350 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.922327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.922705 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.922669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.923032 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.922993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.923830 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.923456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfc6c363-a695-445c-81e6-e996af0a8a70-config-out\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.923975 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.923891    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-web-config\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:37.926608 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:37.926586    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7krwx\" (UniqueName: \"kubernetes.io/projected/cfc6c363-a695-445c-81e6-e996af0a8a70-kube-api-access-7krwx\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:38.427150 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:38.427092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:38.427337 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:38.427265    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 20 17:58:38.427417 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:38.427343    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls podName:cfc6c363-a695-445c-81e6-e996af0a8a70 nodeName:}" failed. No retries permitted until 2026-07-20 17:58:39.42732092 +0000 UTC m=+148.793298478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "cfc6c363-a695-445c-81e6-e996af0a8a70") : secret "alertmanager-main-tls" not found
Jul 20 17:58:38.523763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:38.523679    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:39.436176 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.436133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:39.439073 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.439048    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfc6c363-a695-445c-81e6-e996af0a8a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfc6c363-a695-445c-81e6-e996af0a8a70\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:39.496171 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.496137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:58:39.594093 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.593992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:39.700308 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.700222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:39.800153 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.800113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:39.953687 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:39.953606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:41.147463 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:41.147431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:41.226353 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:41.226318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:41.437379 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:41.437279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:41.693984 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:41.693867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:41.840810 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:41.840779    2562 patch_prober.go:28] interesting pod/console-d79bd7776-zg7gn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Jul 20 17:58:41.841024 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:41.840825    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d79bd7776-zg7gn" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Jul 20 17:58:42.307684 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.307650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:42.559715 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:42.559624    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb067cced_5894_4f28_99ab_c95b8ddf34cf.slice/crio-9027d6ad2543ba89bdb8e682ea5df65dec6a914d7299ca41871c005eecd34a33 WatchSource:0}: Error finding container 9027d6ad2543ba89bdb8e682ea5df65dec6a914d7299ca41871c005eecd34a33: Status 404 returned error can't find the container with id 9027d6ad2543ba89bdb8e682ea5df65dec6a914d7299ca41871c005eecd34a33
Jul 20 17:58:42.648414 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.648380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r692k" event={"ID":"b067cced-5894-4f28-99ab-c95b8ddf34cf","Type":"ContainerStarted","Data":"9027d6ad2543ba89bdb8e682ea5df65dec6a914d7299ca41871c005eecd34a33"}
Jul 20 17:58:42.722663 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.722616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 17:58:42.723393 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.723368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p"]
Jul 20 17:58:42.743521 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.743502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-sc8pz"]
Jul 20 17:58:42.773992 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:42.773960    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc6c363_a695_445c_81e6_e996af0a8a70.slice/crio-4ad40e381be87ef938af2dbfcd2229c1cb433cc64cb9de14d8382f9ebf18e8f4 WatchSource:0}: Error finding container 4ad40e381be87ef938af2dbfcd2229c1cb433cc64cb9de14d8382f9ebf18e8f4: Status 404 returned error can't find the container with id 4ad40e381be87ef938af2dbfcd2229c1cb433cc64cb9de14d8382f9ebf18e8f4
Jul 20 17:58:42.774786 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:42.774760    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714a59ad_a987_4bc2_9f25_bd7488aeb692.slice/crio-9eb9854feb655eaa90c074a05c748f4d1fa84a789d5fae981b061f473ec973a6 WatchSource:0}: Error finding container 9eb9854feb655eaa90c074a05c748f4d1fa84a789d5fae981b061f473ec973a6: Status 404 returned error can't find the container with id 9eb9854feb655eaa90c074a05c748f4d1fa84a789d5fae981b061f473ec973a6
Jul 20 17:58:42.775572 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:42.775526    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d22c22_3bf5_435b_9eff_e2189bfe593e.slice/crio-67dce343f10921eba48dfc4afab844a85356ad5030db490beaeee3eb45c16b44 WatchSource:0}: Error finding container 67dce343f10921eba48dfc4afab844a85356ad5030db490beaeee3eb45c16b44: Status 404 returned error can't find the container with id 67dce343f10921eba48dfc4afab844a85356ad5030db490beaeee3eb45c16b44
Jul 20 17:58:42.903578 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.903549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:42.910360 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.910335    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 17:58:42.913749 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.913733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:42.924252 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924229    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 17:58:42.924355 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924252    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 17:58:42.924454 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924439    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 17:58:42.924544 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 17:58:42.924599 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924578    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 17:58:42.924774 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924757    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 17:58:42.924842 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.924825    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 17:58:42.925172 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925152    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 17:58:42.925387 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925371    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 17:58:42.925472 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925456    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 17:58:42.925550 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 17:58:42.925664 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925650    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 17:58:42.925712 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925693    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ftt8b4m4e4gvl\""
Jul 20 17:58:42.925969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.925951    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 17:58:42.926868 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.926852    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pwvpf\""
Jul 20 17:58:42.931776 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.931745    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 17:58:42.932711 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.932690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 17:58:42.949800 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:42.949770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 17:58:43.071254 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-config\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071254 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071254 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071520 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071520 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071520 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071520 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071520 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071724 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071724 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071724 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071724 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071724 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5s9\" (UniqueName: \"kubernetes.io/projected/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-kube-api-access-5b5s9\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071724 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.071969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.071963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173001 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.172963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173182 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173182 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173182 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173182 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173182 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173448 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5s9\" (UniqueName: \"kubernetes.io/projected/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-kube-api-access-5b5s9\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173448 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173448 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173448 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173636 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173636 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173636 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173636 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173636 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-config\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173886 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173886 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173886 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173886 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.173886 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.173769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.174231 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.174124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.174821 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.174464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.175366 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.175344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.176706 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.176319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.176706 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.176354    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.176869 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.176781    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.176869 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.176840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.177384 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.177289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.177384 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.177333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.177534 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.177517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.179460 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.178723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-config\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.179460 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.179147    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.179460 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.179330    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.179460 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.179438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.179721 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.179441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.180232 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.180204    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.180814 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.180793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.181019 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.181001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.181552 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.181527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.188065 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.188042    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5s9\" (UniqueName: \"kubernetes.io/projected/e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74-kube-api-access-5b5s9\") pod \"prometheus-k8s-0\" (UID: \"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.227065 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.227022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:43.428096 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.427972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 17:58:43.433780 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:43.433738    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e0ab74_59bd_44b5_ab2a_1c6d4d764d74.slice/crio-bfa55071a51bce0baa6c3aa47cc3832d6ef4742dfbb3f92c9a62658915a9a4f9 WatchSource:0}: Error finding container bfa55071a51bce0baa6c3aa47cc3832d6ef4742dfbb3f92c9a62658915a9a4f9: Status 404 returned error can't find the container with id bfa55071a51bce0baa6c3aa47cc3832d6ef4742dfbb3f92c9a62658915a9a4f9
Jul 20 17:58:43.654939 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.654829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"bfa55071a51bce0baa6c3aa47cc3832d6ef4742dfbb3f92c9a62658915a9a4f9"}
Jul 20 17:58:43.656899 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.656780    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"4ad40e381be87ef938af2dbfcd2229c1cb433cc64cb9de14d8382f9ebf18e8f4"}
Jul 20 17:58:43.659821 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.659745    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz" event={"ID":"a9d22c22-3bf5-435b-9eff-e2189bfe593e","Type":"ContainerStarted","Data":"67dce343f10921eba48dfc4afab844a85356ad5030db490beaeee3eb45c16b44"}
Jul 20 17:58:43.664246 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.663198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-ttwzv" event={"ID":"4b14387b-9ad5-40fc-aea0-a90ec1a6ea61","Type":"ContainerStarted","Data":"f18934ef44b3d2a4bb641fc68313fc6ab70a850f6e56cf723a626a34eeb5971d"}
Jul 20 17:58:43.664246 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.664201    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:43.669331 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.669294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p" event={"ID":"714a59ad-a987-4bc2-9f25-bd7488aeb692","Type":"ContainerStarted","Data":"a0374acf650b7a69eba8243b2c466bb2140813600acdeac7a75ae3209fcab63c"}
Jul 20 17:58:43.669616 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.669352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p" event={"ID":"714a59ad-a987-4bc2-9f25-bd7488aeb692","Type":"ContainerStarted","Data":"829fb23d50592ed680621f329e168367a4fd8fb4484c5e70ee43f8fb7f430bc6"}
Jul 20 17:58:43.669616 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.669381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p" event={"ID":"714a59ad-a987-4bc2-9f25-bd7488aeb692","Type":"ContainerStarted","Data":"9eb9854feb655eaa90c074a05c748f4d1fa84a789d5fae981b061f473ec973a6"}
Jul 20 17:58:43.677394 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.677374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-ttwzv"
Jul 20 17:58:43.684738 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:43.684688    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-ttwzv" podStartSLOduration=2.262274242 podStartE2EDuration="22.684668368s" totalImagesPullingTime="20.422394126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:43.683939011 +0000 UTC m=+153.049916588" watchObservedRunningTime="2026-07-20 17:58:43.684668368 +0000 UTC m=+153.050645958"
Jul 20 17:58:44.133882 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:44.133816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:44.197603 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:44.197568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:46.684025 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.683987    2562 generic.go:356] "Generic (PLEG): container finished" podID="b067cced-5894-4f28-99ab-c95b8ddf34cf" containerID="b856e4ae28cf67b02967f6daca252efb2abf49ea701ee593a13aa30586d651a3" exitCode=0
Jul 20 17:58:46.684478 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.684108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r692k" event={"ID":"b067cced-5894-4f28-99ab-c95b8ddf34cf","Type":"ContainerDied","Data":"b856e4ae28cf67b02967f6daca252efb2abf49ea701ee593a13aa30586d651a3"}
Jul 20 17:58:46.686904 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.686764    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74" containerID="504b76d119ce26c5f46610d4f749a0a4a0cb30eca3e47c9041a5c8b607559cbd" exitCode=0
Jul 20 17:58:46.686904 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.686855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerDied","Data":"504b76d119ce26c5f46610d4f749a0a4a0cb30eca3e47c9041a5c8b607559cbd"}
Jul 20 17:58:46.692373 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.692335    2562 generic.go:356] "Generic (PLEG): container finished" podID="cfc6c363-a695-445c-81e6-e996af0a8a70" containerID="5ac20e39ae56b10ca3cba9245ff2334df367d8e8b385cb6207704362e7df28b1" exitCode=0
Jul 20 17:58:46.692481 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.692419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerDied","Data":"5ac20e39ae56b10ca3cba9245ff2334df367d8e8b385cb6207704362e7df28b1"}
Jul 20 17:58:46.696340 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.696235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz" event={"ID":"a9d22c22-3bf5-435b-9eff-e2189bfe593e","Type":"ContainerStarted","Data":"e6a2e95cfcac20013d8bfa2b387856a49a563b334e0cadc8641d33a55e6c56be"}
Jul 20 17:58:46.696340 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.696289    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz" event={"ID":"a9d22c22-3bf5-435b-9eff-e2189bfe593e","Type":"ContainerStarted","Data":"b2f13f09442094d0467155f73e3e2bf91a377008a1c81de3f94c9a5d1e2b7fd8"}
Jul 20 17:58:46.699070 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.699015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p" event={"ID":"714a59ad-a987-4bc2-9f25-bd7488aeb692","Type":"ContainerStarted","Data":"1678f21a7c60096d3a182f89fc536b72ae771a65da8d215d4f5ec97d39037464"}
Jul 20 17:58:46.786596 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:46.786552    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n4c7p" podStartSLOduration=7.545088857 podStartE2EDuration="10.786537207s" totalImagesPullingTime="3.24144835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:46.786001458 +0000 UTC m=+156.151979038" watchObservedRunningTime="2026-07-20 17:58:46.786537207 +0000 UTC m=+156.152514785"
Jul 20 17:58:47.711868 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:47.711792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz" event={"ID":"a9d22c22-3bf5-435b-9eff-e2189bfe593e","Type":"ContainerStarted","Data":"5cc36d872b355c9b594b4fa3269f7f62c8bd3fcf552dd0aa7df7e0bf2481f7db"}
Jul 20 17:58:47.715217 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:47.715061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r692k" event={"ID":"b067cced-5894-4f28-99ab-c95b8ddf34cf","Type":"ContainerStarted","Data":"513ef41db568e16b47002a8393f4e38b68c9db781d0e19b5776ba69241dfd462"}
Jul 20 17:58:47.715455 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:47.715374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r692k" event={"ID":"b067cced-5894-4f28-99ab-c95b8ddf34cf","Type":"ContainerStarted","Data":"7d296be81bff1f7f51b974b666c7ce329752558f3240f841604a3d53330e78c3"}
Jul 20 17:58:47.733958 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:47.733887    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-sc8pz" podStartSLOduration=8.357003042 podStartE2EDuration="11.733868977s" totalImagesPullingTime="3.376865935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:47.732231885 +0000 UTC m=+157.098209465" watchObservedRunningTime="2026-07-20 17:58:47.733868977 +0000 UTC m=+157.099846558"
Jul 20 17:58:47.756014 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:47.755937    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r692k" podStartSLOduration=7.956997987 podStartE2EDuration="11.755890073s" totalImagesPullingTime="3.596004571s" totalInitContainerRuntime="202.887515ms" isStatefulPod=true podCreationTimestamp="2026-07-20 17:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:47.754709082 +0000 UTC m=+157.120686673" watchObservedRunningTime="2026-07-20 17:58:47.755890073 +0000 UTC m=+157.121867651"
Jul 20 17:58:48.569761 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:58:48.569723    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xfhzz" podUID="52773415-b6f1-4a86-9bfa-d23c15838389"
Jul 20 17:58:48.720440 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:48.720404    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:58:49.731030 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:49.730943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"ef1baba740fd2da29dfa8874781f9e8bd7c0158c1d1d4355a9a357a5a3ca78fb"}
Jul 20 17:58:49.731494 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:49.731029    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"299a36e50778890390e66712137318efee964b1cfc8f6e1c4544def466af95ac"}
Jul 20 17:58:49.731494 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:49.731111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"cfda09007210867bd3505a2ca76f1fac965e1edfaee7154cf7f299ccee7b0284"}
Jul 20 17:58:49.731494 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:49.731161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"d691b8adc2556b7806af0f2425ae0c3b1b90cf4f9ac5c89e54cf38012e5fe2c9"}
Jul 20 17:58:49.731494 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:49.731199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"9198f70b6ede35639d248912827c22fd4ede72c01c8311adc905c343bb95f197"}
Jul 20 17:58:50.328322 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:50.328241    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:50.448634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:50.448598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:51.746674 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:51.746578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"cc2ca2522dc3d649bb8695de07d7cb4f0a99558b34990d254fd2c57c933e2810"}
Jul 20 17:58:51.840621 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:51.840588    2562 patch_prober.go:28] interesting pod/console-d79bd7776-zg7gn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Jul 20 17:58:51.840812 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:51.840652    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d79bd7776-zg7gn" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Jul 20 17:58:52.753201 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:52.753158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"b1cff30b733e33d86cf0554b05d8e23e651529eb14e216eb40a784ba8ee00e4b"}
Jul 20 17:58:52.757151 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:52.757123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfc6c363-a695-445c-81e6-e996af0a8a70","Type":"ContainerStarted","Data":"017586ed0bc7eefd0182df3667fe4e28740283cb4044e0b7d6a8a824ec6faba2"}
Jul 20 17:58:52.794632 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:52.794576    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.415768604 podStartE2EDuration="15.794560289s" totalImagesPullingTime="8.352017626s" totalInitContainerRuntime="26.774059ms" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:52.79351785 +0000 UTC m=+162.159495680" watchObservedRunningTime="2026-07-20 17:58:52.794560289 +0000 UTC m=+162.160537868"
Jul 20 17:58:53.477268 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.477230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:58:53.479429 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.479401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52773415-b6f1-4a86-9bfa-d23c15838389-metrics-tls\") pod \"dns-default-xfhzz\" (UID: \"52773415-b6f1-4a86-9bfa-d23c15838389\") " pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:58:53.492563 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.492534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.524755 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.524726    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m6nkv\""
Jul 20 17:58:53.532734 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.532710    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:58:53.635296 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.635259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.704875 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:53.704837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:54.093163 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.093125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:54.182423 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.182237    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xfhzz"]
Jul 20 17:58:54.185230 ip-10-0-138-227 kubenswrapper[2562]: W0720 17:58:54.185204    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52773415_b6f1_4a86_9bfa_d23c15838389.slice/crio-704b85adcb94d47f694f868f6cbb4ba76407e346f2dac1b0eb5882d42da281d7 WatchSource:0}: Error finding container 704b85adcb94d47f694f868f6cbb4ba76407e346f2dac1b0eb5882d42da281d7: Status 404 returned error can't find the container with id 704b85adcb94d47f694f868f6cbb4ba76407e346f2dac1b0eb5882d42da281d7
Jul 20 17:58:54.200864 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.200835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:54.300132 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.300057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:54.766999 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.766966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xfhzz" event={"ID":"52773415-b6f1-4a86-9bfa-d23c15838389","Type":"ContainerStarted","Data":"704b85adcb94d47f694f868f6cbb4ba76407e346f2dac1b0eb5882d42da281d7"}
Jul 20 17:58:54.770564 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.770530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"75d740522a56f582dff4103cf26aafc3bc3ce49ee688ebc960593a12cd30586a"}
Jul 20 17:58:54.770681 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.770603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"762aaacf861f1283d38809d74ec89ab9d90da3d973db08b35d09c4a57227aee8"}
Jul 20 17:58:54.770681 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:54.770647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"bf0f78aa7de12a7bb5c4cc55bb5eac2079b465feaf9e6522c29056d14d66df2a"}
Jul 20 17:58:55.779096 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:55.779054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74","Type":"ContainerStarted","Data":"0b0cf9f111ebe9721529c9b89a4c99aa882cdfbe3e91e47056358087edf4443c"}
Jul 20 17:58:55.832968 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:55.832576    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.4566178069999998 podStartE2EDuration="13.832554113s" totalImagesPullingTime="10.328448244s" totalInitContainerRuntime="47.488062ms" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:55.831401214 +0000 UTC m=+165.197378795" watchObservedRunningTime="2026-07-20 17:58:55.832554113 +0000 UTC m=+165.198531693"
Jul 20 17:58:56.785240 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:56.785144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xfhzz" event={"ID":"52773415-b6f1-4a86-9bfa-d23c15838389","Type":"ContainerStarted","Data":"d1d9fa638f9d756412b16b7849b2fdc41b53af25bdfcd90dab5732dd7fd7eb5e"}
Jul 20 17:58:56.785240 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:56.785204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xfhzz" event={"ID":"52773415-b6f1-4a86-9bfa-d23c15838389","Type":"ContainerStarted","Data":"78a0d5ee51ad5da97a265b04ab9021d75434cffcf04c16e3567ff37745e71e16"}
Jul 20 17:58:56.785666 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:56.785548    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:58:56.806660 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:56.806613    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xfhzz" podStartSLOduration=129.710340288 podStartE2EDuration="2m11.80659713s" totalImagesPullingTime="2.096256842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:56.804343558 +0000 UTC m=+166.170321139" watchObservedRunningTime="2026-07-20 17:58:56.80659713 +0000 UTC m=+166.172574710"
Jul 20 17:58:58.227577 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:58.227546    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:58:59.905656 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:58:59.905618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:00.009047 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:00.008994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:00.076492 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:00.076461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:00.159495 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:00.159397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:00.223760 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:00.223732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:01.833700 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:01.833669    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d79bd7776-zg7gn"]
Jul 20 17:59:01.959007 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:01.958971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:02.062253 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:02.062222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:02.175168 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:02.175080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:02.345478 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:02.345440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:02.417066 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:02.416992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:06.089638 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:06.089591    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xfhzz_52773415-b6f1-4a86-9bfa-d23c15838389/dns/0.log"
Jul 20 17:59:06.183411 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:06.183385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xfhzz_52773415-b6f1-4a86-9bfa-d23c15838389/kube-rbac-proxy/0.log"
Jul 20 17:59:06.383102 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:06.383017    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fh7nh_239fc666-92b4-4452-900b-482d4c7e2ba4/dns-node-resolver/0.log"
Jul 20 17:59:06.984935 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:06.984901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-2httt_50b8d0ec-8f68-4bff-a9bd-edbd36297e4e/cluster-samples-operator/0.log"
Jul 20 17:59:07.182055 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:07.182025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-2httt_50b8d0ec-8f68-4bff-a9bd-edbd36297e4e/cluster-samples-operator-watch/0.log"
Jul 20 17:59:07.795615 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:07.795590    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xfhzz"
Jul 20 17:59:09.254763 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:09.254723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:09.324870 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:09.324830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:13.751639 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:13.751585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:13.895907 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:13.895877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:16.968844 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:16.968811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:17.072634 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:17.072600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:26.045262 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:26.045231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:26.121307 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:26.121269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:26.854347 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:26.854311    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d79bd7776-zg7gn" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console" containerID="cri-o://0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2" gracePeriod=15
Jul 20 17:59:27.141905 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.141880    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:59:27.193981 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.193943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-trusted-ca-bundle\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.193981 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.193978    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-console-config\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.194220 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.193996    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-oauth-serving-cert\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.194220 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194043    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-serving-cert\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.194220 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-service-ca\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.194220 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194112    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smtz\" (UniqueName: \"kubernetes.io/projected/a279779a-a368-47fd-a96f-e635d3aa1342-kube-api-access-4smtz\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.194220 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194147    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-oauth-config\") pod \"a279779a-a368-47fd-a96f-e635d3aa1342\" (UID: \"a279779a-a368-47fd-a96f-e635d3aa1342\") "
Jul 20 17:59:27.194513 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194384    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-console-config" (OuterVolumeSpecName: "console-config") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:59:27.194513 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194434    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:59:27.194627 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194514    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-service-ca" (OuterVolumeSpecName: "service-ca") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:59:27.194819 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.194785    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:59:27.196619 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.196592    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a279779a-a368-47fd-a96f-e635d3aa1342-kube-api-access-4smtz" (OuterVolumeSpecName: "kube-api-access-4smtz") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "kube-api-access-4smtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 17:59:27.196805 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.196785    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:59:27.196885 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.196867    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a279779a-a368-47fd-a96f-e635d3aa1342" (UID: "a279779a-a368-47fd-a96f-e635d3aa1342"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:59:27.295581 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295548    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-oauth-serving-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.295581 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295575    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-serving-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.295581 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295584    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-service-ca\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.295783 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295593    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smtz\" (UniqueName: \"kubernetes.io/projected/a279779a-a368-47fd-a96f-e635d3aa1342-kube-api-access-4smtz\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.295783 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295601    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a279779a-a368-47fd-a96f-e635d3aa1342-console-oauth-config\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.295783 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295609    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-trusted-ca-bundle\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.295783 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.295617    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a279779a-a368-47fd-a96f-e635d3aa1342-console-config\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 17:59:27.919252 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.919218    2562 generic.go:356] "Generic (PLEG): container finished" podID="a279779a-a368-47fd-a96f-e635d3aa1342" containerID="0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2" exitCode=0
Jul 20 17:59:27.919431 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.919270    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79bd7776-zg7gn"
Jul 20 17:59:27.919431 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.919285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79bd7776-zg7gn" event={"ID":"a279779a-a368-47fd-a96f-e635d3aa1342","Type":"ContainerDied","Data":"0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2"}
Jul 20 17:59:27.919431 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.919325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79bd7776-zg7gn" event={"ID":"a279779a-a368-47fd-a96f-e635d3aa1342","Type":"ContainerDied","Data":"5412262a8992fc6baaa178c87000a177257a1efea211bef4d7a8e72532fae99a"}
Jul 20 17:59:27.919431 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.919344    2562 scope.go:117] "RemoveContainer" containerID="0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2"
Jul 20 17:59:27.928713 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.928694    2562 scope.go:117] "RemoveContainer" containerID="0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2"
Jul 20 17:59:27.929027 ip-10-0-138-227 kubenswrapper[2562]: E0720 17:59:27.929006    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2\": container with ID starting with 0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2 not found: ID does not exist" containerID="0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2"
Jul 20 17:59:27.929089 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.929033    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2"} err="failed to get container status \"0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2\": rpc error: code = NotFound desc = could not find container \"0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2\": container with ID starting with 0a86a3881f451f0025ef8d50ad7908b96432caf96214d157f5d8c30be81090f2 not found: ID does not exist"
Jul 20 17:59:27.942912 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.942886    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d79bd7776-zg7gn"]
Jul 20 17:59:27.947544 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:27.947522    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d79bd7776-zg7gn"]
Jul 20 17:59:28.697138 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:28.697108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:28.770662 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:28.770628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:29.134670 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:29.134636    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" path="/var/lib/kubelet/pods/a279779a-a368-47fd-a96f-e635d3aa1342/volumes"
Jul 20 17:59:43.228001 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:43.227966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:59:43.243334 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:43.243308    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:59:43.998798 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:43.998774    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:59:55.845461 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:55.845416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:56.241969 ip-10-0-138-227 kubenswrapper[2562]: I0720 17:59:56.241872    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:07.167168 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:07.167118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:07.229595 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:07.229567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:08.108536 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:08.108505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:08.168008 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:08.167972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:11.147538 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:11.147504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:11.199284 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:11.199246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:23.070251 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:23.070213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:23.288969 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:23.288936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:29.538434 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:29.538397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:29.596265 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:29.596228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:36.069974 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:36.069942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:36.523944 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:36.523878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:50.367971 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:00:50.367908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:10.985572 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:01:10.985537    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 18:01:27.126243 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:01:27.126197    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:27.222983 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:01:27.222942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:58.660410 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:01:58.660379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:00.051703 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:00.051672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:02.670731 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:02.670646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:02.733496 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:02.733457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:06.212409 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:06.212371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:06.313839 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:06.313802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:06.431288 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:06.431248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:09.465219 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:09.465185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:10.827938 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:10.827887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:14.473679 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:14.473609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:14.573870 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:14.573839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:15.254191 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:15.254156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:20.340114 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:20.340080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:20.441031 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:20.440981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:23.172987 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:23.172957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:23.266235 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:23.266197    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:24.991512 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:24.991482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:36.774827 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:36.774787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:37.122769 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:37.122659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:37.221655 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:37.221614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:37.705147 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:37.705116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:37.965320 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:37.965236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.087848 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.087816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.126246 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.126216    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"]
Jul 20 18:02:38.126543 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.126531    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console"
Jul 20 18:02:38.126592 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.126546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console"
Jul 20 18:02:38.126628 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.126609    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a279779a-a368-47fd-a96f-e635d3aa1342" containerName="console"
Jul 20 18:02:38.128699 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.128683    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.132526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.132501    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 18:02:38.133046 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.133025    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 18:02:38.133176 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.133050    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 18:02:38.133176 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.133129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4q2sn\""
Jul 20 18:02:38.133831 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.133814    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 18:02:38.145525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.145493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v754s\" (UniqueName: \"kubernetes.io/projected/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-kube-api-access-v754s\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.145637 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.145535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.145637 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.145608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-tmp\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.145744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.145641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.145744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.145669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-manifests\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.191492 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.191464    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"]
Jul 20 18:02:38.247030 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.246942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-manifests\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.247030 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.247001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v754s\" (UniqueName: \"kubernetes.io/projected/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-kube-api-access-v754s\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.247253 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.247048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.247253 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.247088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-tmp\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.247253 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.247129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.247399 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.247349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-manifests\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.249271 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.249249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-tmp\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.249377 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.249309    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.249500 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.249483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.260252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.260229    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v754s\" (UniqueName: \"kubernetes.io/projected/4b8111bb-6583-4b6c-b2de-547c9e93fc4c-kube-api-access-v754s\") pod \"opendatahub-operator-controller-manager-79747b4d4c-dx8nf\" (UID: \"4b8111bb-6583-4b6c-b2de-547c9e93fc4c\") " pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.268032 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.267993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.370066 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.370021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.438639 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.438608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:38.471789 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.471757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.554745 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.554715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.573563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.573488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"]
Jul 20 18:02:38.576521 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:02:38.576498    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8111bb_6583_4b6c_b2de_547c9e93fc4c.slice/crio-747a74d40d208ac14549c894bd8c66c9d71968b6d3ac3c63451bf52ff8969dc4 WatchSource:0}: Error finding container 747a74d40d208ac14549c894bd8c66c9d71968b6d3ac3c63451bf52ff8969dc4: Status 404 returned error can't find the container with id 747a74d40d208ac14549c894bd8c66c9d71968b6d3ac3c63451bf52ff8969dc4
Jul 20 18:02:38.578285 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.578266    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:02:38.642218 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.642186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.643452 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.643432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf" event={"ID":"4b8111bb-6583-4b6c-b2de-547c9e93fc4c","Type":"ContainerStarted","Data":"747a74d40d208ac14549c894bd8c66c9d71968b6d3ac3c63451bf52ff8969dc4"}
Jul 20 18:02:38.742122 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.742087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.948154 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:38.948059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:42.664372 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:42.664333    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf" event={"ID":"4b8111bb-6583-4b6c-b2de-547c9e93fc4c","Type":"ContainerStarted","Data":"05a2b5d118a5e7efb32b4587ddfa9250ce1474758149b79a523b88a7b94d0ec7"}
Jul 20 18:02:43.669449 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:43.669420    2562 generic.go:356] "Generic (PLEG): container finished" podID="4b8111bb-6583-4b6c-b2de-547c9e93fc4c" containerID="05a2b5d118a5e7efb32b4587ddfa9250ce1474758149b79a523b88a7b94d0ec7" exitCode=0
Jul 20 18:02:43.669801 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:43.669487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf" event={"ID":"4b8111bb-6583-4b6c-b2de-547c9e93fc4c","Type":"ContainerDied","Data":"05a2b5d118a5e7efb32b4587ddfa9250ce1474758149b79a523b88a7b94d0ec7"}
Jul 20 18:02:44.676025 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:44.675988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf" event={"ID":"4b8111bb-6583-4b6c-b2de-547c9e93fc4c","Type":"ContainerStarted","Data":"61fd47d6aed99020ac988603be6a395bc206ddc7fd15212583e2f1dc52fce8c5"}
Jul 20 18:02:44.676372 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:44.676104    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:45.018288 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:45.018256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:45.359523 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:45.359441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:45.453559 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:45.453527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:55.681824 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:55.681789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf"
Jul 20 18:02:55.707648 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:55.707599    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79747b4d4c-dx8nf" podStartSLOduration=13.20705756 podStartE2EDuration="17.707583033s" totalImagesPullingTime="3.435317013s" totalInitContainerRuntime="1.06520846s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:02:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:02:44.697258732 +0000 UTC m=+394.063236323" watchObservedRunningTime="2026-07-20 18:02:55.707583033 +0000 UTC m=+405.073560611"
Jul 20 18:02:57.421401 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:57.421368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:57.616386 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:57.616348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:57.839972 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:57.839936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:57.992780 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:57.992754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:58.134769 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.134683    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"]
Jul 20 18:02:58.144593 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.144565    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.147872 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.147850    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:02:58.148016 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.147969    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 18:02:58.149153 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.149131    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 18:02:58.149285 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.149173    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 18:02:58.149285 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.149178    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tpzld\""
Jul 20 18:02:58.149285 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.149235    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 18:02:58.160613 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.160582    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"]
Jul 20 18:02:58.224174 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.224138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6wcp\" (UniqueName: \"kubernetes.io/projected/fabeea22-9957-4211-a88d-d8be7d133d48-kube-api-access-w6wcp\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.224360 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.224191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fabeea22-9957-4211-a88d-d8be7d133d48-metrics-cert\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.224360 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.224262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabeea22-9957-4211-a88d-d8be7d133d48-cert\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.224360 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.224283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fabeea22-9957-4211-a88d-d8be7d133d48-manager-config\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.325563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.325520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6wcp\" (UniqueName: \"kubernetes.io/projected/fabeea22-9957-4211-a88d-d8be7d133d48-kube-api-access-w6wcp\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.325799 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.325591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fabeea22-9957-4211-a88d-d8be7d133d48-metrics-cert\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.325799 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.325656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabeea22-9957-4211-a88d-d8be7d133d48-cert\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.325799 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.325685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fabeea22-9957-4211-a88d-d8be7d133d48-manager-config\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.326539 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.326501    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fabeea22-9957-4211-a88d-d8be7d133d48-manager-config\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.329047 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.329020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabeea22-9957-4211-a88d-d8be7d133d48-cert\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.329171 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.329068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fabeea22-9957-4211-a88d-d8be7d133d48-metrics-cert\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.361257 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.361227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6wcp\" (UniqueName: \"kubernetes.io/projected/fabeea22-9957-4211-a88d-d8be7d133d48-kube-api-access-w6wcp\") pod \"lws-controller-manager-57d4489cf8-n2mzz\" (UID: \"fabeea22-9957-4211-a88d-d8be7d133d48\") " pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.363858 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.363826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:58.454161 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.454070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:02:58.483284 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.483249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:58.626390 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.626342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:58.628632 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.628612    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"]
Jul 20 18:02:58.631450 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:02:58.631425    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabeea22_9957_4211_a88d_d8be7d133d48.slice/crio-7a66795ce813becd11dd5f58b35bf69390d103ca99bd4b0b050ea3f83d367ab7 WatchSource:0}: Error finding container 7a66795ce813becd11dd5f58b35bf69390d103ca99bd4b0b050ea3f83d367ab7: Status 404 returned error can't find the container with id 7a66795ce813becd11dd5f58b35bf69390d103ca99bd4b0b050ea3f83d367ab7
Jul 20 18:02:58.738419 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.738335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz" event={"ID":"fabeea22-9957-4211-a88d-d8be7d133d48","Type":"ContainerStarted","Data":"7a66795ce813becd11dd5f58b35bf69390d103ca99bd4b0b050ea3f83d367ab7"}
Jul 20 18:02:58.883906 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:58.883870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:59.369504 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:59.369471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:59.541931 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:59.541880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:59.800396 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:59.800352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:59.888815 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:02:59.888783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:00.794132 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:00.794074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:02.760313 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:02.760276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz" event={"ID":"fabeea22-9957-4211-a88d-d8be7d133d48","Type":"ContainerStarted","Data":"50d81d01b668cb06ad9e3d8eb77b3c38c708a493b055e0503f072a4c0d6e031e"}
Jul 20 18:03:02.760747 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:02.760512    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:03:02.778162 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:02.778114    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz" podStartSLOduration=1.41259581 podStartE2EDuration="4.778097696s" totalImagesPullingTime="3.365501886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:03:02.777462711 +0000 UTC m=+412.143440304" watchObservedRunningTime="2026-07-20 18:03:02.778097696 +0000 UTC m=+412.144075275"
Jul 20 18:03:06.899222 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.899185    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"]
Jul 20 18:03:06.901682 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.901662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:06.904300 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.904273    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 18:03:06.904430 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.904326    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 18:03:06.904430 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.904391    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 18:03:06.904430 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.904400    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 18:03:06.904722 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.904704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-55w2v\""
Jul 20 18:03:06.913840 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:06.913819    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"]
Jul 20 18:03:07.004871 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.004839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.004871 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.004877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.005116 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.004899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jqpd\" (UniqueName: \"kubernetes.io/projected/ca6fe371-f421-4be6-8d26-e02bc9ab1409-kube-api-access-7jqpd\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.005116 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.004931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca6fe371-f421-4be6-8d26-e02bc9ab1409-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.005116 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.004948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.005116 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.005038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.005116 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.005075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.060674 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.060644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:07.105681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.105837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.105837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.105837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jqpd\" (UniqueName: \"kubernetes.io/projected/ca6fe371-f421-4be6-8d26-e02bc9ab1409-kube-api-access-7jqpd\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.105999 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca6fe371-f421-4be6-8d26-e02bc9ab1409-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.105999 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.105999 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.105947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.106472 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.106438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.108212 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.108184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.108307 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.108210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca6fe371-f421-4be6-8d26-e02bc9ab1409-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.108307 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.108289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.108376 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.108318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.124394 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.124363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca6fe371-f421-4be6-8d26-e02bc9ab1409-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.124671 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.124653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jqpd\" (UniqueName: \"kubernetes.io/projected/ca6fe371-f421-4be6-8d26-e02bc9ab1409-kube-api-access-7jqpd\") pod \"istiod-openshift-gateway-94bb8fbfd-8b729\" (UID: \"ca6fe371-f421-4be6-8d26-e02bc9ab1409\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.180371 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.180279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:07.210367 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.210320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:07.362205 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.362168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"]
Jul 20 18:03:07.365465 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:03:07.365421    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6fe371_f421_4be6_8d26_e02bc9ab1409.slice/crio-c502f6a790f0022c65cf1b32f8c9b596afd5babbafc790ed60eaa2aa067f16ca WatchSource:0}: Error finding container c502f6a790f0022c65cf1b32f8c9b596afd5babbafc790ed60eaa2aa067f16ca: Status 404 returned error can't find the container with id c502f6a790f0022c65cf1b32f8c9b596afd5babbafc790ed60eaa2aa067f16ca
Jul 20 18:03:07.783290 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:07.783258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729" event={"ID":"ca6fe371-f421-4be6-8d26-e02bc9ab1409","Type":"ContainerStarted","Data":"c502f6a790f0022c65cf1b32f8c9b596afd5babbafc790ed60eaa2aa067f16ca"}
Jul 20 18:03:08.168937 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:08.168847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:08.385278 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:08.385243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:08.480121 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:08.480034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:10.160424 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:10.160377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:10.264563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:10.264523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:10.376022 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:10.375908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:10.477189 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:10.476967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:11.438966 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:11.438894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:11.557323 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:11.557290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:11.671753 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:11.671716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:12.151253 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:12.151202    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:03:12.151388 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:12.151295    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:03:12.807591 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:12.807552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729" event={"ID":"ca6fe371-f421-4be6-8d26-e02bc9ab1409","Type":"ContainerStarted","Data":"a29d911b2ce4745a8091f4f45508de2bbbfa445e8cb543f5b5d7e95477ac0398"}
Jul 20 18:03:12.808043 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:12.807681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:12.831766 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:12.831710    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729" podStartSLOduration=2.048079991 podStartE2EDuration="6.831694127s" totalImagesPullingTime="4.783614136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:03:12.830181971 +0000 UTC m=+422.196159582" watchObservedRunningTime="2026-07-20 18:03:12.831694127 +0000 UTC m=+422.197671704"
Jul 20 18:03:13.767094 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:13.767059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57d4489cf8-n2mzz"
Jul 20 18:03:13.814155 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:13.814130    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b729"
Jul 20 18:03:58.984704 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:58.984669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:59.083721 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:59.083685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:59.178972 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:59.178910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:59.919104 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:03:59.919067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:00.120306 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:00.120261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:27.978319 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:27.978288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:32.203572 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:32.203537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:34.645902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:34.645866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:35.212055 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:35.212015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:35.502594 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:35.502565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:35.598189 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:35.598140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:37.236565 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:37.236529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:38.708032 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:38.707993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:39.958761 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:39.958723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:43.072617 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:43.072583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:43.623623 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:43.623593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:44.812746 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:44.812711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:44.917060 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:44.917026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:47.214708 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:47.214672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:47.315448 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:47.315414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:52.605215 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:52.605181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:52.705144 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:52.705111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:53.382028 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:53.381992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:53.938493 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:53.938461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:56.171150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:56.171113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:56.272055 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:04:56.272025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:02.865877 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:02.865795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:03.132542 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.132451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:03.630288 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.630252    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"]
Jul 20 18:05:03.632601 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.632584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:03.635532 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.635510    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 18:05:03.635641 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.635521    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 18:05:03.635641 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.635621    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fn4h6\""
Jul 20 18:05:03.649951 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.649909    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"]
Jul 20 18:05:03.791930 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.791895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfrt\" (UniqueName: \"kubernetes.io/projected/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-kube-api-access-8xfrt\") pod \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" (UID: \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:03.792150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.792070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" (UID: \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:03.891884 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.891798    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"]
Jul 20 18:05:03.892347 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:05:03.892090    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-8xfrt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb" podUID="6bb0828a-4912-4a3a-b756-1f9fa91d5fa8"
Jul 20 18:05:03.893404 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.893371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfrt\" (UniqueName: \"kubernetes.io/projected/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-kube-api-access-8xfrt\") pod \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" (UID: \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:03.893524 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.893481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" (UID: \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:03.893900 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.893878    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" (UID: \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:03.906552 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.906520    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"]
Jul 20 18:05:03.908654 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:05:03.908630    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8xfrt for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb: failed to fetch token: pods "kuadrant-operator-controller-manager-86878c769f-p4nlb" not found
Jul 20 18:05:03.908785 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:05:03.908709    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-kube-api-access-8xfrt podName:6bb0828a-4912-4a3a-b756-1f9fa91d5fa8 nodeName:}" failed. No retries permitted until 2026-07-20 18:05:04.408691465 +0000 UTC m=+533.774669022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8xfrt" (UniqueName: "kubernetes.io/projected/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-kube-api-access-8xfrt") pod "kuadrant-operator-controller-manager-86878c769f-p4nlb" (UID: "6bb0828a-4912-4a3a-b756-1f9fa91d5fa8") : failed to fetch token: pods "kuadrant-operator-controller-manager-86878c769f-p4nlb" not found
Jul 20 18:05:03.935945 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.935898    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"]
Jul 20 18:05:03.938983 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:03.938965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.015706 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.015668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"]
Jul 20 18:05:04.095144 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.095102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655c6\" (UniqueName: \"kubernetes.io/projected/0fadf150-19ec-4587-b994-9c4a1f090c6d-kube-api-access-655c6\") pod \"kuadrant-operator-controller-manager-86878c769f-vh7d9\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.095313 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.095168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fadf150-19ec-4587-b994-9c4a1f090c6d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh7d9\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.196041 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.195955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655c6\" (UniqueName: \"kubernetes.io/projected/0fadf150-19ec-4587-b994-9c4a1f090c6d-kube-api-access-655c6\") pod \"kuadrant-operator-controller-manager-86878c769f-vh7d9\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.196041 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.196015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fadf150-19ec-4587-b994-9c4a1f090c6d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh7d9\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.196399 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.196383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fadf150-19ec-4587-b994-9c4a1f090c6d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vh7d9\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.211792 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.211765    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-655c6\" (UniqueName: \"kubernetes.io/projected/0fadf150-19ec-4587-b994-9c4a1f090c6d-kube-api-access-655c6\") pod \"kuadrant-operator-controller-manager-86878c769f-vh7d9\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.248495 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.248467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:04.283066 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.283035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:04.287564 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:05:04.287533    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" is forbidden: User \"system:node:ip-10-0-138-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-227.ec2.internal' and this object" podUID="6bb0828a-4912-4a3a-b756-1f9fa91d5fa8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:04.289526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.289509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:04.296326 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:05:04.296292    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" is forbidden: User \"system:node:ip-10-0-138-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-227.ec2.internal' and this object" podUID="6bb0828a-4912-4a3a-b756-1f9fa91d5fa8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:04.386696 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.386664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"]
Jul 20 18:05:04.391449 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:05:04.391420    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fadf150_19ec_4587_b994_9c4a1f090c6d.slice/crio-4469f16201499aaa7aaebc29294126965bdae8761a9c92ec75821d95f2b382d1 WatchSource:0}: Error finding container 4469f16201499aaa7aaebc29294126965bdae8761a9c92ec75821d95f2b382d1: Status 404 returned error can't find the container with id 4469f16201499aaa7aaebc29294126965bdae8761a9c92ec75821d95f2b382d1
Jul 20 18:05:04.397656 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.397635    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-extensions-socket-volume\") pod \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\" (UID: \"6bb0828a-4912-4a3a-b756-1f9fa91d5fa8\") "
Jul 20 18:05:04.397884 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.397863    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xfrt\" (UniqueName: \"kubernetes.io/projected/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-kube-api-access-8xfrt\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:05:04.398027 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.397899    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6bb0828a-4912-4a3a-b756-1f9fa91d5fa8" (UID: "6bb0828a-4912-4a3a-b756-1f9fa91d5fa8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:05:04.499207 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:04.499179    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8-extensions-socket-volume\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:05:05.131062 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:05.131030    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb0828a-4912-4a3a-b756-1f9fa91d5fa8" path="/var/lib/kubelet/pods/6bb0828a-4912-4a3a-b756-1f9fa91d5fa8/volumes"
Jul 20 18:05:05.288863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:05.288835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:05.288863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:05.288843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9" event={"ID":"0fadf150-19ec-4587-b994-9c4a1f090c6d","Type":"ContainerStarted","Data":"4469f16201499aaa7aaebc29294126965bdae8761a9c92ec75821d95f2b382d1"}
Jul 20 18:05:05.294095 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:05:05.294070    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-p4nlb\" is forbidden: User \"system:node:ip-10-0-138-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-227.ec2.internal' and this object" podUID="6bb0828a-4912-4a3a-b756-1f9fa91d5fa8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4nlb"
Jul 20 18:05:05.641486 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:05.641450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:08.195578 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:08.195543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:08.294864 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:08.294828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:08.543413 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:08.543377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:10.315596 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:10.315562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9" event={"ID":"0fadf150-19ec-4587-b994-9c4a1f090c6d","Type":"ContainerStarted","Data":"39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5"}
Jul 20 18:05:10.315966 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:10.315640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:10.338173 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:10.338126    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9" podStartSLOduration=2.17328863 podStartE2EDuration="7.338110895s" totalImagesPullingTime="5.164822265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:05:10.335557538 +0000 UTC m=+539.701535145" watchObservedRunningTime="2026-07-20 18:05:10.338110895 +0000 UTC m=+539.704088474"
Jul 20 18:05:10.631999 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:10.631877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:10.748080 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:10.748048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:14.190152 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:14.190086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:14.291421 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:14.291389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:21.321798 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:21.321768    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:05:38.002342 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:38.002304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:38.139534 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:38.139496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:40.267807 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:40.267776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:40.377314 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:40.377276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:40.438074 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:40.438042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:41.104656 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:41.104623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:41.205455 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:05:41.205394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:01.714357 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:01.714319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:03.173776 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:03.173745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:03.274630 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:03.274598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:10.490955 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:10.490907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:10.592275 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:10.592227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:14.730196 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:14.730158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:15.981181 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:15.981147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:22.570284 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:22.570245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:23.593951 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:23.593900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:23.660887 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:23.660834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:25.832270 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:25.832230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:25.957749 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:25.957678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:55.179531 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.179488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:55.269235 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.269182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:55.825453 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.825421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:55.948067 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.948034    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"]
Jul 20 18:06:55.950540 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.950524    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:55.953661 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.953640    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 18:06:55.953773 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.953682    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 18:06:55.954576 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.954558    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h2tfv\""
Jul 20 18:06:55.954683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.954564    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 18:06:55.962400 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:55.962379    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"]
Jul 20 18:06:56.036000 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.035968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:56.044933 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.044894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpgg\" (UniqueName: \"kubernetes.io/projected/0225c282-6a0b-4f3f-94d5-8926c46876ad-kube-api-access-2cpgg\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.045022 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.044966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0225c282-6a0b-4f3f-94d5-8926c46876ad-maas-api-tls\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.045022 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.044998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0225c282-6a0b-4f3f-94d5-8926c46876ad-openshift-service-ca\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.145478 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.145398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpgg\" (UniqueName: \"kubernetes.io/projected/0225c282-6a0b-4f3f-94d5-8926c46876ad-kube-api-access-2cpgg\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.145478 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.145440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0225c282-6a0b-4f3f-94d5-8926c46876ad-maas-api-tls\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.145478 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.145459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0225c282-6a0b-4f3f-94d5-8926c46876ad-openshift-service-ca\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.146022 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.146006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0225c282-6a0b-4f3f-94d5-8926c46876ad-openshift-service-ca\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.147821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.147797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0225c282-6a0b-4f3f-94d5-8926c46876ad-maas-api-tls\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.153794 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.153774    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpgg\" (UniqueName: \"kubernetes.io/projected/0225c282-6a0b-4f3f-94d5-8926c46876ad-kube-api-access-2cpgg\") pod \"maas-api-5d978fb74-6s5l5\" (UID: \"0225c282-6a0b-4f3f-94d5-8926c46876ad\") " pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.261378 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.261346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:56.404563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.404478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"]
Jul 20 18:06:56.408477 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:06:56.408445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0225c282_6a0b_4f3f_94d5_8926c46876ad.slice/crio-ab97b09b2e48d1059df37bd0a68cf73aaf5aa0b5231c87b90b7b3216fa26284c WatchSource:0}: Error finding container ab97b09b2e48d1059df37bd0a68cf73aaf5aa0b5231c87b90b7b3216fa26284c: Status 404 returned error can't find the container with id ab97b09b2e48d1059df37bd0a68cf73aaf5aa0b5231c87b90b7b3216fa26284c
Jul 20 18:06:56.463072 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.463043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:56.560298 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.560271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:56.781779 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:56.781739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5" event={"ID":"0225c282-6a0b-4f3f-94d5-8926c46876ad","Type":"ContainerStarted","Data":"ab97b09b2e48d1059df37bd0a68cf73aaf5aa0b5231c87b90b7b3216fa26284c"}
Jul 20 18:06:58.794150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:58.794116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5" event={"ID":"0225c282-6a0b-4f3f-94d5-8926c46876ad","Type":"ContainerStarted","Data":"c0d4d681f49a3bcb95797ca80c543eaccdf81f2e78dc8eb7ac5311adf4a6ae9c"}
Jul 20 18:06:58.794526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:58.794255    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:06:58.812472 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:06:58.812425    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5" podStartSLOduration=1.552678309 podStartE2EDuration="3.812409939s" totalImagesPullingTime="2.25973163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:06:58.811281062 +0000 UTC m=+648.177258665" watchObservedRunningTime="2026-07-20 18:06:58.812409939 +0000 UTC m=+648.178387523"
Jul 20 18:07:04.804545 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:04.804506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d978fb74-6s5l5"
Jul 20 18:07:05.824460 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:05.824426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:05.916500 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:05.916468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:19.397809 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:19.397765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:22.531163 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:22.531116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:31.202295 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.202259    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"]
Jul 20 18:07:31.208434 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.208411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.212282 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.212258    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 18:07:31.212681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.212663    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 18:07:31.213034 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.213018    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 18:07:31.213178 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.213074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4dzgb\""
Jul 20 18:07:31.214741 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.214714    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"]
Jul 20 18:07:31.234969 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.234943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:31.344035 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.343998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.344205 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.344048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.344205 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.344083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee24104-2ab2-48a6-9764-4ccdeb950fc5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.344205 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.344106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.344311 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.344211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.344311 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.344243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnpd\" (UniqueName: \"kubernetes.io/projected/aee24104-2ab2-48a6-9764-4ccdeb950fc5-kube-api-access-wvnpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445104 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee24104-2ab2-48a6-9764-4ccdeb950fc5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445273 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445273 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445273 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnpd\" (UniqueName: \"kubernetes.io/projected/aee24104-2ab2-48a6-9764-4ccdeb950fc5-kube-api-access-wvnpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445273 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445273 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445646 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445729 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.445784 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.445730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.447467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.447435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee24104-2ab2-48a6-9764-4ccdeb950fc5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.447702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.447686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee24104-2ab2-48a6-9764-4ccdeb950fc5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.453706 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.453646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnpd\" (UniqueName: \"kubernetes.io/projected/aee24104-2ab2-48a6-9764-4ccdeb950fc5-kube-api-access-wvnpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4zfs\" (UID: \"aee24104-2ab2-48a6-9764-4ccdeb950fc5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.521759 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.521725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:31.657702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.657660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"]
Jul 20 18:07:31.662610 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:07:31.662578    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee24104_2ab2_48a6_9764_4ccdeb950fc5.slice/crio-0c742dc1ecae8d7f7a11d87692004d42c7df5fc78b37bfb9fefa2d9fcaf72203 WatchSource:0}: Error finding container 0c742dc1ecae8d7f7a11d87692004d42c7df5fc78b37bfb9fefa2d9fcaf72203: Status 404 returned error can't find the container with id 0c742dc1ecae8d7f7a11d87692004d42c7df5fc78b37bfb9fefa2d9fcaf72203
Jul 20 18:07:31.940323 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:31.940283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs" event={"ID":"aee24104-2ab2-48a6-9764-4ccdeb950fc5","Type":"ContainerStarted","Data":"0c742dc1ecae8d7f7a11d87692004d42c7df5fc78b37bfb9fefa2d9fcaf72203"}
Jul 20 18:07:32.946998 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:32.946961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs" event={"ID":"aee24104-2ab2-48a6-9764-4ccdeb950fc5","Type":"ContainerStarted","Data":"0d76d3f91c056d0bf5632cf3d9426c046393d8add4d7c4f8b9d41711aa82060c"}
Jul 20 18:07:32.966696 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:32.966639    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs" podStartSLOduration=0.898783902 podStartE2EDuration="1.966623263s" totalImagesPullingTime="1.067839361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:07:32.966348112 +0000 UTC m=+682.332325713" watchObservedRunningTime="2026-07-20 18:07:32.966623263 +0000 UTC m=+682.332600888"
Jul 20 18:07:41.522235 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:41.522194    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:41.522690 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:41.522260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:41.534914 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:41.534887    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:41.996612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:41.996529    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4zfs"
Jul 20 18:07:42.997494 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:42.997462    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"]
Jul 20 18:07:43.001004 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.000981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.003958 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.003934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 18:07:43.013460 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.013438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"]
Jul 20 18:07:43.039699 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.039664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:43.161573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.161540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwwbr\" (UniqueName: \"kubernetes.io/projected/52dc3cac-145a-4c97-9407-7716cf2601eb-kube-api-access-lwwbr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.161733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.161584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.161733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.161701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.161733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.161728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.161839 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.161757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.161873 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.161841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52dc3cac-145a-4c97-9407-7716cf2601eb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263231 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263231 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263411 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263411 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52dc3cac-145a-4c97-9407-7716cf2601eb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263487 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwbr\" (UniqueName: \"kubernetes.io/projected/52dc3cac-145a-4c97-9407-7716cf2601eb-kube-api-access-lwwbr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263523 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263561 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263530    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.263668 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.263617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.265630 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.265595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52dc3cac-145a-4c97-9407-7716cf2601eb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.265806 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.265792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52dc3cac-145a-4c97-9407-7716cf2601eb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.273163 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.272698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwbr\" (UniqueName: \"kubernetes.io/projected/52dc3cac-145a-4c97-9407-7716cf2601eb-kube-api-access-lwwbr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jj6df\" (UID: \"52dc3cac-145a-4c97-9407-7716cf2601eb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.313839 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.313791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:43.450341 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.450318    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"]
Jul 20 18:07:43.452733 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:07:43.452704    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dc3cac_145a_4c97_9407_7716cf2601eb.slice/crio-69abdf0ebfbcf987b679af605755027a17c046526877788875792892641625e9 WatchSource:0}: Error finding container 69abdf0ebfbcf987b679af605755027a17c046526877788875792892641625e9: Status 404 returned error can't find the container with id 69abdf0ebfbcf987b679af605755027a17c046526877788875792892641625e9
Jul 20 18:07:43.454577 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.454560    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:07:43.997925 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.997892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df" event={"ID":"52dc3cac-145a-4c97-9407-7716cf2601eb","Type":"ContainerStarted","Data":"4fb1e7eb686425b51ea6836066d1b769b46071a83c9c5fb409243115bcbb6a4b"}
Jul 20 18:07:43.998295 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:43.997969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df" event={"ID":"52dc3cac-145a-4c97-9407-7716cf2601eb","Type":"ContainerStarted","Data":"69abdf0ebfbcf987b679af605755027a17c046526877788875792892641625e9"}
Jul 20 18:07:44.019014 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:44.018962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df" podStartSLOduration=1.823436918 podStartE2EDuration="2.018944419s" totalImagesPullingTime="195.507501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:07:44.017697042 +0000 UTC m=+693.383674637" watchObservedRunningTime="2026-07-20 18:07:44.018944419 +0000 UTC m=+693.384921990"
Jul 20 18:07:53.314679 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:53.314640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:53.315113 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:53.314711    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:53.326975 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:53.326950    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:54.055367 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:54.055340    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jj6df"
Jul 20 18:07:55.052801 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:55.052770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:59.770739 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:59.770694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:59.868642 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:07:59.868614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:11.803176 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.803084    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"]
Jul 20 18:08:11.805662 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.805643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:11.808384 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.808365    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 20 18:08:11.821150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.821116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"]
Jul 20 18:08:11.842737 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.842702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:11.928456 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.928400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:11.928456 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.928458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59j5h\" (UniqueName: \"kubernetes.io/projected/5f347be5-8da3-4a48-9177-4843cebdaf5c-kube-api-access-59j5h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:11.928682 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.928531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f347be5-8da3-4a48-9177-4843cebdaf5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:11.928682 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.928585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:11.928682 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.928639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:11.928682 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:11.928660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029284 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029476 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029476 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029476 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029476 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59j5h\" (UniqueName: \"kubernetes.io/projected/5f347be5-8da3-4a48-9177-4843cebdaf5c-kube-api-access-59j5h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029684 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f347be5-8da3-4a48-9177-4843cebdaf5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029766 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029825 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.029884 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.029838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.031702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.031677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f347be5-8da3-4a48-9177-4843cebdaf5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.032112 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.032090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f347be5-8da3-4a48-9177-4843cebdaf5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.038493 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.038469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59j5h\" (UniqueName: \"kubernetes.io/projected/5f347be5-8da3-4a48-9177-4843cebdaf5c-kube-api-access-59j5h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zp9v4\" (UID: \"5f347be5-8da3-4a48-9177-4843cebdaf5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.116189 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.116095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:12.254701 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:12.254679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"]
Jul 20 18:08:12.256829 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:08:12.256798    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f347be5_8da3_4a48_9177_4843cebdaf5c.slice/crio-91b1f0bccec71906dffd5ca38e4f681ec18aafe522ec396e9e1178584ec9872e WatchSource:0}: Error finding container 91b1f0bccec71906dffd5ca38e4f681ec18aafe522ec396e9e1178584ec9872e: Status 404 returned error can't find the container with id 91b1f0bccec71906dffd5ca38e4f681ec18aafe522ec396e9e1178584ec9872e
Jul 20 18:08:13.130404 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:13.130368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4" event={"ID":"5f347be5-8da3-4a48-9177-4843cebdaf5c","Type":"ContainerStarted","Data":"0ede474bce71ff4949e050a3a5a3ff64424db37a30d2ad1030485242cac3cd98"}
Jul 20 18:08:13.130781 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:13.130420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4" event={"ID":"5f347be5-8da3-4a48-9177-4843cebdaf5c","Type":"ContainerStarted","Data":"91b1f0bccec71906dffd5ca38e4f681ec18aafe522ec396e9e1178584ec9872e"}
Jul 20 18:08:13.146167 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:13.146113    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4" podStartSLOduration=1.952880635 podStartE2EDuration="2.146094636s" totalImagesPullingTime="193.214001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:08:13.144755856 +0000 UTC m=+722.510733436" watchObservedRunningTime="2026-07-20 18:08:13.146094636 +0000 UTC m=+722.512072214"
Jul 20 18:08:19.847552 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:19.847503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:22.117148 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:22.117105    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:22.117564 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:22.117223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:22.129677 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:22.129649    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:08:22.179857 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:08:22.179831    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zp9v4"
Jul 20 18:09:26.220739 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:09:26.220705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:09:26.346713 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:09:26.346680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:09:27.396359 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:09:27.396317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:09:30.153699 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:09:30.153668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:09:36.054626 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:09:36.054587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:09:57.159659 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:09:57.159622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:10:03.242057 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:10:03.242015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:11:05.356139 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:11:05.356058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:11:06.814047 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:11:06.814006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:11:34.100937 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:11:34.100890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:11:35.313093 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:11:35.313056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:13.957440 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:13.957405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:14.049354 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:14.049309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:14.194500 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:14.194463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:20.354913 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:20.354877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:20.458788 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:20.458747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:20.558454 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:20.558423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:20.726056 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:20.725968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:26.585045 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:26.585012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:27.935908 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:12:27.935874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:13:03.406385 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:13:03.406343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:13:03.507467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:13:03.507432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:13:41.559395 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:13:41.559362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:13:41.659965 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:13:41.659912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:14:34.178350 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:14:34.178312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:14:34.274320 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:14:34.274279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:16:27.165310 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:27.165276    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"]
Jul 20 18:16:27.165755 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:27.165502    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9" podUID="0fadf150-19ec-4587-b994-9c4a1f090c6d" containerName="manager" containerID="cri-o://39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5" gracePeriod=10
Jul 20 18:16:30.208018 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.207994    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:16:30.314485 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.314454    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fadf150-19ec-4587-b994-9c4a1f090c6d-extensions-socket-volume\") pod \"0fadf150-19ec-4587-b994-9c4a1f090c6d\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") "
Jul 20 18:16:30.314674 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.314572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-655c6\" (UniqueName: \"kubernetes.io/projected/0fadf150-19ec-4587-b994-9c4a1f090c6d-kube-api-access-655c6\") pod \"0fadf150-19ec-4587-b994-9c4a1f090c6d\" (UID: \"0fadf150-19ec-4587-b994-9c4a1f090c6d\") "
Jul 20 18:16:30.314861 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.314835    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fadf150-19ec-4587-b994-9c4a1f090c6d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0fadf150-19ec-4587-b994-9c4a1f090c6d" (UID: "0fadf150-19ec-4587-b994-9c4a1f090c6d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:16:30.316618 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.316590    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fadf150-19ec-4587-b994-9c4a1f090c6d-kube-api-access-655c6" (OuterVolumeSpecName: "kube-api-access-655c6") pod "0fadf150-19ec-4587-b994-9c4a1f090c6d" (UID: "0fadf150-19ec-4587-b994-9c4a1f090c6d"). InnerVolumeSpecName "kube-api-access-655c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:16:30.413821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.413783    2562 generic.go:356] "Generic (PLEG): container finished" podID="0fadf150-19ec-4587-b994-9c4a1f090c6d" containerID="39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5" exitCode=0
Jul 20 18:16:30.413821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.413821    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"
Jul 20 18:16:30.414037 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.413866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9" event={"ID":"0fadf150-19ec-4587-b994-9c4a1f090c6d","Type":"ContainerDied","Data":"39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5"}
Jul 20 18:16:30.414037 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.413913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9" event={"ID":"0fadf150-19ec-4587-b994-9c4a1f090c6d","Type":"ContainerDied","Data":"4469f16201499aaa7aaebc29294126965bdae8761a9c92ec75821d95f2b382d1"}
Jul 20 18:16:30.414037 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.413965    2562 scope.go:117] "RemoveContainer" containerID="39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5"
Jul 20 18:16:30.415443 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.415424    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-655c6\" (UniqueName: \"kubernetes.io/projected/0fadf150-19ec-4587-b994-9c4a1f090c6d-kube-api-access-655c6\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:16:30.415560 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.415445    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fadf150-19ec-4587-b994-9c4a1f090c6d-extensions-socket-volume\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:16:30.423633 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.423617    2562 scope.go:117] "RemoveContainer" containerID="39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5"
Jul 20 18:16:30.423869 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:16:30.423854    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5\": container with ID starting with 39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5 not found: ID does not exist" containerID="39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5"
Jul 20 18:16:30.423905 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.423876    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5"} err="failed to get container status \"39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5\": rpc error: code = NotFound desc = could not find container \"39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5\": container with ID starting with 39f81cb0bee6737381426e0f76a0caf70a61f4347adc5676be157f2efa6647f5 not found: ID does not exist"
Jul 20 18:16:30.434996 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.434940    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"]
Jul 20 18:16:30.442258 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:30.442236    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vh7d9"]
Jul 20 18:16:31.131275 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:16:31.131241    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fadf150-19ec-4587-b994-9c4a1f090c6d" path="/var/lib/kubelet/pods/0fadf150-19ec-4587-b994-9c4a1f090c6d/volumes"
Jul 20 18:17:08.566939 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:08.566840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:17:28.300093 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.300056    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"]
Jul 20 18:17:28.300640 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.300611    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fadf150-19ec-4587-b994-9c4a1f090c6d" containerName="manager"
Jul 20 18:17:28.300640 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.300630    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fadf150-19ec-4587-b994-9c4a1f090c6d" containerName="manager"
Jul 20 18:17:28.300762 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.300741    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fadf150-19ec-4587-b994-9c4a1f090c6d" containerName="manager"
Jul 20 18:17:28.305045 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.305025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.307756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.307736    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 18:17:28.307856 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.307736    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 18:17:28.307901 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.307814    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fn4h6\""
Jul 20 18:17:28.315552 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.315527    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"]
Jul 20 18:17:28.452956 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.452898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc4ccb08-955b-45be-b56e-1053f3620b15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-56bmf\" (UID: \"cc4ccb08-955b-45be-b56e-1053f3620b15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.453156 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.452964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74dph\" (UniqueName: \"kubernetes.io/projected/cc4ccb08-955b-45be-b56e-1053f3620b15-kube-api-access-74dph\") pod \"kuadrant-operator-controller-manager-86878c769f-56bmf\" (UID: \"cc4ccb08-955b-45be-b56e-1053f3620b15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.554374 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.554210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74dph\" (UniqueName: \"kubernetes.io/projected/cc4ccb08-955b-45be-b56e-1053f3620b15-kube-api-access-74dph\") pod \"kuadrant-operator-controller-manager-86878c769f-56bmf\" (UID: \"cc4ccb08-955b-45be-b56e-1053f3620b15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.554561 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.554448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc4ccb08-955b-45be-b56e-1053f3620b15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-56bmf\" (UID: \"cc4ccb08-955b-45be-b56e-1053f3620b15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.554781 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.554764    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc4ccb08-955b-45be-b56e-1053f3620b15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-56bmf\" (UID: \"cc4ccb08-955b-45be-b56e-1053f3620b15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.562967 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.562940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74dph\" (UniqueName: \"kubernetes.io/projected/cc4ccb08-955b-45be-b56e-1053f3620b15-kube-api-access-74dph\") pod \"kuadrant-operator-controller-manager-86878c769f-56bmf\" (UID: \"cc4ccb08-955b-45be-b56e-1053f3620b15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.615542 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.615511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:28.756913 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:28.756882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"]
Jul 20 18:17:28.760802 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:17:28.760770    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4ccb08_955b_45be_b56e_1053f3620b15.slice/crio-f02e0df7dc30a1689fb606efd4e9e1f2857ec5c81fe61a89a493fba6a4f9708e WatchSource:0}: Error finding container f02e0df7dc30a1689fb606efd4e9e1f2857ec5c81fe61a89a493fba6a4f9708e: Status 404 returned error can't find the container with id f02e0df7dc30a1689fb606efd4e9e1f2857ec5c81fe61a89a493fba6a4f9708e
Jul 20 18:17:29.682793 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:29.682759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf" event={"ID":"cc4ccb08-955b-45be-b56e-1053f3620b15","Type":"ContainerStarted","Data":"cb34db79956be57191dd0968ff2a5863b3d70d0771080e93242d643ecba9a695"}
Jul 20 18:17:29.683209 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:29.682809    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf" event={"ID":"cc4ccb08-955b-45be-b56e-1053f3620b15","Type":"ContainerStarted","Data":"f02e0df7dc30a1689fb606efd4e9e1f2857ec5c81fe61a89a493fba6a4f9708e"}
Jul 20 18:17:29.683209 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:29.682867    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:17:29.707411 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:29.707363    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf" podStartSLOduration=1.707346426 podStartE2EDuration="1.707346426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:29.70465663 +0000 UTC m=+1279.070634222" watchObservedRunningTime="2026-07-20 18:17:29.707346426 +0000 UTC m=+1279.073324005"
Jul 20 18:17:39.329555 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:39.329525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:17:40.689338 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:17:40.689308    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56bmf"
Jul 20 18:20:12.471870 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:20:12.471780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:24.414719 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:20:24.414687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:56.541799 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:20:56.541762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:57.687656 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:20:57.687615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:44.431084 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:22:44.431037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:45.857287 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:22:45.857237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:55.833041 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:22:55.833006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:55.933300 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:22:55.933268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:06.491772 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:06.491720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:13.956647 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:13.956610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:22.318270 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:22.318236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:27.634905 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:27.634873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:30.568313 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:30.568282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:30.665071 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:30.665041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:31.058104 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:31.058061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:36.932832 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:36.932784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:37.034249 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:37.034221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:37.163042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:37.163002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:37.512216 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:37.512130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:37.686772 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:37.686704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:39.552209 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.552177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:39.648111 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.648079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:39.754369 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.754329    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"]
Jul 20 18:24:39.758525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.758504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.761431 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.761411    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7f0c0a5b-serving-cert\""
Jul 20 18:24:39.773668 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.773648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"]
Jul 20 18:24:39.791950 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.791903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:39.881236 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.881142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94z59\" (UniqueName: \"kubernetes.io/projected/3e5bf77c-9dca-4626-b460-9bff37542d2c-kube-api-access-94z59\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.881236 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.881181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.881459 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.881289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5bf77c-9dca-4626-b460-9bff37542d2c-openshift-service-ca\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.982411 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.982371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5bf77c-9dca-4626-b460-9bff37542d2c-openshift-service-ca\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.982599 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.982454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94z59\" (UniqueName: \"kubernetes.io/projected/3e5bf77c-9dca-4626-b460-9bff37542d2c-kube-api-access-94z59\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.982599 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.982477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.982599 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:24:39.982581    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-serving-cert: secret "maas-api-e2e-ait-7f0c0a5b-serving-cert" not found
Jul 20 18:24:39.982727 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:24:39.982646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls podName:3e5bf77c-9dca-4626-b460-9bff37542d2c nodeName:}" failed. No retries permitted until 2026-07-20 18:24:40.482627687 +0000 UTC m=+1709.848605245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls") pod "maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" (UID: "3e5bf77c-9dca-4626-b460-9bff37542d2c") : secret "maas-api-e2e-ait-7f0c0a5b-serving-cert" not found
Jul 20 18:24:39.983009 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.982990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5bf77c-9dca-4626-b460-9bff37542d2c-openshift-service-ca\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:39.991592 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:39.991572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94z59\" (UniqueName: \"kubernetes.io/projected/3e5bf77c-9dca-4626-b460-9bff37542d2c-kube-api-access-94z59\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:40.067705 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.067675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:40.285504 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.285469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:40.386534 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.386499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:40.487111 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.487081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:40.489644 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.489616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls\") pod \"maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:40.668744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.668653    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:40.808353 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.808326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"]
Jul 20 18:24:40.809000 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:24:40.808972    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5bf77c_9dca_4626_b460_9bff37542d2c.slice/crio-dc00fc83bbeb2b9709cc45f3c7a364b3c23aa7700454ea18ac8782654171c7e6 WatchSource:0}: Error finding container dc00fc83bbeb2b9709cc45f3c7a364b3c23aa7700454ea18ac8782654171c7e6: Status 404 returned error can't find the container with id dc00fc83bbeb2b9709cc45f3c7a364b3c23aa7700454ea18ac8782654171c7e6
Jul 20 18:24:40.810876 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:40.810857    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:24:41.680564 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:41.680532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" event={"ID":"3e5bf77c-9dca-4626-b460-9bff37542d2c","Type":"ContainerStarted","Data":"574c8a4a18c01efb5a876f4edb1aa9871574dcee03b93bbe722ee89c5666b170"}
Jul 20 18:24:41.680962 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:41.680587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" event={"ID":"3e5bf77c-9dca-4626-b460-9bff37542d2c","Type":"ContainerStarted","Data":"dc00fc83bbeb2b9709cc45f3c7a364b3c23aa7700454ea18ac8782654171c7e6"}
Jul 20 18:24:41.680962 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:41.680614    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:24:41.706463 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:41.706412    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" podStartSLOduration=2.035237989 podStartE2EDuration="2.706393229s" totalImagesPullingTime="671.15524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:24:41.704531776 +0000 UTC m=+1711.070509357" watchObservedRunningTime="2026-07-20 18:24:41.706393229 +0000 UTC m=+1711.072370807"
Jul 20 18:24:47.691378 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:24:47.691292    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:25:15.653603 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:15.653553    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"]
Jul 20 18:25:15.654238 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:15.653816    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" podUID="3e5bf77c-9dca-4626-b460-9bff37542d2c" containerName="maas-api" containerID="cri-o://574c8a4a18c01efb5a876f4edb1aa9871574dcee03b93bbe722ee89c5666b170" gracePeriod=30
Jul 20 18:25:15.677722 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:15.677689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:15.842511 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:15.842461    2562 generic.go:356] "Generic (PLEG): container finished" podID="3e5bf77c-9dca-4626-b460-9bff37542d2c" containerID="574c8a4a18c01efb5a876f4edb1aa9871574dcee03b93bbe722ee89c5666b170" exitCode=0
Jul 20 18:25:15.842678 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:15.842529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" event={"ID":"3e5bf77c-9dca-4626-b460-9bff37542d2c","Type":"ContainerDied","Data":"574c8a4a18c01efb5a876f4edb1aa9871574dcee03b93bbe722ee89c5666b170"}
Jul 20 18:25:15.908424 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:15.908366    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:25:16.006291 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.006258    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5bf77c-9dca-4626-b460-9bff37542d2c-openshift-service-ca\") pod \"3e5bf77c-9dca-4626-b460-9bff37542d2c\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") "
Jul 20 18:25:16.006457 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.006343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls\") pod \"3e5bf77c-9dca-4626-b460-9bff37542d2c\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") "
Jul 20 18:25:16.006457 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.006378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94z59\" (UniqueName: \"kubernetes.io/projected/3e5bf77c-9dca-4626-b460-9bff37542d2c-kube-api-access-94z59\") pod \"3e5bf77c-9dca-4626-b460-9bff37542d2c\" (UID: \"3e5bf77c-9dca-4626-b460-9bff37542d2c\") "
Jul 20 18:25:16.006639 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.006613    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e5bf77c-9dca-4626-b460-9bff37542d2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e5bf77c-9dca-4626-b460-9bff37542d2c" (UID: "3e5bf77c-9dca-4626-b460-9bff37542d2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:25:16.008438 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.008403    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e5bf77c-9dca-4626-b460-9bff37542d2c" (UID: "3e5bf77c-9dca-4626-b460-9bff37542d2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:25:16.008565 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.008545    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5bf77c-9dca-4626-b460-9bff37542d2c-kube-api-access-94z59" (OuterVolumeSpecName: "kube-api-access-94z59") pod "3e5bf77c-9dca-4626-b460-9bff37542d2c" (UID: "3e5bf77c-9dca-4626-b460-9bff37542d2c"). InnerVolumeSpecName "kube-api-access-94z59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:25:16.107173 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.107131    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5bf77c-9dca-4626-b460-9bff37542d2c-openshift-service-ca\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:25:16.107173 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.107164    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5bf77c-9dca-4626-b460-9bff37542d2c-maas-api-tls\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:25:16.107173 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.107178    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94z59\" (UniqueName: \"kubernetes.io/projected/3e5bf77c-9dca-4626-b460-9bff37542d2c-kube-api-access-94z59\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:25:16.848578 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.848546    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"
Jul 20 18:25:16.849002 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.848545    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t" event={"ID":"3e5bf77c-9dca-4626-b460-9bff37542d2c","Type":"ContainerDied","Data":"dc00fc83bbeb2b9709cc45f3c7a364b3c23aa7700454ea18ac8782654171c7e6"}
Jul 20 18:25:16.849002 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.848685    2562 scope.go:117] "RemoveContainer" containerID="574c8a4a18c01efb5a876f4edb1aa9871574dcee03b93bbe722ee89c5666b170"
Jul 20 18:25:16.875936 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.875890    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"]
Jul 20 18:25:16.879005 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:16.878977    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f0c0a5b-5b85877b49-plv9t"]
Jul 20 18:25:17.131978 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:17.131864    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5bf77c-9dca-4626-b460-9bff37542d2c" path="/var/lib/kubelet/pods/3e5bf77c-9dca-4626-b460-9bff37542d2c/volumes"
Jul 20 18:25:20.268625 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:20.268580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:20.454628 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:20.454582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.026675 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.026630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.130078 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.130022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.231662 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.231631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.531970 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.531939    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"]
Jul 20 18:25:21.532488 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.532473    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5bf77c-9dca-4626-b460-9bff37542d2c" containerName="maas-api"
Jul 20 18:25:21.532548 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.532490    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5bf77c-9dca-4626-b460-9bff37542d2c" containerName="maas-api"
Jul 20 18:25:21.532598 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.532571    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5bf77c-9dca-4626-b460-9bff37542d2c" containerName="maas-api"
Jul 20 18:25:21.537174 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.537152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.540031 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.540013    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0ae63acc-gw-openshift-default-dockercfg-qwvrl\""
Jul 20 18:25:21.548577 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.548548    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"]
Jul 20 18:25:21.659591 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/024d65b7-5084-49e6-91ca-b6972f3d0447-istiod-ca-cert\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.659591 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zhqc\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-kube-api-access-5zhqc\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.659874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-certs\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.659874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-data\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.659874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-socket\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.659874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-token\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.660114 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-credential-socket\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.660114 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.659979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-envoy\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.660114 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.660004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-podinfo\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.674667 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.674634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.761190 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-credential-socket\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761190 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-envoy\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761405 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-podinfo\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761405 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/024d65b7-5084-49e6-91ca-b6972f3d0447-istiod-ca-cert\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761405 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zhqc\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-kube-api-access-5zhqc\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761535 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-certs\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761610 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-data\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761666 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-socket\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761666 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-credential-socket\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761767 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-token\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.761901 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-certs\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.762009 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761911    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-data\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.762009 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.761997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-socket\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.762114 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.762071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/024d65b7-5084-49e6-91ca-b6972f3d0447-istiod-ca-cert\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.763522 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.763506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-envoy\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.763832 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.763816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-podinfo\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.780752 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.780721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-token\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.781007 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.780870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zhqc\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-kube-api-access-5zhqc\") pod \"e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") " pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.781121 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.781019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.848373 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.848267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:21.992454 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:21.992372    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"]
Jul 20 18:25:21.994808 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:25:21.994777    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024d65b7_5084_49e6_91ca_b6972f3d0447.slice/crio-4bb37e9480974ac109ac3ba5dac658b4a6d80ffd7b94853d54776fd0d9a2f7a6 WatchSource:0}: Error finding container 4bb37e9480974ac109ac3ba5dac658b4a6d80ffd7b94853d54776fd0d9a2f7a6: Status 404 returned error can't find the container with id 4bb37e9480974ac109ac3ba5dac658b4a6d80ffd7b94853d54776fd0d9a2f7a6
Jul 20 18:25:22.879449 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:22.879414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" event={"ID":"024d65b7-5084-49e6-91ca-b6972f3d0447","Type":"ContainerStarted","Data":"4bb37e9480974ac109ac3ba5dac658b4a6d80ffd7b94853d54776fd0d9a2f7a6"}
Jul 20 18:25:24.660253 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:24.660209    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:25:24.660560 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:24.660288    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:25:24.660560 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:24.660321    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:25:24.892511 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:24.892472    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" event={"ID":"024d65b7-5084-49e6-91ca-b6972f3d0447","Type":"ContainerStarted","Data":"359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"}
Jul 20 18:25:24.917665 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:24.917551    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" podStartSLOduration=1.254494963 podStartE2EDuration="3.917528418s" totalImagesPullingTime="2.663033455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:24.916151078 +0000 UTC m=+1754.282128681" watchObservedRunningTime="2026-07-20 18:25:24.917528418 +0000 UTC m=+1754.283505998"
Jul 20 18:25:25.848837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:25.848802    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:25.853527 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:25.853504    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:25.898213 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:25.898166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:25.899031 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:25.899012    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:26.413129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:26.413093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:26.689048 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:26.688959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:27.000369 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:27.000339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:27.233406 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:27.233376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:27.457282 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:27.457200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:37.967673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:37.967570    2562 generic.go:356] "Generic (PLEG): container finished" podID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerID="359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df" exitCode=0
Jul 20 18:25:37.967673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:37.967641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" event={"ID":"024d65b7-5084-49e6-91ca-b6972f3d0447","Type":"ContainerDied","Data":"359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"}
Jul 20 18:25:37.968146 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:37.968114    2562 scope.go:117] "RemoveContainer" containerID="359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"
Jul 20 18:25:37.970262 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:37.970228    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:25:37.970355 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:37.970308    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:25:37.970355 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:37.970342    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:25:38.973972 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:38.973939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" event={"ID":"024d65b7-5084-49e6-91ca-b6972f3d0447","Type":"ContainerStarted","Data":"66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a"}
Jul 20 18:25:39.848476 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:39.848439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:39.849655 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:39.849629    2562 patch_prober.go:28] interesting pod/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 20 18:25:39.849780 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:39.849687    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 20 18:25:40.849620 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:40.849586    2562 patch_prober.go:28] interesting pod/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 20 18:25:40.850036 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:40.849643    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 20 18:25:40.898870 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:40.898824    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:41.849047 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:41.849008    2562 patch_prober.go:28] interesting pod/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 20 18:25:41.849222 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:41.849063    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 20 18:25:42.853146 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:42.853120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:25:42.854308 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:25:42.854285    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:26:02.002612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:02.002575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:06.557993 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:06.557960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:06.689148 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:06.689111    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"]
Jul 20 18:26:06.689391 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:06.689367    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy" containerID="cri-o://66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a" gracePeriod=30
Jul 20 18:26:06.704404 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:06.704378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:07.018629 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.018596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:07.188868 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.188836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:07.509453 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.509420    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"]
Jul 20 18:26:07.516436 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.516414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.521448 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.521425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-674433c6-openshift-default-dockercfg-t5p25\""
Jul 20 18:26:07.525522 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.525503    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"]
Jul 20 18:26:07.546511 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.546481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:07.608563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.608523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-credential-socket\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609187 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-data\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609298 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-socket\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609370 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wcq\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-kube-api-access-j4wcq\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609370 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-certs\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609478 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-envoy\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609478 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-podinfo\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609580 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-token\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.609580 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.609570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d8036f-28c2-47ce-9b32-0f61aed231d6-istiod-ca-cert\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711016 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.710976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wcq\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-kube-api-access-j4wcq\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711016 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-certs\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711279 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-envoy\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711279 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-podinfo\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711279 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-token\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711279 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d8036f-28c2-47ce-9b32-0f61aed231d6-istiod-ca-cert\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711279 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-credential-socket\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711279 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-data\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-socket\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711629 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-certs\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711635    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-credential-socket\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711736 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-data\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711736 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-socket\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.711874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.711855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d8036f-28c2-47ce-9b32-0f61aed231d6-istiod-ca-cert\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.713387 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.713362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-envoy\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.713689 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.713671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-podinfo\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.725987 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.725952    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wcq\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-kube-api-access-j4wcq\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.726630 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.726609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-token\") pod \"e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") " pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.813638 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.813555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:07.828581 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.828499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:07.995694 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:07.995664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"]
Jul 20 18:26:07.999011 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:26:07.998982    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d8036f_28c2_47ce_9b32_0f61aed231d6.slice/crio-dcf60cbe7ad3762223332a0e4ab67694c28e901dd3af7f06b7974c1079add861 WatchSource:0}: Error finding container dcf60cbe7ad3762223332a0e4ab67694c28e901dd3af7f06b7974c1079add861: Status 404 returned error can't find the container with id dcf60cbe7ad3762223332a0e4ab67694c28e901dd3af7f06b7974c1079add861
Jul 20 18:26:08.001080 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.001049    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:26:08.001146 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.001110    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:26:08.001190 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.001144    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:26:08.121330 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.121233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" event={"ID":"12d8036f-28c2-47ce-9b32-0f61aed231d6","Type":"ContainerStarted","Data":"9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"}
Jul 20 18:26:08.121330 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.121298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" event={"ID":"12d8036f-28c2-47ce-9b32-0f61aed231d6","Type":"ContainerStarted","Data":"dcf60cbe7ad3762223332a0e4ab67694c28e901dd3af7f06b7974c1079add861"}
Jul 20 18:26:08.146306 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.146255    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" podStartSLOduration=1.146236104 podStartE2EDuration="1.146236104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:08.144134554 +0000 UTC m=+1797.510112140" watchObservedRunningTime="2026-07-20 18:26:08.146236104 +0000 UTC m=+1797.512213684"
Jul 20 18:26:08.828732 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:08.828699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:09.510555 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:09.510525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:09.602611 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:09.602581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:09.683352 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:09.683303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:09.833401 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:09.833302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:09.835167 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:09.835136    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:10.131218 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:10.131120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:10.132135 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:10.132118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:10.190911 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:10.190879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:10.291832 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:10.291800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:11.940123 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:11.940098    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:26:12.056695 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056662    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-envoy\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056695 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056703    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-token\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zhqc\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-kube-api-access-5zhqc\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056761    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-credential-socket\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056792    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/024d65b7-5084-49e6-91ca-b6972f3d0447-istiod-ca-cert\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056856    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-podinfo\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056885    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-socket\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.056982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.056963    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-certs\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.057356 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-data\") pod \"024d65b7-5084-49e6-91ca-b6972f3d0447\" (UID: \"024d65b7-5084-49e6-91ca-b6972f3d0447\") "
Jul 20 18:26:12.057356 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:12.057356 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057297    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:12.057356 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057314    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:12.057573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057373    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/024d65b7-5084-49e6-91ca-b6972f3d0447-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:26:12.057573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057422    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.057573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057443    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.057573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057457    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.058018 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.057996    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-data" (OuterVolumeSpecName: "istio-data") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:12.059220 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.059194    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-token" (OuterVolumeSpecName: "istio-token") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:12.059324 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.059226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:12.059418 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.059398    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-kube-api-access-5zhqc" (OuterVolumeSpecName: "kube-api-access-5zhqc") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "kube-api-access-5zhqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:12.059482 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.059464    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "024d65b7-5084-49e6-91ca-b6972f3d0447" (UID: "024d65b7-5084-49e6-91ca-b6972f3d0447"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:26:12.141620 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.141582    2562 generic.go:356] "Generic (PLEG): container finished" podID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerID="66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a" exitCode=0
Jul 20 18:26:12.141784 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.141635    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"
Jul 20 18:26:12.141784 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.141666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" event={"ID":"024d65b7-5084-49e6-91ca-b6972f3d0447","Type":"ContainerDied","Data":"66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a"}
Jul 20 18:26:12.141784 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.141722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425" event={"ID":"024d65b7-5084-49e6-91ca-b6972f3d0447","Type":"ContainerDied","Data":"4bb37e9480974ac109ac3ba5dac658b4a6d80ffd7b94853d54776fd0d9a2f7a6"}
Jul 20 18:26:12.141784 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.141745    2562 scope.go:117] "RemoveContainer" containerID="66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a"
Jul 20 18:26:12.151102 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.151085    2562 scope.go:117] "RemoveContainer" containerID="359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"
Jul 20 18:26:12.158244 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.158222    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.158244 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.158244    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.158387 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.158255    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.158387 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.158262    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.158387 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.158271    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zhqc\" (UniqueName: \"kubernetes.io/projected/024d65b7-5084-49e6-91ca-b6972f3d0447-kube-api-access-5zhqc\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.158387 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.158280    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/024d65b7-5084-49e6-91ca-b6972f3d0447-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:12.159325 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.159313    2562 scope.go:117] "RemoveContainer" containerID="66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a"
Jul 20 18:26:12.159589 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:26:12.159574    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a\": container with ID starting with 66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a not found: ID does not exist" containerID="66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a"
Jul 20 18:26:12.159660 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.159598    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a"} err="failed to get container status \"66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a\": rpc error: code = NotFound desc = could not find container \"66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a\": container with ID starting with 66679bcc60871cce8954d37a9543b7302d9aac75d57faaf80a8b1f16caa9aa7a not found: ID does not exist"
Jul 20 18:26:12.159660 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.159615    2562 scope.go:117] "RemoveContainer" containerID="359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"
Jul 20 18:26:12.159867 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:26:12.159849    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df\": container with ID starting with 359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df not found: ID does not exist" containerID="359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"
Jul 20 18:26:12.159936 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.159875    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df"} err="failed to get container status \"359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df\": rpc error: code = NotFound desc = could not find container \"359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df\": container with ID starting with 359db861ffdac5ed8a18e9e794d0c1d4a5e556121931b7b4f564c95b1bfa36df not found: ID does not exist"
Jul 20 18:26:12.165163 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.165136    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"]
Jul 20 18:26:12.169508 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:12.169484    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0ae63acc-gw-openshift-default-68b57cb879-wg425"]
Jul 20 18:26:13.131807 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:13.131758    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" path="/var/lib/kubelet/pods/024d65b7-5084-49e6-91ca-b6972f3d0447/volumes"
Jul 20 18:26:24.204869 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:24.204827    2562 generic.go:356] "Generic (PLEG): container finished" podID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerID="9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118" exitCode=0
Jul 20 18:26:24.205313 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:24.204905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" event={"ID":"12d8036f-28c2-47ce-9b32-0f61aed231d6","Type":"ContainerDied","Data":"9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"}
Jul 20 18:26:24.205370 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:24.205344    2562 scope.go:117] "RemoveContainer" containerID="9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"
Jul 20 18:26:24.206519 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:24.206489    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:26:24.206594 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:24.206576    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:26:24.206645 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:24.206628    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:26:25.131863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:25.131837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:25.215247 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:25.215205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" event={"ID":"12d8036f-28c2-47ce-9b32-0f61aed231d6","Type":"ContainerStarted","Data":"5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2"}
Jul 20 18:26:25.828647 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:25.828620    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:25.830010 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:25.829985    2562 patch_prober.go:28] interesting pod/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 20 18:26:25.830135 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:25.830034    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 20 18:26:26.829393 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:26.829356    2562 patch_prober.go:28] interesting pod/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 20 18:26:26.829782 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:26.829411    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 20 18:26:27.829067 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:27.829031    2562 patch_prober.go:28] interesting pod/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 20 18:26:27.829251 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:27.829092    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 20 18:26:28.829102 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:28.829063    2562 patch_prober.go:28] interesting pod/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 20 18:26:28.829598 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:28.829127    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 20 18:26:29.833368 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:29.833340    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:29.833842 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:29.833618    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:29.834264 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:29.834244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:46.102758 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:46.102729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:50.421600 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:50.421561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:51.635083 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:51.635051    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"]
Jul 20 18:26:51.635473 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:51.635283    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy" containerID="cri-o://5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2" gracePeriod=30
Jul 20 18:26:51.656146 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:51.656098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:51.773546 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:51.773511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:51.885193 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:51.885097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:52.172665 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:52.172582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:52.512811 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:52.512767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:52.923005 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:52.922901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:54.454648 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.454612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:54.628877 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.628842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:54.638094 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.638066    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"]
Jul 20 18:26:54.638444 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.638432    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy"
Jul 20 18:26:54.638501 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.638447    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy"
Jul 20 18:26:54.638536 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.638521    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy"
Jul 20 18:26:54.638536 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.638533    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy"
Jul 20 18:26:54.641441 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.641425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.647032 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.647001    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-76c00924-serving-cert\""
Jul 20 18:26:54.673383 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.673350    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"]
Jul 20 18:26:54.786772 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.786733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ff96b5f-bda8-455f-baa1-1f51efa47578-maas-api-tls\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.786996 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.786877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff96b5f-bda8-455f-baa1-1f51efa47578-openshift-service-ca\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.786996 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.786940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s6wt\" (UniqueName: \"kubernetes.io/projected/7ff96b5f-bda8-455f-baa1-1f51efa47578-kube-api-access-7s6wt\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.848088 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.848024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:54.888445 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.888408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff96b5f-bda8-455f-baa1-1f51efa47578-openshift-service-ca\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.888653 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.888450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s6wt\" (UniqueName: \"kubernetes.io/projected/7ff96b5f-bda8-455f-baa1-1f51efa47578-kube-api-access-7s6wt\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.888653 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.888531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ff96b5f-bda8-455f-baa1-1f51efa47578-maas-api-tls\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.889244 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.889225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff96b5f-bda8-455f-baa1-1f51efa47578-openshift-service-ca\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.890971 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.890949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ff96b5f-bda8-455f-baa1-1f51efa47578-maas-api-tls\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.899220 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.899193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s6wt\" (UniqueName: \"kubernetes.io/projected/7ff96b5f-bda8-455f-baa1-1f51efa47578-kube-api-access-7s6wt\") pod \"maas-api-e2e-derive-76c00924-6499d65f77-kmxlb\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.951981 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.951948    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:54.972434 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:54.972397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:55.298028 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:55.297996    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"]
Jul 20 18:26:55.300074 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:26:55.300044    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff96b5f_bda8_455f_baa1_1f51efa47578.slice/crio-ff46e631b194c161c4aaf02648b748dc80152aee90d9c81e10e782c9c3061fbb WatchSource:0}: Error finding container ff46e631b194c161c4aaf02648b748dc80152aee90d9c81e10e782c9c3061fbb: Status 404 returned error can't find the container with id ff46e631b194c161c4aaf02648b748dc80152aee90d9c81e10e782c9c3061fbb
Jul 20 18:26:55.363199 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:55.363163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb" event={"ID":"7ff96b5f-bda8-455f-baa1-1f51efa47578","Type":"ContainerStarted","Data":"ff46e631b194c161c4aaf02648b748dc80152aee90d9c81e10e782c9c3061fbb"}
Jul 20 18:26:55.566507 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:55.566401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:55.726550 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:55.726502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:56.369489 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:56.369450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb" event={"ID":"7ff96b5f-bda8-455f-baa1-1f51efa47578","Type":"ContainerStarted","Data":"a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6"}
Jul 20 18:26:56.369674 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:56.369525    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:26:56.782739 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:56.782711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:56.889122 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:56.889089    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:56.895400 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:56.895345    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:56.930982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:56.930903    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb" podStartSLOduration=2.46913282 podStartE2EDuration="2.930879757s" totalImagesPullingTime="461.746937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:56.408237027 +0000 UTC m=+1845.774214606" watchObservedRunningTime="2026-07-20 18:26:56.930879757 +0000 UTC m=+1846.296857333"
Jul 20 18:26:57.008081 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008050    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d8036f-28c2-47ce-9b32-0f61aed231d6-istiod-ca-cert\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008081 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008086    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-credential-socket\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008283 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008110    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-certs\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008283 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008146    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-podinfo\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008376 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4wcq\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-kube-api-access-j4wcq\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008432 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008395    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:57.008489 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-data\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008545 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008482    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d8036f-28c2-47ce-9b32-0f61aed231d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:26:57.008545 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008486    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:57.008545 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008521    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-socket\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008703 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008545    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-token\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008703 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008580    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-envoy\") pod \"12d8036f-28c2-47ce-9b32-0f61aed231d6\" (UID: \"12d8036f-28c2-47ce-9b32-0f61aed231d6\") "
Jul 20 18:26:57.008816 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:57.008948 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008910    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.009043 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008954    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d8036f-28c2-47ce-9b32-0f61aed231d6-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.009043 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008968    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.009043 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.008982    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.009423 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.009395    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:57.010508 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.010483    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:26:57.010649 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.010628    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:57.010702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.010647    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:26:57.010702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.010662    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-kube-api-access-j4wcq" (OuterVolumeSpecName: "kube-api-access-j4wcq") pod "12d8036f-28c2-47ce-9b32-0f61aed231d6" (UID: "12d8036f-28c2-47ce-9b32-0f61aed231d6"). InnerVolumeSpecName "kube-api-access-j4wcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:57.109863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.109821    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.109863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.109851    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.109863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.109859    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.109863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.109867    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d8036f-28c2-47ce-9b32-0f61aed231d6-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.110155 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.109877    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4wcq\" (UniqueName: \"kubernetes.io/projected/12d8036f-28c2-47ce-9b32-0f61aed231d6-kube-api-access-j4wcq\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:26:57.375694 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.375661    2562 generic.go:356] "Generic (PLEG): container finished" podID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerID="5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2" exitCode=0
Jul 20 18:26:57.375902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.375709    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"
Jul 20 18:26:57.375902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.375750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" event={"ID":"12d8036f-28c2-47ce-9b32-0f61aed231d6","Type":"ContainerDied","Data":"5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2"}
Jul 20 18:26:57.375902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.375814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9" event={"ID":"12d8036f-28c2-47ce-9b32-0f61aed231d6","Type":"ContainerDied","Data":"dcf60cbe7ad3762223332a0e4ab67694c28e901dd3af7f06b7974c1079add861"}
Jul 20 18:26:57.375902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.375845    2562 scope.go:117] "RemoveContainer" containerID="5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2"
Jul 20 18:26:57.386521 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.386505    2562 scope.go:117] "RemoveContainer" containerID="9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"
Jul 20 18:26:57.394458 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.394435    2562 scope.go:117] "RemoveContainer" containerID="5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2"
Jul 20 18:26:57.394731 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:26:57.394704    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2\": container with ID starting with 5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2 not found: ID does not exist" containerID="5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2"
Jul 20 18:26:57.394812 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.394743    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2"} err="failed to get container status \"5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2\": rpc error: code = NotFound desc = could not find container \"5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2\": container with ID starting with 5dd91c550ddf46ab85444fa08d9719b5c72efe25158507e7cd38b01d8c9269a2 not found: ID does not exist"
Jul 20 18:26:57.394812 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.394770    2562 scope.go:117] "RemoveContainer" containerID="9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"
Jul 20 18:26:57.395056 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:26:57.395038    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118\": container with ID starting with 9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118 not found: ID does not exist" containerID="9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"
Jul 20 18:26:57.395112 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.395062    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118"} err="failed to get container status \"9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118\": rpc error: code = NotFound desc = could not find container \"9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118\": container with ID starting with 9100419aff0ebdc80d244eacc55decb1ab67c1e5ecae68c0ec037d8837525118 not found: ID does not exist"
Jul 20 18:26:57.402517 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.402491    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"]
Jul 20 18:26:57.408300 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.408276    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-674433c6-openshift-default-5c48f8c567-5fgz9"]
Jul 20 18:26:57.769049 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.769010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:57.867529 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:57.867498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:59.137591 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:26:59.137558    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" path="/var/lib/kubelet/pods/12d8036f-28c2-47ce-9b32-0f61aed231d6/volumes"
Jul 20 18:27:02.382302 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:02.382272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:27:30.158123 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.158091    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"]
Jul 20 18:27:30.158622 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.158335    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb" podUID="7ff96b5f-bda8-455f-baa1-1f51efa47578" containerName="maas-api" containerID="cri-o://a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6" gracePeriod=30
Jul 20 18:27:30.209596 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.209567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:30.409609 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.409545    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:27:30.522627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.522593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s6wt\" (UniqueName: \"kubernetes.io/projected/7ff96b5f-bda8-455f-baa1-1f51efa47578-kube-api-access-7s6wt\") pod \"7ff96b5f-bda8-455f-baa1-1f51efa47578\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") "
Jul 20 18:27:30.522830 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.522669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ff96b5f-bda8-455f-baa1-1f51efa47578-maas-api-tls\") pod \"7ff96b5f-bda8-455f-baa1-1f51efa47578\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") "
Jul 20 18:27:30.522830 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.522731    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff96b5f-bda8-455f-baa1-1f51efa47578-openshift-service-ca\") pod \"7ff96b5f-bda8-455f-baa1-1f51efa47578\" (UID: \"7ff96b5f-bda8-455f-baa1-1f51efa47578\") "
Jul 20 18:27:30.523141 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.523110    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff96b5f-bda8-455f-baa1-1f51efa47578-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ff96b5f-bda8-455f-baa1-1f51efa47578" (UID: "7ff96b5f-bda8-455f-baa1-1f51efa47578"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:27:30.524676 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.524655    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff96b5f-bda8-455f-baa1-1f51efa47578-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ff96b5f-bda8-455f-baa1-1f51efa47578" (UID: "7ff96b5f-bda8-455f-baa1-1f51efa47578"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:27:30.524745 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.524728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff96b5f-bda8-455f-baa1-1f51efa47578-kube-api-access-7s6wt" (OuterVolumeSpecName: "kube-api-access-7s6wt") pod "7ff96b5f-bda8-455f-baa1-1f51efa47578" (UID: "7ff96b5f-bda8-455f-baa1-1f51efa47578"). InnerVolumeSpecName "kube-api-access-7s6wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:27:30.534355 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.534321    2562 generic.go:356] "Generic (PLEG): container finished" podID="7ff96b5f-bda8-455f-baa1-1f51efa47578" containerID="a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6" exitCode=0
Jul 20 18:27:30.534499 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.534367    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"
Jul 20 18:27:30.534499 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.534399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb" event={"ID":"7ff96b5f-bda8-455f-baa1-1f51efa47578","Type":"ContainerDied","Data":"a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6"}
Jul 20 18:27:30.534499 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.534454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb" event={"ID":"7ff96b5f-bda8-455f-baa1-1f51efa47578","Type":"ContainerDied","Data":"ff46e631b194c161c4aaf02648b748dc80152aee90d9c81e10e782c9c3061fbb"}
Jul 20 18:27:30.534499 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.534477    2562 scope.go:117] "RemoveContainer" containerID="a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6"
Jul 20 18:27:30.544539 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.544520    2562 scope.go:117] "RemoveContainer" containerID="a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6"
Jul 20 18:27:30.544828 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:27:30.544812    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6\": container with ID starting with a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6 not found: ID does not exist" containerID="a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6"
Jul 20 18:27:30.544867 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.544837    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6"} err="failed to get container status \"a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6\": rpc error: code = NotFound desc = could not find container \"a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6\": container with ID starting with a934c1cb887a681ed28f21f43143d3488d9c385e9fa06bc2ec97fcd86d667ac6 not found: ID does not exist"
Jul 20 18:27:30.559375 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.559340    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"]
Jul 20 18:27:30.565004 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.564974    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-76c00924-6499d65f77-kmxlb"]
Jul 20 18:27:30.624328 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.624283    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff96b5f-bda8-455f-baa1-1f51efa47578-openshift-service-ca\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:27:30.624328 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.624319    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s6wt\" (UniqueName: \"kubernetes.io/projected/7ff96b5f-bda8-455f-baa1-1f51efa47578-kube-api-access-7s6wt\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:27:30.624328 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:30.624334    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ff96b5f-bda8-455f-baa1-1f51efa47578-maas-api-tls\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:27:31.131623 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:31.131587    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff96b5f-bda8-455f-baa1-1f51efa47578" path="/var/lib/kubelet/pods/7ff96b5f-bda8-455f-baa1-1f51efa47578/volumes"
Jul 20 18:27:34.435324 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:34.435281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:34.649664 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:34.649634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:34.852934 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:34.852897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:35.445093 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:35.445064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:35.571856 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:35.571824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:37.159123 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:37.159082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:43.280507 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:43.280475    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:43.412363 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:43.412327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:43.528851 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:43.528793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:45.801854 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:45.801815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:52.107789 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:52.107758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:53.529656 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:53.529623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:54.166819 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:27:54.166787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:03.332997 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:03.332962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:20.047982 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:20.047943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:27.586592 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:27.586552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:27.708351 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:27.708318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:27.801927 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:27.801898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:43.726446 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:43.726398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:50.394715 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:50.394683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:50.502885 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:50.502853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:50.691874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:28:50.691796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:01.316653 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:01.316617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:02.100414 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:02.100380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:09.602498 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:09.602467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:09.768315 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:09.768287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:09.854523 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:09.854445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:09.960129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:09.960100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:10.764263 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:10.764231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:10.857389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:10.857358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:10.962334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:10.962286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:12.625278 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:12.625239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:18.740358 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:18.740328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:18.825157 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:18.825117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:19.451233 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:19.451198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:25.466683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:25.466650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:25.578845 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:25.578804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:25.733289 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:25.733169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:26.120219 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120190    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"]
Jul 20 18:29:26.120557 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120545    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy"
Jul 20 18:29:26.120602 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120558    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy"
Jul 20 18:29:26.120602 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120574    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy"
Jul 20 18:29:26.120602 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120580    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy"
Jul 20 18:29:26.120602 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120586    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff96b5f-bda8-455f-baa1-1f51efa47578" containerName="maas-api"
Jul 20 18:29:26.120602 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120591    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff96b5f-bda8-455f-baa1-1f51efa47578" containerName="maas-api"
Jul 20 18:29:26.120759 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120605    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy"
Jul 20 18:29:26.120759 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120610    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="024d65b7-5084-49e6-91ca-b6972f3d0447" containerName="istio-proxy"
Jul 20 18:29:26.120759 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120671    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy"
Jul 20 18:29:26.120759 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120679    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff96b5f-bda8-455f-baa1-1f51efa47578" containerName="maas-api"
Jul 20 18:29:26.120759 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.120685    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d8036f-28c2-47ce-9b32-0f61aed231d6" containerName="istio-proxy"
Jul 20 18:29:26.123752 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.123737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.127434 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.127410    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e68a9f8e-openshift-default-dockercfg-r9qlg\""
Jul 20 18:29:26.137901 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.137869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:26.150942 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.150901    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"]
Jul 20 18:29:26.269098 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a64750-b321-4a08-8a3c-746540db2ec2-istio-podinfo\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269269 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-socket\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269269 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a64750-b321-4a08-8a3c-746540db2ec2-istiod-ca-cert\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269346 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-certs\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269405 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-data\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269442 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-credential-socket\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269475 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-istio-token\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269475 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fbbx\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-kube-api-access-8fbbx\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.269563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.269496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-envoy\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370438    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-socket\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a64750-b321-4a08-8a3c-746540db2ec2-istiod-ca-cert\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-certs\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-data\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-credential-socket\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-istio-token\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fbbx\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-kube-api-access-8fbbx\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-envoy\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.370818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a64750-b321-4a08-8a3c-746540db2ec2-istio-podinfo\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.371153 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-data\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.371153 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.370890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-socket\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.371153 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.371085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-certs\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.371153 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.371126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-credential-socket\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.371471 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.371444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a64750-b321-4a08-8a3c-746540db2ec2-istiod-ca-cert\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.373129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.373104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-envoy\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.373394 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.373373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a64750-b321-4a08-8a3c-746540db2ec2-istio-podinfo\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.391775 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.391752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fbbx\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-kube-api-access-8fbbx\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.395679 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.395657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-istio-token\") pod \"e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") " pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.434263 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.434231    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:26.443557 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.443531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:26.580439 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.580413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"]
Jul 20 18:29:26.582038 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:29:26.582008    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a64750_b321_4a08_8a3c_746540db2ec2.slice/crio-d5cd83045d2626298cc73d5569935e55962630c12cd7274be81989acdb5aef88 WatchSource:0}: Error finding container d5cd83045d2626298cc73d5569935e55962630c12cd7274be81989acdb5aef88: Status 404 returned error can't find the container with id d5cd83045d2626298cc73d5569935e55962630c12cd7274be81989acdb5aef88
Jul 20 18:29:26.584174 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.584138    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:29:26.584274 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.584203    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:29:26.584274 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:26.584236    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:29:27.075673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:27.075633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" event={"ID":"68a64750-b321-4a08-8a3c-746540db2ec2","Type":"ContainerStarted","Data":"cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"}
Jul 20 18:29:27.075847 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:27.075695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" event={"ID":"68a64750-b321-4a08-8a3c-746540db2ec2","Type":"ContainerStarted","Data":"d5cd83045d2626298cc73d5569935e55962630c12cd7274be81989acdb5aef88"}
Jul 20 18:29:27.100277 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:27.099562    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" podStartSLOduration=1.099541184 podStartE2EDuration="1.099541184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:29:27.098298798 +0000 UTC m=+1996.464276412" watchObservedRunningTime="2026-07-20 18:29:27.099541184 +0000 UTC m=+1996.465518762"
Jul 20 18:29:27.435100 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:27.435006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:27.440057 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:27.440029    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:28.080083 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:28.080049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:28.080942 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:28.080911    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:29.214681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:29.214647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:29.308642 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:29.308607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:29.402861 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:29.402828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:29.533073 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:29.533041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:29.883318 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:29.883227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:29.983185 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:29.983151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:33.719681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:33.719649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:34.344235 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:34.344205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:34.456450 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:34.456412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:34.845622 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:34.845593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:40.141250 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:40.141221    2562 generic.go:356] "Generic (PLEG): container finished" podID="68a64750-b321-4a08-8a3c-746540db2ec2" containerID="cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3" exitCode=0
Jul 20 18:29:40.141641 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:40.141297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" event={"ID":"68a64750-b321-4a08-8a3c-746540db2ec2","Type":"ContainerDied","Data":"cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"}
Jul 20 18:29:40.141749 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:40.141732    2562 scope.go:117] "RemoveContainer" containerID="cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"
Jul 20 18:29:40.142714 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:40.142686    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:29:40.142768 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:40.142752    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:29:40.142807 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:40.142784    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:29:41.115595 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:41.115560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:41.146709 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:41.146674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" event={"ID":"68a64750-b321-4a08-8a3c-746540db2ec2","Type":"ContainerStarted","Data":"ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73"}
Jul 20 18:29:41.183015 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:41.182969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:41.435099 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:41.435007    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:41.436235 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:41.436211    2562 patch_prober.go:28] interesting pod/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 20 18:29:41.436352 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:41.436256    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 20 18:29:42.434821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:42.434787    2562 patch_prober.go:28] interesting pod/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 20 18:29:42.435233 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:42.434843    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 20 18:29:43.081029 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:43.080993    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:43.435671 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:43.435577    2562 patch_prober.go:28] interesting pod/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 20 18:29:43.435671 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:43.435636    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 20 18:29:44.434557 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:44.434519    2562 patch_prober.go:28] interesting pod/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 20 18:29:44.434741 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:44.434572    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 20 18:29:45.438312 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:45.438282    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:45.439347 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:45.439326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:29:51.736634 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:51.736596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:56.585653 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:56.585616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:57.001153 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:29:57.001124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:03.063150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.063111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:03.160517 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.160486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:03.295692 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.295656    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"]
Jul 20 18:30:03.295973 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.295904    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy" containerID="cri-o://ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73" gracePeriod=30
Jul 20 18:30:03.321400 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.321310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:03.555272 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.555238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:03.691060 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.690961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:03.843104 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:03.843069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:04.024032 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:04.023993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:08.548776 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.548751    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:30:08.572792 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.572716    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fbbx\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-kube-api-access-8fbbx\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.572792 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.572754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a64750-b321-4a08-8a3c-746540db2ec2-istiod-ca-cert\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.572792 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.572776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-istio-token\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.572792 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.572793    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-envoy\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.573128 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.572904    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a64750-b321-4a08-8a3c-746540db2ec2-istio-podinfo\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.573128 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.572975    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-data\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.573232 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573119    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-certs\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.573232 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-credential-socket\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.573345 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-socket\") pod \"68a64750-b321-4a08-8a3c-746540db2ec2\" (UID: \"68a64750-b321-4a08-8a3c-746540db2ec2\") "
Jul 20 18:30:08.573631 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:30:08.573631 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573477    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a64750-b321-4a08-8a3c-746540db2ec2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:30:08.573631 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573606    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:30:08.573821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:30:08.573821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573704    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a64750-b321-4a08-8a3c-746540db2ec2-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.573821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573722    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.573821 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573735    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.573978 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.573872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-data" (OuterVolumeSpecName: "istio-data") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:30:08.575136 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.575108    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:30:08.575249 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.575169    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-istio-token" (OuterVolumeSpecName: "istio-token") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:30:08.575375 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.575351    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68a64750-b321-4a08-8a3c-746540db2ec2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:30:08.575460 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.575441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-kube-api-access-8fbbx" (OuterVolumeSpecName: "kube-api-access-8fbbx") pod "68a64750-b321-4a08-8a3c-746540db2ec2" (UID: "68a64750-b321-4a08-8a3c-746540db2ec2"). InnerVolumeSpecName "kube-api-access-8fbbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:30:08.674744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.674706    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fbbx\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-kube-api-access-8fbbx\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.674744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.674741    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a64750-b321-4a08-8a3c-746540db2ec2-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.674744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.674751    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.675010 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.674759    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a64750-b321-4a08-8a3c-746540db2ec2-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.675010 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.674767    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:08.675010 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:08.674776    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a64750-b321-4a08-8a3c-746540db2ec2-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:30:09.280562 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.280524    2562 generic.go:356] "Generic (PLEG): container finished" podID="68a64750-b321-4a08-8a3c-746540db2ec2" containerID="ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73" exitCode=0
Jul 20 18:30:09.280562 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.280568    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"
Jul 20 18:30:09.280814 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.280566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" event={"ID":"68a64750-b321-4a08-8a3c-746540db2ec2","Type":"ContainerDied","Data":"ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73"}
Jul 20 18:30:09.280814 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.280634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7" event={"ID":"68a64750-b321-4a08-8a3c-746540db2ec2","Type":"ContainerDied","Data":"d5cd83045d2626298cc73d5569935e55962630c12cd7274be81989acdb5aef88"}
Jul 20 18:30:09.280814 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.280663    2562 scope.go:117] "RemoveContainer" containerID="ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73"
Jul 20 18:30:09.289450 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.289431    2562 scope.go:117] "RemoveContainer" containerID="cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"
Jul 20 18:30:09.297295 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.297280    2562 scope.go:117] "RemoveContainer" containerID="ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73"
Jul 20 18:30:09.297566 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:30:09.297547    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73\": container with ID starting with ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73 not found: ID does not exist" containerID="ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73"
Jul 20 18:30:09.297620 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.297576    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73"} err="failed to get container status \"ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73\": rpc error: code = NotFound desc = could not find container \"ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73\": container with ID starting with ae247a8384fa4a5f839d1ecff2e659743aaa206ef3d36fa2aacc39593bfc4b73 not found: ID does not exist"
Jul 20 18:30:09.297620 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.297594    2562 scope.go:117] "RemoveContainer" containerID="cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"
Jul 20 18:30:09.297828 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:30:09.297809    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3\": container with ID starting with cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3 not found: ID does not exist" containerID="cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"
Jul 20 18:30:09.297871 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.297834    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3"} err="failed to get container status \"cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3\": rpc error: code = NotFound desc = could not find container \"cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3\": container with ID starting with cd19ebd7a6ab1e29d8c42eef0247e3dfbef0a99700e65477a60e95782f9ef5a3 not found: ID does not exist"
Jul 20 18:30:09.305564 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.305539    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"]
Jul 20 18:30:09.310966 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.310940    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e68a9f8e-openshift-default-6b7d8ff64c-fgpr7"]
Jul 20 18:30:09.969401 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:09.969367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:10.098960 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:10.098908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:10.194642 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:10.194611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:10.329822 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:10.329791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:11.131730 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:11.131695    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" path="/var/lib/kubelet/pods/68a64750-b321-4a08-8a3c-746540db2ec2/volumes"
Jul 20 18:30:17.752139 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:17.752099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:17.826479 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:17.826430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:24.674480 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:24.674445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:25.075952 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.075900    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"]
Jul 20 18:30:25.076365 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.076351    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy"
Jul 20 18:30:25.076413 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.076366    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy"
Jul 20 18:30:25.076413 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.076378    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy"
Jul 20 18:30:25.076413 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.076384    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy"
Jul 20 18:30:25.076503 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.076451    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy"
Jul 20 18:30:25.079509 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.079493    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.082703 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.082680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-da2296d7-openshift-default-dockercfg-zw55v\""
Jul 20 18:30:25.096789 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.096761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"]
Jul 20 18:30:25.126067 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-token\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126239 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istiod-ca-cert\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126239 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-socket\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126239 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-data\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126239 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-podinfo\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126443 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-envoy\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126443 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-credential-socket\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126544 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qllvf\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-kube-api-access-qllvf\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.126544 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.126482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-certs\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.184025 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.183981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:25.227421 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istiod-ca-cert\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227421 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-socket\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-data\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-podinfo\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-envoy\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227733 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-credential-socket\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qllvf\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-kube-api-access-qllvf\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-socket\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-certs\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.227979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.227908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-token\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.228187 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.228159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-data\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.228428 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.228380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-credential-socket\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.228499 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.228479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-certs\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.228641 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.228625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istiod-ca-cert\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.230006 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.229987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-envoy\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.230131 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.230116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-podinfo\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.238719 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.238695    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-token\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.238837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.238804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qllvf\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-kube-api-access-qllvf\") pod \"e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") " pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.390251 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.390162    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:25.530254 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.530224    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"]
Jul 20 18:30:25.532425 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:30:25.532394    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbeb4a2a_24f4_4866_a664_debc146ebb6e.slice/crio-85b099aec7075c7c529a713ed12fff05f5dcd7e88993fad32c516e513ce8b4af WatchSource:0}: Error finding container 85b099aec7075c7c529a713ed12fff05f5dcd7e88993fad32c516e513ce8b4af: Status 404 returned error can't find the container with id 85b099aec7075c7c529a713ed12fff05f5dcd7e88993fad32c516e513ce8b4af
Jul 20 18:30:25.534399 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.534368    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:30:25.534472 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.534431    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:30:25.534472 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.534459    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:30:25.598056 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:25.598027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:26.361641 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:26.361609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" event={"ID":"dbeb4a2a-24f4-4866-a664-debc146ebb6e","Type":"ContainerStarted","Data":"0bb51764c4f0b7aa628cbaf5e6bcd19c3bf8d67cb677ef69effc1b045536ac66"}
Jul 20 18:30:26.362084 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:26.361656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" event={"ID":"dbeb4a2a-24f4-4866-a664-debc146ebb6e","Type":"ContainerStarted","Data":"85b099aec7075c7c529a713ed12fff05f5dcd7e88993fad32c516e513ce8b4af"}
Jul 20 18:30:26.384653 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:26.384601    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" podStartSLOduration=1.38458476 podStartE2EDuration="1.38458476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:26.382768037 +0000 UTC m=+2055.748745615" watchObservedRunningTime="2026-07-20 18:30:26.38458476 +0000 UTC m=+2055.750562370"
Jul 20 18:30:26.390895 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:26.390870    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:26.396069 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:26.396048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:27.366682 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:27.366648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:27.367731 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:27.367710    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:27.879703 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:27.879666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:28.357599 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.357569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:28.436266 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.436232    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"]
Jul 20 18:30:28.436984 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.436962    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a64750-b321-4a08-8a3c-746540db2ec2" containerName="istio-proxy"
Jul 20 18:30:28.440156 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.440133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.442795 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.442776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-da2296d7-serving-cert\""
Jul 20 18:30:28.451562 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.451539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"]
Jul 20 18:30:28.558308 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.558271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m24d\" (UniqueName: \"kubernetes.io/projected/1ef4092e-c05e-4ef7-9d17-c8db847774df-kube-api-access-9m24d\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.558489 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.558371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef4092e-c05e-4ef7-9d17-c8db847774df-openshift-service-ca\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.558489 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.558425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.659466 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.659369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m24d\" (UniqueName: \"kubernetes.io/projected/1ef4092e-c05e-4ef7-9d17-c8db847774df-kube-api-access-9m24d\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.659466 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.659431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef4092e-c05e-4ef7-9d17-c8db847774df-openshift-service-ca\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.659466 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.659461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.659754 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:30:28.659579    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-serving-cert: secret "maas-api-e2e-mt-da2296d7-serving-cert" not found
Jul 20 18:30:28.659754 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:30:28.659648    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls podName:1ef4092e-c05e-4ef7-9d17-c8db847774df nodeName:}" failed. No retries permitted until 2026-07-20 18:30:29.159628252 +0000 UTC m=+2058.525605823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls") pod "maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" (UID: "1ef4092e-c05e-4ef7-9d17-c8db847774df") : secret "maas-api-e2e-mt-da2296d7-serving-cert" not found
Jul 20 18:30:28.660160 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.660140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef4092e-c05e-4ef7-9d17-c8db847774df-openshift-service-ca\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.698064 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.698032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m24d\" (UniqueName: \"kubernetes.io/projected/1ef4092e-c05e-4ef7-9d17-c8db847774df-kube-api-access-9m24d\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:28.713094 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.713062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:28.832876 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:28.832838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:29.148592 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.148560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:29.164067 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.164034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:29.166467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.166439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls\") pod \"maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:29.258618 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.258590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:29.351549 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.351512    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:29.487651 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.487623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"]
Jul 20 18:30:29.490188 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:30:29.490160    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef4092e_c05e_4ef7_9d17_c8db847774df.slice/crio-fa00405cca2684920e85773997d96ec290310219f53834ee9e5774e7c1818eb7 WatchSource:0}: Error finding container fa00405cca2684920e85773997d96ec290310219f53834ee9e5774e7c1818eb7: Status 404 returned error can't find the container with id fa00405cca2684920e85773997d96ec290310219f53834ee9e5774e7c1818eb7
Jul 20 18:30:29.491608 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:29.491589    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:30:30.380962 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:30.380907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" event={"ID":"1ef4092e-c05e-4ef7-9d17-c8db847774df","Type":"ContainerStarted","Data":"54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361"}
Jul 20 18:30:30.381161 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:30.380975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" event={"ID":"1ef4092e-c05e-4ef7-9d17-c8db847774df","Type":"ContainerStarted","Data":"fa00405cca2684920e85773997d96ec290310219f53834ee9e5774e7c1818eb7"}
Jul 20 18:30:30.381161 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:30.381048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:30.400178 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:30.400132    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" podStartSLOduration=2.060646862 podStartE2EDuration="2.400115292s" totalImagesPullingTime="339.46843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:30.399030887 +0000 UTC m=+2059.765008464" watchObservedRunningTime="2026-07-20 18:30:30.400115292 +0000 UTC m=+2059.766092852"
Jul 20 18:30:31.605999 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:31.605966    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:32.884304 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:32.884226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:36.395146 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:36.395050    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:30:37.738613 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:37.738554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:43.091570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.091533    2562 patch_prober.go:28] interesting pod/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:43386->10.133.0.36:15021: read: connection reset by peer" start-of-body=
Jul 20 18:30:43.092006 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.091609    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:43386->10.133.0.36:15021: read: connection reset by peer"
Jul 20 18:30:43.447981 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.447861    2562 generic.go:356] "Generic (PLEG): container finished" podID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerID="0bb51764c4f0b7aa628cbaf5e6bcd19c3bf8d67cb677ef69effc1b045536ac66" exitCode=0
Jul 20 18:30:43.447981 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.447947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" event={"ID":"dbeb4a2a-24f4-4866-a664-debc146ebb6e","Type":"ContainerDied","Data":"0bb51764c4f0b7aa628cbaf5e6bcd19c3bf8d67cb677ef69effc1b045536ac66"}
Jul 20 18:30:43.448353 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.448339    2562 scope.go:117] "RemoveContainer" containerID="0bb51764c4f0b7aa628cbaf5e6bcd19c3bf8d67cb677ef69effc1b045536ac66"
Jul 20 18:30:43.449345 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.449318    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:30:43.449419 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.449401    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:30:43.449469 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:43.449454    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:30:44.454977 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:44.454940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" event={"ID":"dbeb4a2a-24f4-4866-a664-debc146ebb6e","Type":"ContainerStarted","Data":"53c984cc42aeacb6d54c1a7210622b22e7be8fc83446957b9a2a54f1e870dbb1"}
Jul 20 18:30:45.391327 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:45.391286    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:45.391609 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:45.391578    2562 patch_prober.go:28] interesting pod/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 20 18:30:45.391707 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:45.391651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 20 18:30:46.391261 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:46.391227    2562 patch_prober.go:28] interesting pod/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 20 18:30:46.391869 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:46.391840    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 20 18:30:47.391807 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:47.391360    2562 patch_prober.go:28] interesting pod/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 20 18:30:47.391807 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:47.391427    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 20 18:30:48.394696 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:48.394663    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:48.395185 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:48.395020    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:30:48.396038 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:30:48.396017    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:31:22.111150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.111107    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"]
Jul 20 18:31:22.111723 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.111392    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" podUID="1ef4092e-c05e-4ef7-9d17-c8db847774df" containerName="maas-api" containerID="cri-o://54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361" gracePeriod=30
Jul 20 18:31:22.168381 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.168352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:22.364476 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.364417    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:31:22.478826 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.478789    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m24d\" (UniqueName: \"kubernetes.io/projected/1ef4092e-c05e-4ef7-9d17-c8db847774df-kube-api-access-9m24d\") pod \"1ef4092e-c05e-4ef7-9d17-c8db847774df\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") "
Jul 20 18:31:22.478826 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.478828    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls\") pod \"1ef4092e-c05e-4ef7-9d17-c8db847774df\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") "
Jul 20 18:31:22.479072 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.478979    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef4092e-c05e-4ef7-9d17-c8db847774df-openshift-service-ca\") pod \"1ef4092e-c05e-4ef7-9d17-c8db847774df\" (UID: \"1ef4092e-c05e-4ef7-9d17-c8db847774df\") "
Jul 20 18:31:22.479307 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.479286    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef4092e-c05e-4ef7-9d17-c8db847774df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ef4092e-c05e-4ef7-9d17-c8db847774df" (UID: "1ef4092e-c05e-4ef7-9d17-c8db847774df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:31:22.480967 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.480946    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ef4092e-c05e-4ef7-9d17-c8db847774df" (UID: "1ef4092e-c05e-4ef7-9d17-c8db847774df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:31:22.481067 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.480976    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef4092e-c05e-4ef7-9d17-c8db847774df-kube-api-access-9m24d" (OuterVolumeSpecName: "kube-api-access-9m24d") pod "1ef4092e-c05e-4ef7-9d17-c8db847774df" (UID: "1ef4092e-c05e-4ef7-9d17-c8db847774df"). InnerVolumeSpecName "kube-api-access-9m24d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:31:22.580366 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.580330    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m24d\" (UniqueName: \"kubernetes.io/projected/1ef4092e-c05e-4ef7-9d17-c8db847774df-kube-api-access-9m24d\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:31:22.580366 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.580359    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef4092e-c05e-4ef7-9d17-c8db847774df-maas-api-tls\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:31:22.580366 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.580368    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef4092e-c05e-4ef7-9d17-c8db847774df-openshift-service-ca\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:31:22.646185 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.646091    2562 generic.go:356] "Generic (PLEG): container finished" podID="1ef4092e-c05e-4ef7-9d17-c8db847774df" containerID="54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361" exitCode=0
Jul 20 18:31:22.646185 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.646145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"
Jul 20 18:31:22.646185 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.646163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" event={"ID":"1ef4092e-c05e-4ef7-9d17-c8db847774df","Type":"ContainerDied","Data":"54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361"}
Jul 20 18:31:22.646449 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.646219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q" event={"ID":"1ef4092e-c05e-4ef7-9d17-c8db847774df","Type":"ContainerDied","Data":"fa00405cca2684920e85773997d96ec290310219f53834ee9e5774e7c1818eb7"}
Jul 20 18:31:22.646449 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.646248    2562 scope.go:117] "RemoveContainer" containerID="54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361"
Jul 20 18:31:22.655178 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.655159    2562 scope.go:117] "RemoveContainer" containerID="54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361"
Jul 20 18:31:22.655418 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:31:22.655400    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361\": container with ID starting with 54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361 not found: ID does not exist" containerID="54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361"
Jul 20 18:31:22.655497 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.655426    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361"} err="failed to get container status \"54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361\": rpc error: code = NotFound desc = could not find container \"54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361\": container with ID starting with 54a6fbfd85cff4eacd87d6829d99d344f47b17b35dd1b4066fbf278bca8a4361 not found: ID does not exist"
Jul 20 18:31:22.670657 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.670631    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"]
Jul 20 18:31:22.677318 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:22.677294    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da2296d7-7ff5dc7f5c-kxm6q"]
Jul 20 18:31:23.131016 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:23.130975    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef4092e-c05e-4ef7-9d17-c8db847774df" path="/var/lib/kubelet/pods/1ef4092e-c05e-4ef7-9d17-c8db847774df/volumes"
Jul 20 18:31:26.558498 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:26.558464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:36.179675 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:36.179640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:41.262788 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:41.262749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:57.615170 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:57.615137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:57.782886 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:31:57.782854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:17.730023 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:17.729987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:18.651544 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:18.651505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:24.554950 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:24.554898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:24.620850 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:24.620819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:24.837305 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:24.837208    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"]
Jul 20 18:32:24.837482 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:24.837458    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy" containerID="cri-o://53c984cc42aeacb6d54c1a7210622b22e7be8fc83446957b9a2a54f1e870dbb1" gracePeriod=30
Jul 20 18:32:24.867714 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:24.867684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:25.087650 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:25.087531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:26.183157 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:26.183120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:26.282305 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:26.282268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:26.385453 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:26.385420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:27.203176 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:27.203143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:27.296145 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:27.296110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:28.847379 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:28.847344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:29.966474 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:29.966434    2562 generic.go:356] "Generic (PLEG): container finished" podID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerID="53c984cc42aeacb6d54c1a7210622b22e7be8fc83446957b9a2a54f1e870dbb1" exitCode=0
Jul 20 18:32:29.966873 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:29.966512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" event={"ID":"dbeb4a2a-24f4-4866-a664-debc146ebb6e","Type":"ContainerDied","Data":"53c984cc42aeacb6d54c1a7210622b22e7be8fc83446957b9a2a54f1e870dbb1"}
Jul 20 18:32:29.966873 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:29.966601    2562 scope.go:117] "RemoveContainer" containerID="0bb51764c4f0b7aa628cbaf5e6bcd19c3bf8d67cb677ef69effc1b045536ac66"
Jul 20 18:32:30.101955 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.101881    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:32:30.221869 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.221836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-token\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222089 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.221910    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-certs\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222089 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.221985    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-podinfo\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222089 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222012    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-socket\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222089 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222060    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-envoy\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222089 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istiod-ca-cert\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222339 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222110    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-data\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222339 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222144    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-credential-socket\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222339 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222166    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qllvf\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-kube-api-access-qllvf\") pod \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\" (UID: \"dbeb4a2a-24f4-4866-a664-debc146ebb6e\") "
Jul 20 18:32:30.222680 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222607    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:32:30.222774 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222671    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:32:30.222774 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.222718    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:32:30.223038 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.223000    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:32:30.224584 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.223444    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.224584 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.223472    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.224584 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.223486    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.224584 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.223619    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:32:30.225144 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.225108    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:32:30.226966 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.225609    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:32:30.226966 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.225628    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:32:30.226966 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.225735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-kube-api-access-qllvf" (OuterVolumeSpecName: "kube-api-access-qllvf") pod "dbeb4a2a-24f4-4866-a664-debc146ebb6e" (UID: "dbeb4a2a-24f4-4866-a664-debc146ebb6e"). InnerVolumeSpecName "kube-api-access-qllvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:32:30.324719 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.324683    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.324719 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.324712    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.324719 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.324721    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.324719 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.324729    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbeb4a2a-24f4-4866-a664-debc146ebb6e-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.325027 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.324739    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qllvf\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-kube-api-access-qllvf\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.325027 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.324748    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbeb4a2a-24f4-4866-a664-debc146ebb6e-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:32:30.974552 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.974502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz" event={"ID":"dbeb4a2a-24f4-4866-a664-debc146ebb6e","Type":"ContainerDied","Data":"85b099aec7075c7c529a713ed12fff05f5dcd7e88993fad32c516e513ce8b4af"}
Jul 20 18:32:30.975050 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.974614    2562 scope.go:117] "RemoveContainer" containerID="53c984cc42aeacb6d54c1a7210622b22e7be8fc83446957b9a2a54f1e870dbb1"
Jul 20 18:32:30.975050 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:30.974831    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"
Jul 20 18:32:31.006631 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:31.006595    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"]
Jul 20 18:32:31.009906 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:31.009878    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-da2296d7-openshift-default-6968c98959-nxmkz"]
Jul 20 18:32:31.132108 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:31.132076    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" path="/var/lib/kubelet/pods/dbeb4a2a-24f4-4866-a664-debc146ebb6e/volumes"
Jul 20 18:32:34.945400 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:34.945345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:35.046051 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:35.046020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:35.716048 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:35.716012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:42.286137 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:42.286105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:42.394874 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:42.394846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:42.485658 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:42.485623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:53.070437 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:53.070402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:54.919837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:32:54.919800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:14.445401 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:14.445366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:21.433893 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.433861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:21.533192 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.533151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:21.633038 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.633007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:21.893127 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893092    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"]
Jul 20 18:33:21.893496 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893479    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy"
Jul 20 18:33:21.893496 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893497    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893505    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef4092e-c05e-4ef7-9d17-c8db847774df" containerName="maas-api"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893511    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef4092e-c05e-4ef7-9d17-c8db847774df" containerName="maas-api"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893517    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893522    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893585    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef4092e-c05e-4ef7-9d17-c8db847774df" containerName="maas-api"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893593    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy"
Jul 20 18:33:21.893627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.893601    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbeb4a2a-24f4-4866-a664-debc146ebb6e" containerName="istio-proxy"
Jul 20 18:33:21.896670 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.896653    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:21.899490 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.899473    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-adca0d-openshift-default-dockercfg-f48t4\""
Jul 20 18:33:21.911310 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.911285    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"]
Jul 20 18:33:21.915072 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:21.915046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:22.011905 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.011866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p57vb\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-kube-api-access-p57vb\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012130 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.011964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-certs\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012130 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.011989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-podinfo\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012130 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.012015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-token\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012130 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.012055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-data\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012130 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.012090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-envoy\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012359 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.012147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c03feb0-020e-411a-83df-82a7d20b3f37-istiod-ca-cert\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012359 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.012211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-credential-socket\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.012359 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.012276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-socket\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.079303 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.079266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:22.113147 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-credential-socket\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-socket\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p57vb\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-kube-api-access-p57vb\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-certs\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-podinfo\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-token\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-data\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-credential-socket\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-envoy\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-socket\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c03feb0-020e-411a-83df-82a7d20b3f37-istiod-ca-cert\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-certs\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.113971 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.113862    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-data\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.114205 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.114184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c03feb0-020e-411a-83df-82a7d20b3f37-istiod-ca-cert\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.116038 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.116015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-podinfo\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.116138 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.116075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-envoy\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.122876 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.122850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-token\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.123183 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.123162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p57vb\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-kube-api-access-p57vb\") pod \"e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") " pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.208563 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.208471    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:22.363416 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.363388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"]
Jul 20 18:33:22.365267 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:33:22.365241    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c03feb0_020e_411a_83df_82a7d20b3f37.slice/crio-aa66f1ea95c7a1179937558ba61c7336e83cacc447908dc2dd6da4a1fc4e1063 WatchSource:0}: Error finding container aa66f1ea95c7a1179937558ba61c7336e83cacc447908dc2dd6da4a1fc4e1063: Status 404 returned error can't find the container with id aa66f1ea95c7a1179937558ba61c7336e83cacc447908dc2dd6da4a1fc4e1063
Jul 20 18:33:22.367389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.367359    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:22.367465 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.367421    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:22.367465 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:22.367450    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:23.222750 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:23.222715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" event={"ID":"6c03feb0-020e-411a-83df-82a7d20b3f37","Type":"ContainerStarted","Data":"df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"}
Jul 20 18:33:23.223180 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:23.222767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" event={"ID":"6c03feb0-020e-411a-83df-82a7d20b3f37","Type":"ContainerStarted","Data":"aa66f1ea95c7a1179937558ba61c7336e83cacc447908dc2dd6da4a1fc4e1063"}
Jul 20 18:33:23.246008 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:23.245962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" podStartSLOduration=2.245944954 podStartE2EDuration="2.245944954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:33:23.244212635 +0000 UTC m=+2232.610190247" watchObservedRunningTime="2026-07-20 18:33:23.245944954 +0000 UTC m=+2232.611922534"
Jul 20 18:33:24.209578 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:24.209531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:24.214405 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:24.214380    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:24.227000 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:24.226972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:24.227798 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:24.227782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:25.259515 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.259482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:25.363319 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.363284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:25.383909 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.383875    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"]
Jul 20 18:33:25.387328 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.387307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.390319 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.390301    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-adca0d-serving-cert\""
Jul 20 18:33:25.402649 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.402618    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"]
Jul 20 18:33:25.469397 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.469367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:25.550702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.550608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.550702 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.550657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnrjc\" (UniqueName: \"kubernetes.io/projected/b54014dd-14ed-4829-a884-57146300e5cb-kube-api-access-jnrjc\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.550958 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.550748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b54014dd-14ed-4829-a884-57146300e5cb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.651421 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.651384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnrjc\" (UniqueName: \"kubernetes.io/projected/b54014dd-14ed-4829-a884-57146300e5cb-kube-api-access-jnrjc\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.651632 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.651436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b54014dd-14ed-4829-a884-57146300e5cb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.651632 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.651515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.651632 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:33:25.651620    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-serving-cert: secret "maas-api-e2e-inf-a-adca0d-serving-cert" not found
Jul 20 18:33:25.651793 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:33:25.651695    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls podName:b54014dd-14ed-4829-a884-57146300e5cb nodeName:}" failed. No retries permitted until 2026-07-20 18:33:26.15167464 +0000 UTC m=+2235.517652215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls") pod "maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" (UID: "b54014dd-14ed-4829-a884-57146300e5cb") : secret "maas-api-e2e-inf-a-adca0d-serving-cert" not found
Jul 20 18:33:25.652206 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.652186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b54014dd-14ed-4829-a884-57146300e5cb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.670645 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.670613    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnrjc\" (UniqueName: \"kubernetes.io/projected/b54014dd-14ed-4829-a884-57146300e5cb-kube-api-access-jnrjc\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:25.762594 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:25.762563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:26.026157 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:26.026126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:26.128129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:26.128083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:26.156319 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:26.156290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:26.158756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:26.158736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls\") pod \"maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:26.300795 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:26.300701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:26.464828 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:26.464798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"]
Jul 20 18:33:26.466458 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:33:26.466433    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54014dd_14ed_4829_a884_57146300e5cb.slice/crio-6daefdbce584ea901bed00f6d3aaaa5dd2c2abaf17855485104e91fa00183829 WatchSource:0}: Error finding container 6daefdbce584ea901bed00f6d3aaaa5dd2c2abaf17855485104e91fa00183829: Status 404 returned error can't find the container with id 6daefdbce584ea901bed00f6d3aaaa5dd2c2abaf17855485104e91fa00183829
Jul 20 18:33:27.241666 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:27.241578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" event={"ID":"b54014dd-14ed-4829-a884-57146300e5cb","Type":"ContainerStarted","Data":"34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4"}
Jul 20 18:33:27.241666 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:27.241637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" event={"ID":"b54014dd-14ed-4829-a884-57146300e5cb","Type":"ContainerStarted","Data":"6daefdbce584ea901bed00f6d3aaaa5dd2c2abaf17855485104e91fa00183829"}
Jul 20 18:33:27.241961 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:27.241712    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:27.262773 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:27.262726    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" podStartSLOduration=1.751679589 podStartE2EDuration="2.262709806s" totalImagesPullingTime="511.030217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:33:27.260824585 +0000 UTC m=+2236.626802164" watchObservedRunningTime="2026-07-20 18:33:27.262709806 +0000 UTC m=+2236.628687384"
Jul 20 18:33:30.036858 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:30.036816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:30.786584 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:30.786545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:31.325955 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.325332    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"]
Jul 20 18:33:31.330224 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.330176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"]
Jul 20 18:33:31.330398 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.330312    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.333952 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.333894    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-02ddb5-openshift-default-dockercfg-w2z6m\""
Jul 20 18:33:31.382176 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.382144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:31.426727 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.426690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-certs\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.426910 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.426753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istiod-ca-cert\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.426910 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.426781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2gfq\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-kube-api-access-h2gfq\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.426910 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.426827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-envoy\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.426910 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.426881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-data\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.427143 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.426957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-token\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.427143 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.427021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-socket\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.427143 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.427073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-credential-socket\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.427143 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.427113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-podinfo\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.512451 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.512418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:31.528389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-envoy\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528575 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-data\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528575 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-token\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528575 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-socket\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-credential-socket\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-podinfo\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-certs\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istiod-ca-cert\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.528756 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.528755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2gfq\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-kube-api-access-h2gfq\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.529063 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.529037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-socket\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.529127 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.529065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-data\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.529382 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.529361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-certs\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.529461 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.529381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-credential-socket\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.529461 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.529427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istiod-ca-cert\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.531253 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.531227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-envoy\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.531357 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.531249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-podinfo\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.538066 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.538042    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2gfq\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-kube-api-access-h2gfq\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.538372 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.538350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-token\") pod \"e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") " pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.641622 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.641537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:31.812033 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.808794    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"]
Jul 20 18:33:31.818067 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:33:31.818033    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097a6c66_57a8_4ee4_bbf4_b98a6c3af131.slice/crio-d6c5da105b2b6b35d997d4a58e7b4781a5ef8e6b723967a6f1187c4e190df68b WatchSource:0}: Error finding container d6c5da105b2b6b35d997d4a58e7b4781a5ef8e6b723967a6f1187c4e190df68b: Status 404 returned error can't find the container with id d6c5da105b2b6b35d997d4a58e7b4781a5ef8e6b723967a6f1187c4e190df68b
Jul 20 18:33:31.820806 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.820760    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:31.820897 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.820875    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:31.821004 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:31.820985    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:32.267025 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:32.266992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" event={"ID":"097a6c66-57a8-4ee4-bbf4-b98a6c3af131","Type":"ContainerStarted","Data":"0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"}
Jul 20 18:33:32.267201 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:32.267042    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" event={"ID":"097a6c66-57a8-4ee4-bbf4-b98a6c3af131","Type":"ContainerStarted","Data":"d6c5da105b2b6b35d997d4a58e7b4781a5ef8e6b723967a6f1187c4e190df68b"}
Jul 20 18:33:32.292473 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:32.292410    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podStartSLOduration=1.292389948 podStartE2EDuration="1.292389948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:33:32.289647552 +0000 UTC m=+2241.655625133" watchObservedRunningTime="2026-07-20 18:33:32.292389948 +0000 UTC m=+2241.658367528"
Jul 20 18:33:32.642270 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:32.642152    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:32.647055 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:32.647032    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:33.251349 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:33.251324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:33:33.272511 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:33.272484    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:33.273645 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:33.273624    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:35.084508 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:35.084476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:35.181299 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:35.181211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:35.371140 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:35.371103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:35.853779 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:35.853746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:35.953137 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:35.953108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:36.058371 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:36.058335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:38.302319 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:38.302286    2562 generic.go:356] "Generic (PLEG): container finished" podID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerID="df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41" exitCode=0
Jul 20 18:33:38.302762 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:38.302363    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" event={"ID":"6c03feb0-020e-411a-83df-82a7d20b3f37","Type":"ContainerDied","Data":"df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"}
Jul 20 18:33:38.302811 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:38.302779    2562 scope.go:117] "RemoveContainer" containerID="df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"
Jul 20 18:33:38.303782 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:38.303753    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:38.303879 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:38.303840    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:38.303958 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:38.303887    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:39.227989 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:39.227912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:39.313234 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:39.313198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" event={"ID":"6c03feb0-020e-411a-83df-82a7d20b3f37","Type":"ContainerStarted","Data":"b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206"}
Jul 20 18:33:40.209235 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:40.209202    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:40.210454 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:40.210421    2562 patch_prober.go:28] interesting pod/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 20 18:33:40.210586 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:40.210477    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 20 18:33:40.332095 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:40.332053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:41.209208 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:41.209156    2562 patch_prober.go:28] interesting pod/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 20 18:33:41.209389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:41.209229    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 20 18:33:42.209195 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:42.209153    2562 patch_prober.go:28] interesting pod/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 20 18:33:42.209667 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:42.209242    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 20 18:33:43.213666 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:43.213633    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:43.214143 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:43.213893    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:43.214770 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:43.214755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:33:47.153865 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:47.153829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:47.317103 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:47.317052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:51.375039 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:51.374966    2562 generic.go:356] "Generic (PLEG): container finished" podID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerID="0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0" exitCode=0
Jul 20 18:33:51.375039 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:51.375001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" event={"ID":"097a6c66-57a8-4ee4-bbf4-b98a6c3af131","Type":"ContainerDied","Data":"0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"}
Jul 20 18:33:51.375455 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:51.375422    2562 scope.go:117] "RemoveContainer" containerID="0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"
Jul 20 18:33:51.376504 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:51.376471    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:51.376614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:51.376560    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:51.376684 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:51.376610    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:33:52.382045 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:52.382008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" event={"ID":"097a6c66-57a8-4ee4-bbf4-b98a6c3af131","Type":"ContainerStarted","Data":"6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469"}
Jul 20 18:33:52.642102 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:52.641999    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:52.642286 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:52.642261    2562 patch_prober.go:28] interesting pod/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 20 18:33:52.642369 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:52.642343    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 20 18:33:53.641868 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:53.641829    2562 patch_prober.go:28] interesting pod/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 20 18:33:53.642274 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:53.641899    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 20 18:33:54.641956 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:54.641902    2562 patch_prober.go:28] interesting pod/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 20 18:33:54.642343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:54.641987    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 20 18:33:55.642220 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:55.642185    2562 patch_prober.go:28] interesting pod/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 20 18:33:55.642619 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:55.642237    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 20 18:33:56.645967 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:56.645937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:56.646352 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:56.646301    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:56.646991 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:56.646973    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:33:56.826696 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:56.826652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:56.980334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:33:56.980201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:34:05.068893 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:34:05.068852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:34:30.435845 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:34:30.435798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:34:41.313423 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:34:41.313382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:10.547607 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:10.547519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:11.462714 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:11.462681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:12.273027 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:12.272984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:12.371856 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:12.371825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:22.006069 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.006035    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"]
Jul 20 18:35:22.006525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.006284    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" podUID="b54014dd-14ed-4829-a884-57146300e5cb" containerName="maas-api" containerID="cri-o://34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4" gracePeriod=30
Jul 20 18:35:22.047629 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.047597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:22.260365 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.260303    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:35:22.386795 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.386764    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls\") pod \"b54014dd-14ed-4829-a884-57146300e5cb\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") "
Jul 20 18:35:22.387041 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.386853    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b54014dd-14ed-4829-a884-57146300e5cb-openshift-service-ca\") pod \"b54014dd-14ed-4829-a884-57146300e5cb\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") "
Jul 20 18:35:22.387041 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.386905    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnrjc\" (UniqueName: \"kubernetes.io/projected/b54014dd-14ed-4829-a884-57146300e5cb-kube-api-access-jnrjc\") pod \"b54014dd-14ed-4829-a884-57146300e5cb\" (UID: \"b54014dd-14ed-4829-a884-57146300e5cb\") "
Jul 20 18:35:22.387227 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.387201    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54014dd-14ed-4829-a884-57146300e5cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b54014dd-14ed-4829-a884-57146300e5cb" (UID: "b54014dd-14ed-4829-a884-57146300e5cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:35:22.388951 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.388911    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b54014dd-14ed-4829-a884-57146300e5cb" (UID: "b54014dd-14ed-4829-a884-57146300e5cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:35:22.389113 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.389096    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54014dd-14ed-4829-a884-57146300e5cb-kube-api-access-jnrjc" (OuterVolumeSpecName: "kube-api-access-jnrjc") pod "b54014dd-14ed-4829-a884-57146300e5cb" (UID: "b54014dd-14ed-4829-a884-57146300e5cb"). InnerVolumeSpecName "kube-api-access-jnrjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:35:22.488237 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.488197    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b54014dd-14ed-4829-a884-57146300e5cb-maas-api-tls\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:22.488237 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.488230    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b54014dd-14ed-4829-a884-57146300e5cb-openshift-service-ca\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:22.488237 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.488242    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnrjc\" (UniqueName: \"kubernetes.io/projected/b54014dd-14ed-4829-a884-57146300e5cb-kube-api-access-jnrjc\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:22.823737 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.823706    2562 generic.go:356] "Generic (PLEG): container finished" podID="b54014dd-14ed-4829-a884-57146300e5cb" containerID="34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4" exitCode=0
Jul 20 18:35:22.823939 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.823750    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"
Jul 20 18:35:22.823939 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.823801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" event={"ID":"b54014dd-14ed-4829-a884-57146300e5cb","Type":"ContainerDied","Data":"34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4"}
Jul 20 18:35:22.823939 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.823851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm" event={"ID":"b54014dd-14ed-4829-a884-57146300e5cb","Type":"ContainerDied","Data":"6daefdbce584ea901bed00f6d3aaaa5dd2c2abaf17855485104e91fa00183829"}
Jul 20 18:35:22.823939 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.823876    2562 scope.go:117] "RemoveContainer" containerID="34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4"
Jul 20 18:35:22.832675 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.832660    2562 scope.go:117] "RemoveContainer" containerID="34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4"
Jul 20 18:35:22.832965 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:35:22.832944    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4\": container with ID starting with 34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4 not found: ID does not exist" containerID="34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4"
Jul 20 18:35:22.833035 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.832970    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4"} err="failed to get container status \"34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4\": rpc error: code = NotFound desc = could not find container \"34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4\": container with ID starting with 34a363a3adac9be1ae1e7f2e77fe672bf41a2dabf378d456ab5f1ea89a2f40f4 not found: ID does not exist"
Jul 20 18:35:22.846402 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.846377    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"]
Jul 20 18:35:22.850659 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:22.850638    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-adca0d-7fdc4947fc-465tm"]
Jul 20 18:35:23.131098 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:23.131020    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54014dd-14ed-4829-a884-57146300e5cb" path="/var/lib/kubelet/pods/b54014dd-14ed-4829-a884-57146300e5cb/volumes"
Jul 20 18:35:26.638150 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:26.638117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:27.029938 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:27.029881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:33.086849 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:33.086813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:33.185790 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:33.185741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:33.248145 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:33.248116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:33.312302 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:33.312274    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"]
Jul 20 18:35:33.312605 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:33.312576    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy" containerID="cri-o://b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206" gracePeriod=30
Jul 20 18:35:33.330492 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:33.330460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:34.006940 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:34.006891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:34.370704 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:34.370615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:34.510459 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:34.510423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:38.566443 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.566421    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:35:38.644709 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-data\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.644709 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644665    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c03feb0-020e-411a-83df-82a7d20b3f37-istiod-ca-cert\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.644709 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644699    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-certs\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-credential-socket\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644770    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-socket\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644798    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p57vb\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-kube-api-access-p57vb\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644833    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-podinfo\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-token\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645042 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.644905    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-envoy\") pod \"6c03feb0-020e-411a-83df-82a7d20b3f37\" (UID: \"6c03feb0-020e-411a-83df-82a7d20b3f37\") "
Jul 20 18:35:38.645334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645150    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:35:38.645334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:35:38.645334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645179    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c03feb0-020e-411a-83df-82a7d20b3f37-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:35:38.645334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645302    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c03feb0-020e-411a-83df-82a7d20b3f37-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.645334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645320    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.645541 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645400    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:35:38.645541 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645332    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.645774 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.645752    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:35:38.647087 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.647062    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:35:38.647264 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.647245    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:35:38.647479 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.647455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-kube-api-access-p57vb" (OuterVolumeSpecName: "kube-api-access-p57vb") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "kube-api-access-p57vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:35:38.647561 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.647461    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c03feb0-020e-411a-83df-82a7d20b3f37" (UID: "6c03feb0-020e-411a-83df-82a7d20b3f37"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:35:38.746053 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.746014    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.746053 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.746048    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.746053 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.746061    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c03feb0-020e-411a-83df-82a7d20b3f37-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.746301 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.746076    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p57vb\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-kube-api-access-p57vb\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.746301 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.746088    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.746301 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.746099    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c03feb0-020e-411a-83df-82a7d20b3f37-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:35:38.900725 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.900635    2562 generic.go:356] "Generic (PLEG): container finished" podID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerID="b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206" exitCode=0
Jul 20 18:35:38.900725 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.900693    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"
Jul 20 18:35:38.900985 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.900721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" event={"ID":"6c03feb0-020e-411a-83df-82a7d20b3f37","Type":"ContainerDied","Data":"b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206"}
Jul 20 18:35:38.900985 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.900775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn" event={"ID":"6c03feb0-020e-411a-83df-82a7d20b3f37","Type":"ContainerDied","Data":"aa66f1ea95c7a1179937558ba61c7336e83cacc447908dc2dd6da4a1fc4e1063"}
Jul 20 18:35:38.900985 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.900800    2562 scope.go:117] "RemoveContainer" containerID="b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206"
Jul 20 18:35:38.910527 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.910510    2562 scope.go:117] "RemoveContainer" containerID="df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"
Jul 20 18:35:38.918603 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.918585    2562 scope.go:117] "RemoveContainer" containerID="b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206"
Jul 20 18:35:38.918853 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:35:38.918834    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206\": container with ID starting with b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206 not found: ID does not exist" containerID="b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206"
Jul 20 18:35:38.918903 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.918862    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206"} err="failed to get container status \"b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206\": rpc error: code = NotFound desc = could not find container \"b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206\": container with ID starting with b24523881495880350df1335d4583b2c472bb6e7f804a1f581de7a2294d9b206 not found: ID does not exist"
Jul 20 18:35:38.918903 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.918881    2562 scope.go:117] "RemoveContainer" containerID="df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"
Jul 20 18:35:38.919122 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:35:38.919101    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41\": container with ID starting with df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41 not found: ID does not exist" containerID="df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"
Jul 20 18:35:38.919172 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.919127    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41"} err="failed to get container status \"df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41\": rpc error: code = NotFound desc = could not find container \"df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41\": container with ID starting with df9462f43729ac638e9a2837fa8f4e7ee958a42fbf8a14c64a6f319406214f41 not found: ID does not exist"
Jul 20 18:35:38.924785 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.924762    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"]
Jul 20 18:35:38.944172 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:38.944143    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-adca0d-openshift-default-6ddcf5f579-wk4wn"]
Jul 20 18:35:39.131472 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:39.131432    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" path="/var/lib/kubelet/pods/6c03feb0-020e-411a-83df-82a7d20b3f37/volumes"
Jul 20 18:35:44.338782 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:44.338732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:48.777891 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:48.777860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:49.170494 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:49.170412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:55.403769 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:55.403736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:55.507456 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:55.507426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:55.559870 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:55.559839    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"]
Jul 20 18:35:55.560123 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:55.560102    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy" containerID="cri-o://6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469" gracePeriod=30
Jul 20 18:35:55.633685 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:55.633658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:55.983359 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:55.983327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:56.251001 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:56.250970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:56.633244 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:56.633160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:56.648616 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:56.648578    2562 patch_prober.go:28] interesting pod/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 18:35:56.648771 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:56.648650    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 18:35:56.875691 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:56.875662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:59.338425 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.338386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:59.404073 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404036    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"]
Jul 20 18:35:59.404580 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404562    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy"
Jul 20 18:35:59.404580 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404582    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy"
Jul 20 18:35:59.404751 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404619    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54014dd-14ed-4829-a884-57146300e5cb" containerName="maas-api"
Jul 20 18:35:59.404751 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404628    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54014dd-14ed-4829-a884-57146300e5cb" containerName="maas-api"
Jul 20 18:35:59.404751 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404708    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54014dd-14ed-4829-a884-57146300e5cb" containerName="maas-api"
Jul 20 18:35:59.404751 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.404720    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy"
Jul 20 18:35:59.408182 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.408158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.410867 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.410849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3054a0-serving-cert\""
Jul 20 18:35:59.417934 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.417890    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"]
Jul 20 18:35:59.447640 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.447608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:59.535039 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.535009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:59.552837 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.552807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzk4f\" (UniqueName: \"kubernetes.io/projected/28c3ad57-5a7c-46d2-a777-d0da845edd4a-kube-api-access-mzk4f\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.553001 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.552858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c3ad57-5a7c-46d2-a777-d0da845edd4a-maas-api-tls\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.553074 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.553040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c3ad57-5a7c-46d2-a777-d0da845edd4a-openshift-service-ca\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.654369 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.654271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c3ad57-5a7c-46d2-a777-d0da845edd4a-openshift-service-ca\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.654369 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.654343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzk4f\" (UniqueName: \"kubernetes.io/projected/28c3ad57-5a7c-46d2-a777-d0da845edd4a-kube-api-access-mzk4f\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.654611 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.654401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c3ad57-5a7c-46d2-a777-d0da845edd4a-maas-api-tls\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.655067 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.655039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c3ad57-5a7c-46d2-a777-d0da845edd4a-openshift-service-ca\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.656930 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.656898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c3ad57-5a7c-46d2-a777-d0da845edd4a-maas-api-tls\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.662470 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.662448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzk4f\" (UniqueName: \"kubernetes.io/projected/28c3ad57-5a7c-46d2-a777-d0da845edd4a-kube-api-access-mzk4f\") pod \"maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.711705 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.711666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:59.722200 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.722175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:35:59.856203 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.856177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"]
Jul 20 18:35:59.858015 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:35:59.857980    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c3ad57_5a7c_46d2_a777_d0da845edd4a.slice/crio-4196efbfcc259bef9e01d08d9a833405cfb1a12ea47e6870770eedba8a48090f WatchSource:0}: Error finding container 4196efbfcc259bef9e01d08d9a833405cfb1a12ea47e6870770eedba8a48090f: Status 404 returned error can't find the container with id 4196efbfcc259bef9e01d08d9a833405cfb1a12ea47e6870770eedba8a48090f
Jul 20 18:35:59.859501 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:35:59.859484    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:36:00.003031 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.003001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4" event={"ID":"28c3ad57-5a7c-46d2-a777-d0da845edd4a","Type":"ContainerStarted","Data":"4196efbfcc259bef9e01d08d9a833405cfb1a12ea47e6870770eedba8a48090f"}
Jul 20 18:36:00.162385 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.162350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:00.265138 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.265059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:00.821531 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.821506    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:36:00.969343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969258    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-certs\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2gfq\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-kube-api-access-h2gfq\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-podinfo\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969343 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istiod-ca-cert\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969693 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969371    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-credential-socket\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969693 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969437    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-socket\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969693 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-envoy\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969693 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-token\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969693 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-data\") pod \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\" (UID: \"097a6c66-57a8-4ee4-bbf4-b98a6c3af131\") "
Jul 20 18:36:00.969693 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969609    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969793    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969802    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.969987    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.970007    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.970015    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:00.970110 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.970028    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:00.970513 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.970493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-data" (OuterVolumeSpecName: "istio-data") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:36:00.971777 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.971748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:36:00.971777 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.971754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-token" (OuterVolumeSpecName: "istio-token") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:36:00.972066 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.972045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:36:00.972125 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:00.972079    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-kube-api-access-h2gfq" (OuterVolumeSpecName: "kube-api-access-h2gfq") pod "097a6c66-57a8-4ee4-bbf4-b98a6c3af131" (UID: "097a6c66-57a8-4ee4-bbf4-b98a6c3af131"). InnerVolumeSpecName "kube-api-access-h2gfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:36:01.009637 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.009608    2562 generic.go:356] "Generic (PLEG): container finished" podID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerID="6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469" exitCode=0
Jul 20 18:36:01.009801 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.009656    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"
Jul 20 18:36:01.009801 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.009683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" event={"ID":"097a6c66-57a8-4ee4-bbf4-b98a6c3af131","Type":"ContainerDied","Data":"6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469"}
Jul 20 18:36:01.009801 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.009726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg" event={"ID":"097a6c66-57a8-4ee4-bbf4-b98a6c3af131","Type":"ContainerDied","Data":"d6c5da105b2b6b35d997d4a58e7b4781a5ef8e6b723967a6f1187c4e190df68b"}
Jul 20 18:36:01.009801 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.009754    2562 scope.go:117] "RemoveContainer" containerID="6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469"
Jul 20 18:36:01.011086 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.011066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4" event={"ID":"28c3ad57-5a7c-46d2-a777-d0da845edd4a","Type":"ContainerStarted","Data":"ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de"}
Jul 20 18:36:01.011199 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.011110    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:36:01.019259 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.019241    2562 scope.go:117] "RemoveContainer" containerID="0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"
Jul 20 18:36:01.027026 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.027005    2562 scope.go:117] "RemoveContainer" containerID="6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469"
Jul 20 18:36:01.027314 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:36:01.027292    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469\": container with ID starting with 6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469 not found: ID does not exist" containerID="6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469"
Jul 20 18:36:01.027368 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.027323    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469"} err="failed to get container status \"6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469\": rpc error: code = NotFound desc = could not find container \"6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469\": container with ID starting with 6d0251da50947f27ffadb0b709fe27b7134e77df852198e67923df541b467469 not found: ID does not exist"
Jul 20 18:36:01.027368 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.027341    2562 scope.go:117] "RemoveContainer" containerID="0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"
Jul 20 18:36:01.027583 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:36:01.027564    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0\": container with ID starting with 0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0 not found: ID does not exist" containerID="0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"
Jul 20 18:36:01.027633 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.027589    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0"} err="failed to get container status \"0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0\": rpc error: code = NotFound desc = could not find container \"0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0\": container with ID starting with 0b5a5034fe6a487ca62a4bceec74d6f67d8033244d160891a8ae61b1b4e5f5d0 not found: ID does not exist"
Jul 20 18:36:01.036772 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.036728    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4" podStartSLOduration=1.494586391 podStartE2EDuration="2.036714785s" totalImagesPullingTime="542.128394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:36:01.035284181 +0000 UTC m=+2390.401261759" watchObservedRunningTime="2026-07-20 18:36:01.036714785 +0000 UTC m=+2390.402692363"
Jul 20 18:36:01.054467 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.054433    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"]
Jul 20 18:36:01.056734 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.056709    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-02ddb5-openshift-default-655664769-7z7fg"]
Jul 20 18:36:01.071186 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.071162    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:01.071186 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.071185    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2gfq\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-kube-api-access-h2gfq\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:01.071298 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.071196    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:01.071298 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.071205    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:01.071298 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.071213    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097a6c66-57a8-4ee4-bbf4-b98a6c3af131-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:01.131935 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:01.131892    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" path="/var/lib/kubelet/pods/097a6c66-57a8-4ee4-bbf4-b98a6c3af131/volumes"
Jul 20 18:36:03.339242 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:03.339202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:03.736191 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:03.736107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:04.203423 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.203381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:04.469985 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.469888    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"]
Jul 20 18:36:04.470479 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470463    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy"
Jul 20 18:36:04.470529 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470482    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy"
Jul 20 18:36:04.470529 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470498    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy"
Jul 20 18:36:04.470529 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470506    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy"
Jul 20 18:36:04.470529 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470517    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy"
Jul 20 18:36:04.470529 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470525    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy"
Jul 20 18:36:04.470681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470618    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy"
Jul 20 18:36:04.470681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.470630    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c03feb0-020e-411a-83df-82a7d20b3f37" containerName="istio-proxy"
Jul 20 18:36:04.475659 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.475632    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.478441 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.478418    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-09a1ba-openshift-default-dockercfg-b9kmw\""
Jul 20 18:36:04.488011 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.487986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"]
Jul 20 18:36:04.533441 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.533406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:04.607720 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.607685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-token\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.607938 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.607726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-podinfo\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.607938 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.607763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d5eb3f-4339-4f84-b475-b923013823ce-istiod-ca-cert\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.607938 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.607888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-envoy\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.608119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.607943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-data\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.608119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.607989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-credential-socket\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.608119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.608013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87b4\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-kube-api-access-n87b4\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.608119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.608085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-certs\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.608119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.608117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-socket\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709370 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d5eb3f-4339-4f84-b475-b923013823ce-istiod-ca-cert\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709555 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-envoy\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709555 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-data\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709662 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-credential-socket\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709662 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87b4\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-kube-api-access-n87b4\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709775 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-certs\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709775 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-socket\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.709907 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-token\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.710026 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.709963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-podinfo\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.710126 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.710104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-credential-socket\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.710242 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.710216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d5eb3f-4339-4f84-b475-b923013823ce-istiod-ca-cert\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.710365 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.710220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-data\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.710365 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.710279    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-socket\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.710365 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.710294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-certs\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.711760 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.711744    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-envoy\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.712480 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.712459    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-podinfo\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.712855 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.712836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:04.718828 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.718805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87b4\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-kube-api-access-n87b4\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.718963 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.718883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-token\") pod \"e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") " pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.787000 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.786959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:04.930960 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.930936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"]
Jul 20 18:36:04.933397 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:36:04.933373    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d5eb3f_4339_4f84_b475_b923013823ce.slice/crio-06b98ae43e945d7846300b1930bb157718acbe8be3a55b5850c053f404c2a325 WatchSource:0}: Error finding container 06b98ae43e945d7846300b1930bb157718acbe8be3a55b5850c053f404c2a325: Status 404 returned error can't find the container with id 06b98ae43e945d7846300b1930bb157718acbe8be3a55b5850c053f404c2a325
Jul 20 18:36:04.935657 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.935614    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:36:04.935766 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.935696    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:36:04.935766 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:04.935725    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:36:05.035388 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:05.035345    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" event={"ID":"c1d5eb3f-4339-4f84-b475-b923013823ce","Type":"ContainerStarted","Data":"af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"}
Jul 20 18:36:05.035560 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:05.035415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" event={"ID":"c1d5eb3f-4339-4f84-b475-b923013823ce","Type":"ContainerStarted","Data":"06b98ae43e945d7846300b1930bb157718acbe8be3a55b5850c053f404c2a325"}
Jul 20 18:36:05.074161 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:05.074040    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podStartSLOduration=1.074018057 podStartE2EDuration="1.074018057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:36:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:36:05.072500284 +0000 UTC m=+2394.438477884" watchObservedRunningTime="2026-07-20 18:36:05.074018057 +0000 UTC m=+2394.439995703"
Jul 20 18:36:05.788001 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:05.787959    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:05.789591 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:05.789568    2562 patch_prober.go:28] interesting pod/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 20 18:36:05.789723 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:05.789611    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 20 18:36:06.792366 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:06.792335    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:07.022749 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.022719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:36:07.049652 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.049561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:07.051164 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.051125    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:07.074022 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.073988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:07.180298 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.180266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:07.257781 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.257749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:07.642194 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.642158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:07.881660 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.881611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:07.986956 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:07.986847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:11.538935 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:11.538838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:20.174541 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:20.174504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:20.275174 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:20.275147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:21.129329 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:21.129293    2562 generic.go:356] "Generic (PLEG): container finished" podID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerID="af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92" exitCode=0
Jul 20 18:36:21.130594 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:21.130570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" event={"ID":"c1d5eb3f-4339-4f84-b475-b923013823ce","Type":"ContainerDied","Data":"af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"}
Jul 20 18:36:21.130977 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:21.130962    2562 scope.go:117] "RemoveContainer" containerID="af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"
Jul 20 18:36:21.131981 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:21.131953    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:36:21.132044 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:21.132022    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:36:21.132081 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:21.132052    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:36:22.050025 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:22.049990    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:22.135556 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:22.135512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" event={"ID":"c1d5eb3f-4339-4f84-b475-b923013823ce","Type":"ContainerStarted","Data":"a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad"}
Jul 20 18:36:22.788102 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:22.788065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:22.789596 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:22.789564    2562 patch_prober.go:28] interesting pod/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 20 18:36:22.789724 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:22.789639    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 20 18:36:23.788342 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:23.788289    2562 patch_prober.go:28] interesting pod/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 20 18:36:23.788857 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:23.788366    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 20 18:36:24.788137 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:24.788095    2562 patch_prober.go:28] interesting pod/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 20 18:36:24.788461 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:24.788429    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 20 18:36:25.787681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:25.787640    2562 patch_prober.go:28] interesting pod/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 20 18:36:25.787980 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:25.787950    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 20 18:36:26.792528 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:26.792497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:26.792911 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:26.792897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:26.793573 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:26.793555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:36:27.137834 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:27.137748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:27.211990 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:27.211957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:28.847085 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:28.847054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:28.934530 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:28.934498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:30.281258 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:30.281227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:30.383115 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:30.383081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:35.605162 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:35.605125    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"]
Jul 20 18:36:35.605684 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:35.605353    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4" podUID="28c3ad57-5a7c-46d2-a777-d0da845edd4a" containerName="maas-api" containerID="cri-o://ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de" gracePeriod=30
Jul 20 18:36:35.637620 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:35.637574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:35.863307 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:35.863237    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:36:36.032424 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.032390    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c3ad57-5a7c-46d2-a777-d0da845edd4a-maas-api-tls\") pod \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") "
Jul 20 18:36:36.032613 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.032441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzk4f\" (UniqueName: \"kubernetes.io/projected/28c3ad57-5a7c-46d2-a777-d0da845edd4a-kube-api-access-mzk4f\") pod \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") "
Jul 20 18:36:36.032613 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.032598    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c3ad57-5a7c-46d2-a777-d0da845edd4a-openshift-service-ca\") pod \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\" (UID: \"28c3ad57-5a7c-46d2-a777-d0da845edd4a\") "
Jul 20 18:36:36.032968 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.032939    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28c3ad57-5a7c-46d2-a777-d0da845edd4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28c3ad57-5a7c-46d2-a777-d0da845edd4a" (UID: "28c3ad57-5a7c-46d2-a777-d0da845edd4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:36:36.033092 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.033047    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c3ad57-5a7c-46d2-a777-d0da845edd4a-openshift-service-ca\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:36.034547 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.034526    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28c3ad57-5a7c-46d2-a777-d0da845edd4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28c3ad57-5a7c-46d2-a777-d0da845edd4a" (UID: "28c3ad57-5a7c-46d2-a777-d0da845edd4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:36:36.034651 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.034624    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c3ad57-5a7c-46d2-a777-d0da845edd4a-kube-api-access-mzk4f" (OuterVolumeSpecName: "kube-api-access-mzk4f") pod "28c3ad57-5a7c-46d2-a777-d0da845edd4a" (UID: "28c3ad57-5a7c-46d2-a777-d0da845edd4a"). InnerVolumeSpecName "kube-api-access-mzk4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:36:36.133694 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.133597    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c3ad57-5a7c-46d2-a777-d0da845edd4a-maas-api-tls\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:36.133694 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.133630    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzk4f\" (UniqueName: \"kubernetes.io/projected/28c3ad57-5a7c-46d2-a777-d0da845edd4a-kube-api-access-mzk4f\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:36:36.200729 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.200691    2562 generic.go:356] "Generic (PLEG): container finished" podID="28c3ad57-5a7c-46d2-a777-d0da845edd4a" containerID="ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de" exitCode=0
Jul 20 18:36:36.200902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.200741    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"
Jul 20 18:36:36.200902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.200740    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4" event={"ID":"28c3ad57-5a7c-46d2-a777-d0da845edd4a","Type":"ContainerDied","Data":"ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de"}
Jul 20 18:36:36.200902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.200865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4" event={"ID":"28c3ad57-5a7c-46d2-a777-d0da845edd4a","Type":"ContainerDied","Data":"4196efbfcc259bef9e01d08d9a833405cfb1a12ea47e6870770eedba8a48090f"}
Jul 20 18:36:36.200902 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.200898    2562 scope.go:117] "RemoveContainer" containerID="ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de"
Jul 20 18:36:36.210256 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.210228    2562 scope.go:117] "RemoveContainer" containerID="ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de"
Jul 20 18:36:36.210556 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:36:36.210538    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de\": container with ID starting with ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de not found: ID does not exist" containerID="ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de"
Jul 20 18:36:36.210602 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.210569    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de"} err="failed to get container status \"ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de\": rpc error: code = NotFound desc = could not find container \"ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de\": container with ID starting with ea74fac67b8f55f544ff9f135ec1e7e6c2ad7504eba70908c8208d0224c6e3de not found: ID does not exist"
Jul 20 18:36:36.223780 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.223747    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"]
Jul 20 18:36:36.229754 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:36.229725    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3054a0-6647fc5ff4-kn2s4"]
Jul 20 18:36:37.131283 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:37.131250    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c3ad57-5a7c-46d2-a777-d0da845edd4a" path="/var/lib/kubelet/pods/28c3ad57-5a7c-46d2-a777-d0da845edd4a/volumes"
Jul 20 18:36:39.676554 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:39.676512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:40.068312 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:40.068277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:46.098362 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:46.098327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:46.191384 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:46.191345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:46.372361 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:46.372278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:46.619175 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:46.619068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:47.691796 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:47.691729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:47.786884 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:47.786835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:58.475899 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:58.475863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:58.584849 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:36:58.584814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:02.260372 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:02.260325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:06.830370 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:06.830327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:07.187604 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:07.187503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:13.157754 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:13.157716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:13.249972 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:13.249938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:13.412617 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:13.412529    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"]
Jul 20 18:37:13.412810 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:13.412784    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy" containerID="cri-o://a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad" gracePeriod=30
Jul 20 18:37:13.431594 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:13.431565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:13.664967 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:13.664836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:14.016185 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.016152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:14.318770 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.318677    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"]
Jul 20 18:37:14.319286 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.319267    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c3ad57-5a7c-46d2-a777-d0da845edd4a" containerName="maas-api"
Jul 20 18:37:14.319364 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.319289    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c3ad57-5a7c-46d2-a777-d0da845edd4a" containerName="maas-api"
Jul 20 18:37:14.319420 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.319386    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c3ad57-5a7c-46d2-a777-d0da845edd4a" containerName="maas-api"
Jul 20 18:37:14.319420 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.319401    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="097a6c66-57a8-4ee4-bbf4-b98a6c3af131" containerName="istio-proxy"
Jul 20 18:37:14.322428 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.322409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.325439 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.325421    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0d90bc-openshift-default-dockercfg-776df\""
Jul 20 18:37:14.336175 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.336145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"]
Jul 20 18:37:14.360222 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.360181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:14.418261 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-socket\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418436 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/858feab0-19e4-4d31-b548-d721e00238af-istiod-ca-cert\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418436 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/858feab0-19e4-4d31-b548-d721e00238af-istio-podinfo\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418436 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-data\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-credential-socket\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjjr\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-kube-api-access-gwjjr\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418627 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-certs\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418761 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-envoy\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.418761 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.418685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-istio-token\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519525 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/858feab0-19e4-4d31-b548-d721e00238af-istiod-ca-cert\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519699 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/858feab0-19e4-4d31-b548-d721e00238af-istio-podinfo\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519699 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-data\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519810 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-credential-socket\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519810 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjjr\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-kube-api-access-gwjjr\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519810 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-certs\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-envoy\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-istio-token\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.519979 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.519910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-socket\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.520164 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.520133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-data\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.520306 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.520268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-socket\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.520429 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.520412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-certs\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.520503 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.520412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/858feab0-19e4-4d31-b548-d721e00238af-istiod-ca-cert\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.520640 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.520620    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-credential-socket\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.522158 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.522128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/858feab0-19e4-4d31-b548-d721e00238af-istio-podinfo\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.522278 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.522260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-envoy\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.533429 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.533400    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjjr\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-kube-api-access-gwjjr\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.533744 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.533725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-istio-token\") pod \"e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") " pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.633673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.633579    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:14.783416 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.783388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"]
Jul 20 18:37:14.785996 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:37:14.785961    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858feab0_19e4_4d31_b548_d721e00238af.slice/crio-bdc144fa0029d60b41c070c78ffbcf7a5275c97b1e89a9f0d32c30a692081f8d WatchSource:0}: Error finding container bdc144fa0029d60b41c070c78ffbcf7a5275c97b1e89a9f0d32c30a692081f8d: Status 404 returned error can't find the container with id bdc144fa0029d60b41c070c78ffbcf7a5275c97b1e89a9f0d32c30a692081f8d
Jul 20 18:37:14.791955 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.788876    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:14.791955 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.789067    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:14.791955 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:14.789160    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:15.124909 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:15.124839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:15.393589 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:15.393491    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" event={"ID":"858feab0-19e4-4d31-b548-d721e00238af","Type":"ContainerStarted","Data":"65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"}
Jul 20 18:37:15.393589 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:15.393551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" event={"ID":"858feab0-19e4-4d31-b548-d721e00238af","Type":"ContainerStarted","Data":"bdc144fa0029d60b41c070c78ffbcf7a5275c97b1e89a9f0d32c30a692081f8d"}
Jul 20 18:37:15.416252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:15.416194    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podStartSLOduration=1.416176386 podStartE2EDuration="1.416176386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:37:15.414000406 +0000 UTC m=+2464.779977984" watchObservedRunningTime="2026-07-20 18:37:15.416176386 +0000 UTC m=+2464.782154043"
Jul 20 18:37:15.633940 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:15.633895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:15.638900 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:15.638870    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:16.398024 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:16.397991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:16.399174 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:16.399157    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:17.366642 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:17.366595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:17.520957 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:17.520908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:17.618256 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:17.618160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:17.851214 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:17.851168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:18.073583 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.073541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:18.181929 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.181887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:18.670833 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.670810    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:37:18.755941 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.755883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-podinfo\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.755945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d5eb3f-4339-4f84-b475-b923013823ce-istiod-ca-cert\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.755978    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-token\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756027    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-data\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756050    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-socket\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-envoy\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756132    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n87b4\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-kube-api-access-n87b4\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756159    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-credential-socket\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756186    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-certs\") pod \"c1d5eb3f-4339-4f84-b475-b923013823ce\" (UID: \"c1d5eb3f-4339-4f84-b475-b923013823ce\") "
Jul 20 18:37:18.756526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756424    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d5eb3f-4339-4f84-b475-b923013823ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:37:18.756526 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756428    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:37:18.756741 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756646    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:37:18.756741 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.756668    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:37:18.757055 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.757030    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:37:18.758322 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.758300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:37:18.758419 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.758361    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:37:18.758419 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.758375    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-kube-api-access-n87b4" (OuterVolumeSpecName: "kube-api-access-n87b4") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "kube-api-access-n87b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:37:18.758508 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.758482    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1d5eb3f-4339-4f84-b475-b923013823ce" (UID: "c1d5eb3f-4339-4f84-b475-b923013823ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:37:18.857336 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857288    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857336 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857327    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857336 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857338    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857336 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857347    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n87b4\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-kube-api-access-n87b4\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857356    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857364    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d5eb3f-4339-4f84-b475-b923013823ce-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857372    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857381    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d5eb3f-4339-4f84-b475-b923013823ce-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:18.857612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:18.857389    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d5eb3f-4339-4f84-b475-b923013823ce-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:37:19.414886 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.414793    2562 generic.go:356] "Generic (PLEG): container finished" podID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerID="a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad" exitCode=0
Jul 20 18:37:19.414886 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.414846    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"
Jul 20 18:37:19.414886 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.414875    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" event={"ID":"c1d5eb3f-4339-4f84-b475-b923013823ce","Type":"ContainerDied","Data":"a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad"}
Jul 20 18:37:19.415149 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.414951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb" event={"ID":"c1d5eb3f-4339-4f84-b475-b923013823ce","Type":"ContainerDied","Data":"06b98ae43e945d7846300b1930bb157718acbe8be3a55b5850c053f404c2a325"}
Jul 20 18:37:19.415149 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.414976    2562 scope.go:117] "RemoveContainer" containerID="a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad"
Jul 20 18:37:19.424126 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.424106    2562 scope.go:117] "RemoveContainer" containerID="af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"
Jul 20 18:37:19.432132 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.432107    2562 scope.go:117] "RemoveContainer" containerID="a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad"
Jul 20 18:37:19.432548 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:37:19.432518    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad\": container with ID starting with a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad not found: ID does not exist" containerID="a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad"
Jul 20 18:37:19.432655 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.432559    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad"} err="failed to get container status \"a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad\": rpc error: code = NotFound desc = could not find container \"a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad\": container with ID starting with a2a917f795299613b8bfc46cc0f94e097eaeba98c358fb1b0119839734c27bad not found: ID does not exist"
Jul 20 18:37:19.432655 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.432586    2562 scope.go:117] "RemoveContainer" containerID="af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"
Jul 20 18:37:19.433608 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:37:19.433010    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92\": container with ID starting with af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92 not found: ID does not exist" containerID="af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"
Jul 20 18:37:19.433715 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.433628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92"} err="failed to get container status \"af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92\": rpc error: code = NotFound desc = could not find container \"af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92\": container with ID starting with af1bbe5ecc1290ab327632414ecb873c218f8107123ea972f7d8a0c6d30cfa92 not found: ID does not exist"
Jul 20 18:37:19.438750 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.438723    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"]
Jul 20 18:37:19.443208 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:19.443180    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-09a1ba-openshift-default-f7b7c8565-jhhtb"]
Jul 20 18:37:21.132047 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:21.132014    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" path="/var/lib/kubelet/pods/c1d5eb3f-4339-4f84-b475-b923013823ce/volumes"
Jul 20 18:37:21.808349 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:21.808315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:22.132115 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.132022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:22.403270 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403182    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"]
Jul 20 18:37:22.403773 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403753    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy"
Jul 20 18:37:22.403773 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403773    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy"
Jul 20 18:37:22.403936 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403785    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy"
Jul 20 18:37:22.403936 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403790    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy"
Jul 20 18:37:22.403936 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403886    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy"
Jul 20 18:37:22.403936 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.403896    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d5eb3f-4339-4f84-b475-b923013823ce" containerName="istio-proxy"
Jul 20 18:37:22.407070 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.407051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.409892 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.409870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-94313f-openshift-default-dockercfg-8848w\""
Jul 20 18:37:22.420422 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.420395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"]
Jul 20 18:37:22.441799 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.441752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-credential-socket\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-token\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-envoy\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-socket\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-certs\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-data\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7rtz\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-kube-api-access-s7rtz\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-podinfo\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.490107 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.489882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istiod-ca-cert\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.590761 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rtz\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-kube-api-access-s7rtz\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.590761 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-podinfo\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591068 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istiod-ca-cert\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591068 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-credential-socket\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591068 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-token\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591068 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-envoy\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591068 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-socket\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591068 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.590997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-certs\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591369 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.591073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-data\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591748 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.591469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-socket\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591748 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.591657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-credential-socket\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.591748 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.591714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-certs\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.592006 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.591764    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istiod-ca-cert\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.592089 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.592064    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-data\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.593295 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.593267    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-envoy\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.593430 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.593414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-podinfo\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.600532 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.600340    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-token\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.600532 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.600490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rtz\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-kube-api-access-s7rtz\") pod \"e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") " pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.717713 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.717621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:22.726124 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.726068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:22.875307 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.875278    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"]
Jul 20 18:37:22.877307 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:37:22.877284    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5cecf4_3158_47a6_b605_72d1cf56aae4.slice/crio-6865caf3d716228e1bac35bd94d833eb7ea756ac70fc17c5b4aef75ba09c3480 WatchSource:0}: Error finding container 6865caf3d716228e1bac35bd94d833eb7ea756ac70fc17c5b4aef75ba09c3480: Status 404 returned error can't find the container with id 6865caf3d716228e1bac35bd94d833eb7ea756ac70fc17c5b4aef75ba09c3480
Jul 20 18:37:22.879650 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.879612    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:22.879745 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.879707    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:22.879784 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:22.879757    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:23.437863 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:23.437833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" event={"ID":"2f5cecf4-3158-47a6-b605-72d1cf56aae4","Type":"ContainerStarted","Data":"65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"}
Jul 20 18:37:23.438299 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:23.437884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" event={"ID":"2f5cecf4-3158-47a6-b605-72d1cf56aae4","Type":"ContainerStarted","Data":"6865caf3d716228e1bac35bd94d833eb7ea756ac70fc17c5b4aef75ba09c3480"}
Jul 20 18:37:23.463138 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:23.463069    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podStartSLOduration=1.463049753 podStartE2EDuration="1.463049753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:37:23.460880641 +0000 UTC m=+2472.826858221" watchObservedRunningTime="2026-07-20 18:37:23.463049753 +0000 UTC m=+2472.829027332"
Jul 20 18:37:23.717986 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:23.717871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:23.719547 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:23.719518    2562 patch_prober.go:28] interesting pod/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 20 18:37:23.719689 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:23.719568    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 20 18:37:24.728244 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:24.728214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:25.404613 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:25.404571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:25.448071 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:25.448033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:25.449119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:25.449101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:25.533113 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:25.533070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:25.631764 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:25.631725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:25.755654 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:25.755627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:26.120751 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:26.120661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:26.224556 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:26.224524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:29.876773 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:29.876728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:31.400090 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.400046    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 20 18:37:31.400729 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.400690    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 20 18:37:31.478119 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.478087    2562 generic.go:356] "Generic (PLEG): container finished" podID="858feab0-19e4-4d31-b548-d721e00238af" containerID="65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a" exitCode=0
Jul 20 18:37:31.478300 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.478131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" event={"ID":"858feab0-19e4-4d31-b548-d721e00238af","Type":"ContainerDied","Data":"65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"}
Jul 20 18:37:31.478570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.478555    2562 scope.go:117] "RemoveContainer" containerID="65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"
Jul 20 18:37:31.479608 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.479578    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:31.479661 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.479651    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:31.479724 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:31.479711    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:32.486075 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:32.486036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" event={"ID":"858feab0-19e4-4d31-b548-d721e00238af","Type":"ContainerStarted","Data":"7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c"}
Jul 20 18:37:32.634456 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:32.634427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:32.634739 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:32.634722    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 20 18:37:32.634841 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:32.634825    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 20 18:37:33.634664 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:33.634619    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 20 18:37:33.635191 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:33.634686    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 20 18:37:34.634330 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:34.634291    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 20 18:37:34.634528 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:34.634348    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 20 18:37:35.634747 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:35.634705    2562 patch_prober.go:28] interesting pod/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 20 18:37:35.635183 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:35.634778    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 20 18:37:36.638371 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:36.638341    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:36.638814 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:36.638608    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:36.639270 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:36.639253    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:37:38.525047 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:38.525009    2562 generic.go:356] "Generic (PLEG): container finished" podID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerID="65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905" exitCode=0
Jul 20 18:37:38.525574 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:38.525087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" event={"ID":"2f5cecf4-3158-47a6-b605-72d1cf56aae4","Type":"ContainerDied","Data":"65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"}
Jul 20 18:37:38.525700 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:38.525680    2562 scope.go:117] "RemoveContainer" containerID="65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"
Jul 20 18:37:38.526604 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:38.526579    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:38.526660 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:38.526642    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:38.526697 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:38.526674    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:37:39.116718 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:39.116681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:39.217311 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:39.217278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:39.532991 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:39.532956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" event={"ID":"2f5cecf4-3158-47a6-b605-72d1cf56aae4","Type":"ContainerStarted","Data":"e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e"}
Jul 20 18:37:39.718835 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:39.718797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:39.720056 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:39.720014    2562 patch_prober.go:28] interesting pod/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 20 18:37:39.720194 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:39.720075    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 20 18:37:40.448045 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:40.448005    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:40.718612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:40.718519    2562 patch_prober.go:28] interesting pod/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 20 18:37:40.718612 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:40.718577    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 20 18:37:41.718404 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:41.718366    2562 patch_prober.go:28] interesting pod/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 20 18:37:41.718592 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:41.718457    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 20 18:37:42.718779 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:42.718742    2562 patch_prober.go:28] interesting pod/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 20 18:37:42.719223 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:42.718808    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 20 18:37:43.722789 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:43.722755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:43.723728 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:43.723707    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:37:46.932582 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:46.932546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:47.035690 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:47.035654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:50.336798 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:37:50.336765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:21.916938 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:38:21.916890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:04.680518 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:39:04.680477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:22.317402 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:39:22.317365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:22.418307 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:39:22.418281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:56.313124 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:39:56.313079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:40:28.159251 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:40:28.159212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:40:29.038015 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:40:29.037988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:40:54.242876 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:40:54.242837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:41:19.887105 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:41:19.887018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:41:59.486652 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:41:59.486619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:41:59.587679 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:41:59.587637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:03.639143 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:03.639110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:04.506499 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:04.506459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:13.871658 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:13.871616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:29.842303 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:29.842256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:39.905701 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:39.905663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:40.006856 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:40.006823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:47.902689 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:47.902650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:48.003084 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:48.003051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:42:51.227409 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:42:51.227366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:43:47.117415 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:43:47.117384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:43:57.706317 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:43:57.706279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:43:58.559502 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:43:58.559469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:18.251973 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:18.251882    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:18.353019 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:18.352988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:28.323545 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:28.323495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:32.793794 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:32.793761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:33.242671 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:33.242580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:39.198498 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:39.198465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:39.310748 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:39.310712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:39.563159 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:39.563118    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"]
Jul 20 18:44:39.563402 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:39.563377    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy" containerID="cri-o://7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c" gracePeriod=30
Jul 20 18:44:39.587437 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:39.587407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:39.753395 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:39.753357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:40.446807 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:40.446774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:40.551681 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:40.551640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:44.820208 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.820182    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:44:44.972959 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.972841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwjjr\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-kube-api-access-gwjjr\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.972959 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.972885    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-credential-socket\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.972959 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.972906    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/858feab0-19e4-4d31-b548-d721e00238af-istiod-ca-cert\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.972992    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-socket\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973021    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-envoy\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-certs\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973084    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-istio-token\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/858feab0-19e4-4d31-b548-d721e00238af-istio-podinfo\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973184    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-data\") pod \"858feab0-19e4-4d31-b548-d721e00238af\" (UID: \"858feab0-19e4-4d31-b548-d721e00238af\") "
Jul 20 18:44:44.973252 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973205    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:44:44.973614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973374    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:44:44.973614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973490    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:44:44.973614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973540    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:44.973614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973560    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:44.973841 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.973667    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/858feab0-19e4-4d31-b548-d721e00238af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:44:44.974173 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.974151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-data" (OuterVolumeSpecName: "istio-data") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:44:44.975334 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.975315    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/858feab0-19e4-4d31-b548-d721e00238af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:44:44.975421 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.975367    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:44:44.975644 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.975625    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-istio-token" (OuterVolumeSpecName: "istio-token") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:44:44.975720 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:44.975650    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-kube-api-access-gwjjr" (OuterVolumeSpecName: "kube-api-access-gwjjr") pod "858feab0-19e4-4d31-b548-d721e00238af" (UID: "858feab0-19e4-4d31-b548-d721e00238af"). InnerVolumeSpecName "kube-api-access-gwjjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:44:45.074389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074346    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.074389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074380    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/858feab0-19e4-4d31-b548-d721e00238af-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.074389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074389    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.074389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074398    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwjjr\" (UniqueName: \"kubernetes.io/projected/858feab0-19e4-4d31-b548-d721e00238af-kube-api-access-gwjjr\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.074670 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074407    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/858feab0-19e4-4d31-b548-d721e00238af-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.074670 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074416    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.074670 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.074424    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/858feab0-19e4-4d31-b548-d721e00238af-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:44:45.573432 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.573399    2562 generic.go:356] "Generic (PLEG): container finished" podID="858feab0-19e4-4d31-b548-d721e00238af" containerID="7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c" exitCode=0
Jul 20 18:44:45.573615 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.573445    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"
Jul 20 18:44:45.573615 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.573455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" event={"ID":"858feab0-19e4-4d31-b548-d721e00238af","Type":"ContainerDied","Data":"7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c"}
Jul 20 18:44:45.573615 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.573500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps" event={"ID":"858feab0-19e4-4d31-b548-d721e00238af","Type":"ContainerDied","Data":"bdc144fa0029d60b41c070c78ffbcf7a5275c97b1e89a9f0d32c30a692081f8d"}
Jul 20 18:44:45.573615 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.573521    2562 scope.go:117] "RemoveContainer" containerID="7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c"
Jul 20 18:44:45.582160 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.582140    2562 scope.go:117] "RemoveContainer" containerID="65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"
Jul 20 18:44:45.590028 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.590010    2562 scope.go:117] "RemoveContainer" containerID="7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c"
Jul 20 18:44:45.590292 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:44:45.590274    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c\": container with ID starting with 7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c not found: ID does not exist" containerID="7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c"
Jul 20 18:44:45.590336 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.590302    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c"} err="failed to get container status \"7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c\": rpc error: code = NotFound desc = could not find container \"7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c\": container with ID starting with 7920eb9b70607e7c27feab40757540848a6a5b14e88ef7e32c82c9d6dd263e7c not found: ID does not exist"
Jul 20 18:44:45.590336 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.590319    2562 scope.go:117] "RemoveContainer" containerID="65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"
Jul 20 18:44:45.590562 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:44:45.590547    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a\": container with ID starting with 65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a not found: ID does not exist" containerID="65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"
Jul 20 18:44:45.590609 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.590565    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a"} err="failed to get container status \"65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a\": rpc error: code = NotFound desc = could not find container \"65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a\": container with ID starting with 65a5eb4b178e44e48f5db94a3d248d02045ed22d9bf083f51f98dcea9c838a6a not found: ID does not exist"
Jul 20 18:44:45.604129 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.604095    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"]
Jul 20 18:44:45.611505 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:45.611478    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0d90bc-openshift-default-67cf8cd4dc-w28ps"]
Jul 20 18:44:47.132169 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:47.132133    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858feab0-19e4-4d31-b548-d721e00238af" path="/var/lib/kubelet/pods/858feab0-19e4-4d31-b548-d721e00238af/volumes"
Jul 20 18:44:50.349883 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:50.349852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:54.971881 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:54.971847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:44:55.399896 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:44:55.399864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:02.665866 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:02.665835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:02.777711 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:02.777662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:02.990080 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:02.989992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"]
Jul 20 18:45:02.990260 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:02.990236    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy" containerID="cri-o://e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e" gracePeriod=30
Jul 20 18:45:03.207458 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:03.207422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:03.308211 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:03.308178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:08.250311 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.250289    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:45:08.290086 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.289987    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istiod-ca-cert\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290086 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290073    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-credential-socket\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290109    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-certs\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290183    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-data\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290207    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7rtz\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-kube-api-access-s7rtz\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-podinfo\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-socket\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290311    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-envoy\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-token\") pod \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\" (UID: \"2f5cecf4-3158-47a6-b605-72d1cf56aae4\") "
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:45:08.290570 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290512    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:45:08.291122 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290679    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istiod-ca-cert\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.291122 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290717    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-credential-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.291122 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.290752    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:45:08.291296 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.291249    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:45:08.291404 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.291381    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:45:08.294059 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.293883    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-kube-api-access-s7rtz" (OuterVolumeSpecName: "kube-api-access-s7rtz") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "kube-api-access-s7rtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:45:08.294267 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.294238    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:45:08.295991 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.294609    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:45:08.295991 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.294743    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f5cecf4-3158-47a6-b605-72d1cf56aae4" (UID: "2f5cecf4-3158-47a6-b605-72d1cf56aae4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:45:08.391425 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391386    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-certs\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.391425 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391418    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-data\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.391425 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391432    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7rtz\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-kube-api-access-s7rtz\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.391673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391445    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-podinfo\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.391673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391456    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-workload-socket\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.391673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391468    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-envoy\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.391673 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.391478    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5cecf4-3158-47a6-b605-72d1cf56aae4-istio-token\") on node \"ip-10-0-138-227.ec2.internal\" DevicePath \"\""
Jul 20 18:45:08.684036 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.683947    2562 generic.go:356] "Generic (PLEG): container finished" podID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerID="e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e" exitCode=0
Jul 20 18:45:08.684036 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.684019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" event={"ID":"2f5cecf4-3158-47a6-b605-72d1cf56aae4","Type":"ContainerDied","Data":"e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e"}
Jul 20 18:45:08.684217 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.684059    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"
Jul 20 18:45:08.684217 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.684085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx" event={"ID":"2f5cecf4-3158-47a6-b605-72d1cf56aae4","Type":"ContainerDied","Data":"6865caf3d716228e1bac35bd94d833eb7ea756ac70fc17c5b4aef75ba09c3480"}
Jul 20 18:45:08.684217 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.684109    2562 scope.go:117] "RemoveContainer" containerID="e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e"
Jul 20 18:45:08.693514 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.693490    2562 scope.go:117] "RemoveContainer" containerID="65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"
Jul 20 18:45:08.701086 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.701043    2562 scope.go:117] "RemoveContainer" containerID="e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e"
Jul 20 18:45:08.701312 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:45:08.701292    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e\": container with ID starting with e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e not found: ID does not exist" containerID="e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e"
Jul 20 18:45:08.701355 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.701321    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e"} err="failed to get container status \"e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e\": rpc error: code = NotFound desc = could not find container \"e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e\": container with ID starting with e03051036e7cbb43fbbe9a52a5000fd2f55b177ef1a5ff366ac1a066a026ef2e not found: ID does not exist"
Jul 20 18:45:08.701355 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.701338    2562 scope.go:117] "RemoveContainer" containerID="65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"
Jul 20 18:45:08.701587 ip-10-0-138-227 kubenswrapper[2562]: E0720 18:45:08.701568    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905\": container with ID starting with 65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905 not found: ID does not exist" containerID="65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"
Jul 20 18:45:08.701636 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.701593    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905"} err="failed to get container status \"65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905\": rpc error: code = NotFound desc = could not find container \"65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905\": container with ID starting with 65d7d08aa7bbcf4ecefbfdf8305c73fd22f5ffb6dfb6b7a6332e0c810e1de905 not found: ID does not exist"
Jul 20 18:45:08.712814 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.712794    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"]
Jul 20 18:45:08.716429 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:08.716407    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-94313f-openshift-default-78b85b7dc9-x8hnx"]
Jul 20 18:45:09.131124 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:09.131089    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" path="/var/lib/kubelet/pods/2f5cecf4-3158-47a6-b605-72d1cf56aae4/volumes"
Jul 20 18:45:11.016091 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:11.016065    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79747b4d4c-dx8nf_4b8111bb-6583-4b6c-b2de-547c9e93fc4c/manager/0.log"
Jul 20 18:45:11.023832 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:11.023812    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79747b4d4c-dx8nf_4b8111bb-6583-4b6c-b2de-547c9e93fc4c/copy-manifests/0.log"
Jul 20 18:45:11.425748 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:11.425717    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d978fb74-6s5l5_0225c282-6a0b-4f3f-94d5-8926c46876ad/maas-api/0.log"
Jul 20 18:45:14.071446 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:14.071417    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-56bmf_cc4ccb08-955b-45be-b56e-1053f3620b15/manager/0.log"
Jul 20 18:45:16.049209 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:16.049175    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b729_ca6fe371-f421-4be6-8d26-e02bc9ab1409/discovery/0.log"
Jul 20 18:45:18.369083 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:18.369054    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84b9f6bdc8-jsqhx_209f363a-7c84-4e3b-8c5a-b05d7237b8c2/router/0.log"
Jul 20 18:45:18.894389 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:18.894360    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-n4zfs_aee24104-2ab2-48a6-9764-4ccdeb950fc5/main/0.log"
Jul 20 18:45:19.017039 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:19.017013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jj6df_52dc3cac-145a-4c97-9407-7716cf2601eb/main/0.log"
Jul 20 18:45:19.264033 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:19.264005    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zp9v4_5f347be5-8da3-4a48-9177-4843cebdaf5c/main/0.log"
Jul 20 18:45:24.973890 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:24.973857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:25.067233 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:25.067198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log" limit=1024
Jul 20 18:45:27.920426 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:27.920395    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4ngwk_7e87f8a3-cd47-49ee-be63-c2927fcb7979/global-pull-secret-syncer/0.log"
Jul 20 18:45:28.080606 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:28.080573    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k5hxb_258a9c5e-92b3-40c1-9b7e-7f6c0e24a312/konnectivity-agent/0.log"
Jul 20 18:45:28.244747 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:28.244679    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-227.ec2.internal_e2e50227d65fda4050a8a8dd57637707/haproxy/0.log"
Jul 20 18:45:34.149543 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:34.149507    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-56bmf_cc4ccb08-955b-45be-b56e-1053f3620b15/manager/0.log"
Jul 20 18:45:36.009468 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.009442    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/alertmanager/0.log"
Jul 20 18:45:36.049250 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.049214    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/config-reloader/0.log"
Jul 20 18:45:36.076419 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.076392    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/kube-rbac-proxy-web/0.log"
Jul 20 18:45:36.101201 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.101174    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/kube-rbac-proxy/0.log"
Jul 20 18:45:36.133382 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.133349    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/kube-rbac-proxy-metric/0.log"
Jul 20 18:45:36.165623 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.165586    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/prom-label-proxy/0.log"
Jul 20 18:45:36.194698 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.194676    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfc6c363-a695-445c-81e6-e996af0a8a70/init-config-reloader/0.log"
Jul 20 18:45:36.239108 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.239082    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-8n2j9_e7c52581-b3d6-4579-8217-61140f17d5f3/cluster-monitoring-operator/0.log"
Jul 20 18:45:36.271887 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.271808    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-sc8pz_a9d22c22-3bf5-435b-9eff-e2189bfe593e/kube-state-metrics/0.log"
Jul 20 18:45:36.296357 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.296333    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-sc8pz_a9d22c22-3bf5-435b-9eff-e2189bfe593e/kube-rbac-proxy-main/0.log"
Jul 20 18:45:36.320726 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.320702    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-sc8pz_a9d22c22-3bf5-435b-9eff-e2189bfe593e/kube-rbac-proxy-self/0.log"
Jul 20 18:45:36.671975 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.671866    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r692k_b067cced-5894-4f28-99ab-c95b8ddf34cf/node-exporter/0.log"
Jul 20 18:45:36.698422 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.698401    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r692k_b067cced-5894-4f28-99ab-c95b8ddf34cf/kube-rbac-proxy/0.log"
Jul 20 18:45:36.731014 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.730986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r692k_b067cced-5894-4f28-99ab-c95b8ddf34cf/init-textfile/0.log"
Jul 20 18:45:36.762631 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.762604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-n4c7p_714a59ad-a987-4bc2-9f25-bd7488aeb692/kube-rbac-proxy-main/0.log"
Jul 20 18:45:36.789797 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.789765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-n4c7p_714a59ad-a987-4bc2-9f25-bd7488aeb692/kube-rbac-proxy-self/0.log"
Jul 20 18:45:36.813883 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.813857    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-n4c7p_714a59ad-a987-4bc2-9f25-bd7488aeb692/openshift-state-metrics/0.log"
Jul 20 18:45:36.854167 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.854140    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/prometheus/0.log"
Jul 20 18:45:36.895100 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.895071    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/config-reloader/0.log"
Jul 20 18:45:36.921898 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.921871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/thanos-sidecar/0.log"
Jul 20 18:45:36.948133 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.948066    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/kube-rbac-proxy-web/0.log"
Jul 20 18:45:36.973594 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.973573    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/kube-rbac-proxy/0.log"
Jul 20 18:45:36.999653 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:36.999628    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/kube-rbac-proxy-thanos/0.log"
Jul 20 18:45:37.028498 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.028474    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6e0ab74-59bd-44b5-ab2a-1c6d4d764d74/init-config-reloader/0.log"
Jul 20 18:45:37.924301 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924268    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"]
Jul 20 18:45:37.924638 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924626    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy"
Jul 20 18:45:37.924683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924640    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy"
Jul 20 18:45:37.924683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924656    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy"
Jul 20 18:45:37.924683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924662    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy"
Jul 20 18:45:37.924683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924679    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy"
Jul 20 18:45:37.924809 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924686    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy"
Jul 20 18:45:37.924809 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924740    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy"
Jul 20 18:45:37.924809 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924748    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="858feab0-19e4-4d31-b548-d721e00238af" containerName="istio-proxy"
Jul 20 18:45:37.924809 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.924754    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f5cecf4-3158-47a6-b605-72d1cf56aae4" containerName="istio-proxy"
Jul 20 18:45:37.927805 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.927787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:37.930670 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.930651    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k5j77\"/\"openshift-service-ca.crt\""
Jul 20 18:45:37.930775 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.930756    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k5j77\"/\"kube-root-ca.crt\""
Jul 20 18:45:37.931884 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.931866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k5j77\"/\"default-dockercfg-sk2sz\""
Jul 20 18:45:37.943211 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:37.943189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"]
Jul 20 18:45:38.071050 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.070999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd794\" (UniqueName: \"kubernetes.io/projected/145b0977-26c6-468e-bd51-70e6b458d0eb-kube-api-access-sd794\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.071050 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.071068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-proc\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.071576 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.071233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-lib-modules\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.071576 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.071281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-podres\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.071576 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.071385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-sys\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.171944 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.171880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-sys\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172140 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.171978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd794\" (UniqueName: \"kubernetes.io/projected/145b0977-26c6-468e-bd51-70e6b458d0eb-kube-api-access-sd794\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172140 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-proc\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172140 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-sys\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172140 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-lib-modules\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172140 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-podres\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172374 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-proc\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172374 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-lib-modules\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.172374 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.172268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/145b0977-26c6-468e-bd51-70e6b458d0eb-podres\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.182000 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.181942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd794\" (UniqueName: \"kubernetes.io/projected/145b0977-26c6-468e-bd51-70e6b458d0eb-kube-api-access-sd794\") pod \"perf-node-gather-daemonset-2wxlk\" (UID: \"145b0977-26c6-468e-bd51-70e6b458d0eb\") " pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.237614 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.237581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.372705 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.372678    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"]
Jul 20 18:45:38.375361 ip-10-0-138-227 kubenswrapper[2562]: W0720 18:45:38.375335    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod145b0977_26c6_468e_bd51_70e6b458d0eb.slice/crio-37303df80fc7fc0c8b9cc235e7e5056cc27f20b1cb72f498ea28bfb36c62c54b WatchSource:0}: Error finding container 37303df80fc7fc0c8b9cc235e7e5056cc27f20b1cb72f498ea28bfb36c62c54b: Status 404 returned error can't find the container with id 37303df80fc7fc0c8b9cc235e7e5056cc27f20b1cb72f498ea28bfb36c62c54b
Jul 20 18:45:38.517027 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.516999    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-kvdv5_1b98c485-ea08-4fe9-af14-3f6ae4316a6f/networking-console-plugin/0.log"
Jul 20 18:45:38.821683 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.821649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk" event={"ID":"145b0977-26c6-468e-bd51-70e6b458d0eb","Type":"ContainerStarted","Data":"a5332b91aab9faa7d2250a07a4801bf508dd333aa620fe0a2852afa090b89145"}
Jul 20 18:45:38.821887 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.821704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk" event={"ID":"145b0977-26c6-468e-bd51-70e6b458d0eb","Type":"ContainerStarted","Data":"37303df80fc7fc0c8b9cc235e7e5056cc27f20b1cb72f498ea28bfb36c62c54b"}
Jul 20 18:45:38.821887 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.821852    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:38.842395 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:38.842351    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk" podStartSLOduration=1.8423360770000001 podStartE2EDuration="1.842336077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:45:38.839668321 +0000 UTC m=+2968.205645919" watchObservedRunningTime="2026-07-20 18:45:38.842336077 +0000 UTC m=+2968.208313656"
Jul 20 18:45:39.653818 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:39.653788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-ttwzv_4b14387b-9ad5-40fc-aea0-a90ec1a6ea61/download-server/0.log"
Jul 20 18:45:41.527203 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:41.527173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xfhzz_52773415-b6f1-4a86-9bfa-d23c15838389/dns/0.log"
Jul 20 18:45:41.552858 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:41.552833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xfhzz_52773415-b6f1-4a86-9bfa-d23c15838389/kube-rbac-proxy/0.log"
Jul 20 18:45:41.583536 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:41.583509    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fh7nh_239fc666-92b4-4452-900b-482d4c7e2ba4/dns-node-resolver/0.log"
Jul 20 18:45:42.231961 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:42.231929    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nb5w_665c3b1c-31b8-4b1b-946f-04a54c4e2e4a/node-ca/0.log"
Jul 20 18:45:43.371203 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:43.371176    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b729_ca6fe371-f421-4be6-8d26-e02bc9ab1409/discovery/0.log"
Jul 20 18:45:43.622452 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:43.622368    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84b9f6bdc8-jsqhx_209f363a-7c84-4e3b-8c5a-b05d7237b8c2/router/0.log"
Jul 20 18:45:44.452798 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:44.452764    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jb7wt_9fa31b52-0023-490e-af0a-44e4ebda95ba/serve-healthcheck-canary/0.log"
Jul 20 18:45:44.836198 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:44.836165    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k5j77/perf-node-gather-daemonset-2wxlk"
Jul 20 18:45:45.001551 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:45.001523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckczl_4aa28908-caea-44c0-9e7f-fd1f56d5d0b3/kube-rbac-proxy/0.log"
Jul 20 18:45:45.046122 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:45.046095    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckczl_4aa28908-caea-44c0-9e7f-fd1f56d5d0b3/exporter/0.log"
Jul 20 18:45:45.072196 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:45.072163    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckczl_4aa28908-caea-44c0-9e7f-fd1f56d5d0b3/extractor/0.log"
Jul 20 18:45:48.326047 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:48.326016    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b729_ca6fe371-f421-4be6-8d26-e02bc9ab1409/discovery/0.log"
Jul 20 18:45:48.556266 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:48.556236    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84b9f6bdc8-jsqhx_209f363a-7c84-4e3b-8c5a-b05d7237b8c2/router/0.log"
Jul 20 18:45:48.778152 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:48.778120    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79747b4d4c-dx8nf_4b8111bb-6583-4b6c-b2de-547c9e93fc4c/manager/0.log"
Jul 20 18:45:48.809505 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:48.809425    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79747b4d4c-dx8nf_4b8111bb-6583-4b6c-b2de-547c9e93fc4c/copy-manifests/0.log"
Jul 20 18:45:49.946538 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:49.946448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b729_ca6fe371-f421-4be6-8d26-e02bc9ab1409/discovery/0.log"
Jul 20 18:45:50.186535 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:50.186503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57d4489cf8-n2mzz_fabeea22-9957-4211-a88d-d8be7d133d48/manager/0.log"
Jul 20 18:45:50.189866 ip-10-0-138-227 kubenswrapper[2562]: I0720 18:45:50.189847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84b9f6bdc8-jsqhx_209f363a-7c84-4e3b-8c5a-b05d7237b8c2/router/0.log"