Jul 21 16:21:52.962982 ip-10-0-136-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 16:21:52.962993 ip-10-0-136-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 16:21:52.963000 ip-10-0-136-117 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 16:21:52.963311 ip-10-0-136-117 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 16:22:03.212400 ip-10-0-136-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 16:22:03.212420 ip-10-0-136-117 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c67c37ebe08946ea80a166d80cf289c7 --
Jul 21 16:23:38.056226 ip-10-0-136-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 16:23:38.492254 ip-10-0-136-117 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:23:38.492254 ip-10-0-136-117 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 16:23:38.492254 ip-10-0-136-117 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:23:38.492254 ip-10-0-136-117 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 16:23:38.492254 ip-10-0-136-117 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:23:38.494306 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.494217    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 16:23:38.500777 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500762    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:38.500777 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500776    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500780    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500784    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500788    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500791    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500794    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500797    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500800    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500803    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500806    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500808    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500811    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500814    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500817    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500820    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500822    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500830    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500832    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500835    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500838    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:38.500841 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500840    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500843    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500846    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500849    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500851    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500854    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500857    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500860    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500869    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500873    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500875    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500878    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500880    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500893    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500896    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500899    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500902    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500904    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500907    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500911    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:38.501340 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500915    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500918    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500921    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500923    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500926    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500928    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500931    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500933    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500936    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500938    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500941    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500943    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500947    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500951    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500955    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500958    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500961    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500964    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500967    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:38.501831 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500969    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500972    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500974    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500977    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500979    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500981    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500984    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500987    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500989    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500992    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500994    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.500998    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501000    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501003    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501006    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501008    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501012    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501015    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501017    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501020    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:38.502383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501023    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501025    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501028    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501030    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501033    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501035    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501038    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501041    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501044    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501046    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501049    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501052    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501056    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501059    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501061    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501064    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501067    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501070    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501072    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:38.502856 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501762    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501768    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501771    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501774    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501776    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501780    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501782    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501785    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501788    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501791    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501793    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501796    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501799    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501801    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501804    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501806    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501809    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501812    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501815    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501818    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:38.503323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501821    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501823    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501826    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501829    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501832    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501834    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501837    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501840    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501842    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501845    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501847    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501850    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501853    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501855    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501858    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501861    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501865    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501868    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501871    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:38.503819 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501874    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501877    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501879    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501897    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501900    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501903    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501905    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501908    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501910    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501913    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501916    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501918    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501921    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501924    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501927    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501929    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501932    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501934    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501937    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501939    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:38.504290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501942    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501945    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501947    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501950    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501954    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501957    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501960    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501963    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501966    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501969    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501972    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501975    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501979    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501982    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501984    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501987    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501989    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501992    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501994    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:38.504779 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501996    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.501999    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502001    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502004    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502006    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502009    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502012    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502015    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502017    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502020    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502023    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502027    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502030    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502034    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502037    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502039    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502042    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502045    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502048    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:38.505267 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502051    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502053    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502423    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502428    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502431    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502434    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502437    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502440    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502442    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502445    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502447    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502450    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502453    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502455    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502458    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502462    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502465    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502468    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502471    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:38.505745 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502474    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502477    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502479    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502482    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502484    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502487    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502489    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502492    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502494    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502497    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502499    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502502    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502504    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502507    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502510    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502512    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502515    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502518    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502521    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502523    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:38.506224 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502526    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502529    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502531    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502534    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502536    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502539    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502541    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502544    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502546    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502548    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502551    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502554    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502557    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502559    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502562    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502564    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502567    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502571    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502574    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502578    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:38.506705 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502580    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502583    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502586    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502589    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502592    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502594    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502597    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502600    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502604    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502607    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502609    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502612    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502615    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502618    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502621    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502623    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502626    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502628    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502631    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:38.507261 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502634    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502637    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502640    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502643    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502646    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502650    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502653    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502656    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502658    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502661    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502663    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502666    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502668    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502670    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502673    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502675    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502682    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502684    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502687    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502690    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:38.507720 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502693    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502696    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.502698    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502765    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502772    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502779    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502784    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502788    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502792    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502796    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502800    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502803    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502806    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502809    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502813    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502817    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502820    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502823    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502826    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502829    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502833    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502837    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502840    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502843    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 16:23:38.508236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502846    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502849    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502853    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502856    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502861    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502864    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502868    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502871    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502874    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502877    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502880    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502898    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502902    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502905    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502908    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502911    2573 flags.go:64] FLAG: --enable-server="true"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502915    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502920    2573 flags.go:64] FLAG: --event-burst="100"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502923    2573 flags.go:64] FLAG: --event-qps="50"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502926    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502929    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502932    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502936    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502939    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502942    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 16:23:38.508815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502945    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502948    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502951    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502954    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502957    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502960    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502963    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502966    2573 flags.go:64] FLAG: --feature-gates=""
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502969    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502972    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502976    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502980    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502983    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502986    2573 flags.go:64] FLAG: --help="false"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502989    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502993    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502996    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.502998    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503002    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503005    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503008    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503012    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503015    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 16:23:38.509442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503018    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503021    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503025    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503028    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503030    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503034    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503037    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503040    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503043    2573 flags.go:64] FLAG: --lock-file=""
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503045    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503048    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503051    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503059    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503062    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503065    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503068    2573 flags.go:64] FLAG: --logging-format="text"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503070    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503074    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503077    2573 flags.go:64] FLAG: --manifest-url=""
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503080    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503085    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503088    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503092    2573 flags.go:64] FLAG: --max-pods="110"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503095    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503099    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 16:23:38.510054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503102    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503105    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503108    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503111    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503114    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503120    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503123    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503126    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503129    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503133    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503138    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503141    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503144    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503147    2573 flags.go:64] FLAG: --port="10250"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503151    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503153    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c58235323d416f5"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503157    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503159    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503162    2573 flags.go:64] FLAG: --register-node="true"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503170    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503173    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503176    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503179    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503182    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503186    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 16:23:38.510727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503189    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503192    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503195    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503199    2573 flags.go:64] FLAG: --runonce="false"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503202    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503205    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503208    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503211    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503214    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503217    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503220    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503223    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503226    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503229    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503232    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503234    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503237    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503241    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503244    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503249    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503252    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503254    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503258    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503261    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503264    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 16:23:38.511351 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503267    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503271    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503274    2573 flags.go:64] FLAG: --v="2"
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503282    2573 flags.go:64] FLAG: --version="false"
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503287    2573 flags.go:64] FLAG: --vmodule=""
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503291    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.503294    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503402    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503405    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503409    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503413    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503416    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503419    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503421    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503424    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503427    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503429    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503432    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503434    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503437    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503440    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503443    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:38.511984 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503445    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503448    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503452    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503457    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503461    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503464    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503467    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503470    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503473    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503476    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503480    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503484    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503487    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503490    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503493    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503496    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503499    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503501    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503504    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:38.512513 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503507    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503511    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503514    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503517    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503519    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503522    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503524    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503527    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503529    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503532    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503535    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503537    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503540    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503542    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503545    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503547    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503550    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503553    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503556    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:38.513018 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503559    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503561    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503564    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503566    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503569    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503573    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503575    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503578    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503580    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503583    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503585    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503588    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503591    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503593    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503597    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503600    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503602    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503605    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503607    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503610    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:38.513480 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503612    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503615    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503617    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503620    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503623    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503625    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503628    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503630    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503633    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503636    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503638    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503641    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503644    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503646    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503649    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503651    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503654    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503658    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503661    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503663    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:38.514205 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503666    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503668    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503671    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503673    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503676    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.503678    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.504574    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.511672    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.511687    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.512597    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.512606    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512662    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512667    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512670    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512674    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:38.514932 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512677    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512681    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512683    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512686    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512689    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512692    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512694    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512698    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512700    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512703    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512706    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512709    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512712    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512714    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512716    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512719    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512723    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512727    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512731    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:38.515325 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512734    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512738    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512741    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512744    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512748    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512751    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512755    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512758    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512761    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512764    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512766    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512769    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512772    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512775    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512777    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512780    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512782    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512785    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512787    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512790    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:38.515780 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512792    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512795    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512798    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512800    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512803    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512805    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512808    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512810    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512813    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512815    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512818    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512820    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512823    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512825    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512828    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512830    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512833    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512835    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512839    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512842    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:38.516313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512845    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512847    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512850    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512852    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512855    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512857    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512860    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512870    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512873    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512876    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512879    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512895    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512899    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512902    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512905    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512907    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512910    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512912    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512915    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:38.516842 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512918    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512920    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512923    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512925    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512928    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512930    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512933    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512935    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512938    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512941    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512943    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512946    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512949    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512952    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512956    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512958    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:38.517350 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.512961    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.512966    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513085    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513090    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513094    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513097    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513100    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513102    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513105    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513107    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513110    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513113    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513115    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513118    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513120    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:38.517738 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513123    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513125    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513128    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513130    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513133    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513136    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513138    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513142    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513146    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513149    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513152    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513154    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513157    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513160    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513163    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513166    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513168    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513171    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513173    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:38.518114 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513176    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513178    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513181    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513183    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513186    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513188    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513191    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513193    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513196    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513198    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513201    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513204    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513208    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513211    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513214    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513216    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513219    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513223    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513226    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:38.518576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513229    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513231    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513234    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513237    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513239    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513242    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513244    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513247    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513249    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513252    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513255    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513257    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513260    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513262    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513265    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513267    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513270    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513272    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513275    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:38.519150 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513277    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513279    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513282    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513284    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513287    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513290    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513292    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513295    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513298    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513301    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513303    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513306    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513309    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513311    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513314    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513317    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513320    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513322    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513325    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513327    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:38.519598 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513330    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513333    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513335    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513338    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513341    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513343    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513346    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513348    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:38.513350    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.513355    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.513477    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.516453    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.518115    2573 server.go:1019] "Starting client certificate rotation"
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.518212    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:23:38.520134 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.518238    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:23:38.521147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.521134    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:23:38.525294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.525277    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:23:38.536734 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.536718    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 21 16:23:38.539194 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.539176    2573 log.go:25] "Validated CRI v1 image API"
Jul 21 16:23:38.539926 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.539912    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 16:23:38.542485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.542463    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 84454dc0-acac-4bc6-ada2-319d565717c1:/dev/nvme0n1p3 9f837b58-a0c3-490b-bb7a-c348ae4b815d:/dev/nvme0n1p4]
Jul 21 16:23:38.542573 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.542484    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 16:23:38.547190 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.547175    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:23:38.547632 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.547527    2573 manager.go:216] Machine: {Timestamp:2026-07-21 16:23:38.54600369 +0000 UTC m=+0.362683125 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079303 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba1fd10b8406ab4c936edba7168bc SystemUUID:ec2ba1fd-10b8-406a-b4c9-36edba7168bc BootID:c67c37eb-e089-46ea-80a1-66d80cf289c7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:b7:44:44:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:b7:44:44:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:f2:9d:a1:9d:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 16:23:38.547632 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.547629    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 16:23:38.547718 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.547707    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 16:23:38.551428 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.551405    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 16:23:38.551559 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.551431    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 16:23:38.552264 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.552255    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 16:23:38.552299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.552266    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 16:23:38.552299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.552274    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:23:38.552299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.552286    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:23:38.554180 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.554170    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 16:23:38.558780 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558769    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:23:38.558907 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558898    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 16:23:38.558943 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558927    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 16:23:38.558943 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558941    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 16:23:38.558993 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558955    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 16:23:38.558993 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558964    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 21 16:23:38.558993 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.558973    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 16:23:38.559367 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.559354    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:23:38.559408 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.559373    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:23:38.563412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.563210    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 16:23:38.566197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.566181    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 16:23:38.566274 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.566211    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 16:23:38.567554 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567539    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 16:23:38.567554 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567557    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567564    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567569    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567577    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567584    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567595    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567603    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567612    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567620    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567631    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 16:23:38.567656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.567637    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 16:23:38.569328 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.569308    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 16:23:38.569406 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.569387    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 16:23:38.569438 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.569424    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 16:23:38.569438 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.569437    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 16:23:38.572456 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.572443    2573 server.go:1268] "Started kubelet"
Jul 21 16:23:38.572578 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.572525    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 16:23:38.572623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.572601    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 16:23:38.573272 ip-10-0-136-117 systemd[1]: Started Kubernetes Kubelet.
Jul 21 16:23:38.573474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.573266    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 16:23:38.574605 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.574588    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 16:23:38.575266 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.575254    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 16:23:38.577560 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.577541    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 16:23:38.579489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.579477    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 16:23:38.580658 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.579503    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-117.ec2.internal.18c45aa55a0c332d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-117.ec2.internal,UID:ip-10-0-136-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-117.ec2.internal,},FirstTimestamp:2026-07-21 16:23:38.572411693 +0000 UTC m=+0.389091126,LastTimestamp:2026-07-21 16:23:38.572411693 +0000 UTC m=+0.389091126,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-117.ec2.internal,}"
Jul 21 16:23:38.583966 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.583946    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 16:23:38.584079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.583952    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 16:23:38.584134 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.584103    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:38.584844 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584824    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 16:23:38.584959 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584854    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 16:23:38.584959 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584872    2573 factory.go:55] Registering systemd factory
Jul 21 16:23:38.584959 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584899    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 16:23:38.584959 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584921    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 21 16:23:38.584959 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584958    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 16:23:38.585179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.584970    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 16:23:38.585179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.585121    2573 factory.go:153] Registering CRI-O factory
Jul 21 16:23:38.585179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.585134    2573 factory.go:223] Registration of the crio container factory successfully
Jul 21 16:23:38.585309 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.585194    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 16:23:38.585309 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.585216    2573 factory.go:103] Registering Raw factory
Jul 21 16:23:38.585309 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.585227    2573 manager.go:1196] Started watching for new ooms in manager
Jul 21 16:23:38.585524 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.585509    2573 manager.go:349] Starting recovery of all containers
Jul 21 16:23:38.587145 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.587116    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 16:23:38.587258 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.587147    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 16:23:38.592858 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.592824    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 16:23:38.597261 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.597236    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lc8j6"
Jul 21 16:23:38.598249 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.598231    2573 manager.go:354] Recovery completed
Jul 21 16:23:38.601012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.600997    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lc8j6"
Jul 21 16:23:38.604326 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.604314    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.606423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606097    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.606423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606125    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.606423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606139    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.606652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606641    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.606686 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606642    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 16:23:38.606686 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606668    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 16:23:38.606686 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.606682    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:23:38.607283 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.607271    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.607334 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.607295    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.607334 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.607304    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.608195 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.608135    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-117.ec2.internal.18c45aa55c0e6242  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-117.ec2.internal,UID:ip-10-0-136-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-117.ec2.internal,},FirstTimestamp:2026-07-21 16:23:38.60610925 +0000 UTC m=+0.422788687,LastTimestamp:2026-07-21 16:23:38.60610925 +0000 UTC m=+0.422788687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-117.ec2.internal,}"
Jul 21 16:23:38.608688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.608678    2573 policy_none.go:49] "None policy: Start"
Jul 21 16:23:38.608720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.608693    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 16:23:38.608720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.608703    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 16:23:38.610715 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.610703    2573 policy_none.go:47] "Start"
Jul 21 16:23:38.649562 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649442    2573 manager.go:337] "Starting Device Plugin manager"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.649584    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649597    2573 server.go:87] "Starting device plugin registration server"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649786    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649795    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649880    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649968    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.649978    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.650483    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 16:23:38.669421 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.650537    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:38.692445 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.692419    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 16:23:38.692535 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.692457    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 16:23:38.692535 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.692478    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 16:23:38.692535 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.692507    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 16:23:38.694784 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.694767    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:38.750839 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.750759    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.752393 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.752371    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.752474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.752403    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.752474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.752415    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.752474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.752439    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.759089 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.759070    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.759171 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.759091    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-117.ec2.internal\": node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:38.789026 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.789011    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:38.793111 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.793091    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"]
Jul 21 16:23:38.793183 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.793163    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.793832 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.793813    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.793922 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.793842    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.793922 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.793855    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.796253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.796239    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.796352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.796338    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.796396 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.796368    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.797296 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.797274    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.797379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.797305    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.797379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.797316    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.797379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.797334    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.797379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.797344    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.797379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.797319    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.799665 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.799652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.799716 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.799675    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:38.800432 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.800419    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:38.800497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.800443    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:38.800497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.800459    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:38.814407 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.814390    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-117.ec2.internal\" not found" node="ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.817714 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.817697    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-117.ec2.internal\" not found" node="ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.886891 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.886868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1aebb5d7600211fff1b0f477746bc1ef-config\") pod \"kube-apiserver-proxy-ip-10-0-136-117.ec2.internal\" (UID: \"1aebb5d7600211fff1b0f477746bc1ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.886984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.886912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e61290001765e4592a72ddc939f835e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"3e61290001765e4592a72ddc939f835e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.886984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.886936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e61290001765e4592a72ddc939f835e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"3e61290001765e4592a72ddc939f835e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.889428 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.889409    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:38.988077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.988049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e61290001765e4592a72ddc939f835e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"3e61290001765e4592a72ddc939f835e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.988207 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.988080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e61290001765e4592a72ddc939f835e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"3e61290001765e4592a72ddc939f835e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.988207 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.988098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1aebb5d7600211fff1b0f477746bc1ef-config\") pod \"kube-apiserver-proxy-ip-10-0-136-117.ec2.internal\" (UID: \"1aebb5d7600211fff1b0f477746bc1ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.988207 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.988131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1aebb5d7600211fff1b0f477746bc1ef-config\") pod \"kube-apiserver-proxy-ip-10-0-136-117.ec2.internal\" (UID: \"1aebb5d7600211fff1b0f477746bc1ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.988207 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.988153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e61290001765e4592a72ddc939f835e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"3e61290001765e4592a72ddc939f835e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.988207 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:38.988152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e61290001765e4592a72ddc939f835e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"3e61290001765e4592a72ddc939f835e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:38.990147 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:38.990133    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.091008 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.090937    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.118117 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.118094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:39.121246 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.121233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:39.191104 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.191057    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.291599 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.291568    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.392206 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.392125    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.483988 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.483966    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:39.493071 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.493049    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.517225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.517195    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 16:23:39.517381 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.517353    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:23:39.517430 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.517403    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:23:39.593557 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.593532    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.606657 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.606628    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:18:39 +0000 UTC" deadline="2028-03-11 12:10:28.673270154 +0000 UTC"
Jul 21 16:23:39.606657 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.606652    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14371h46m49.066620813s"
Jul 21 16:23:39.667664 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:39.667631    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aebb5d7600211fff1b0f477746bc1ef.slice/crio-f4066df56d9593849d1767a21d931d472113b466af85355e699bf2eec6bf9587 WatchSource:0}: Error finding container f4066df56d9593849d1767a21d931d472113b466af85355e699bf2eec6bf9587: Status 404 returned error can't find the container with id f4066df56d9593849d1767a21d931d472113b466af85355e699bf2eec6bf9587
Jul 21 16:23:39.668016 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:39.667986    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e61290001765e4592a72ddc939f835e.slice/crio-38a8551324d46d1364e7ea576af1b79149f9c1348c0518a1655d874aca7b740d WatchSource:0}: Error finding container 38a8551324d46d1364e7ea576af1b79149f9c1348c0518a1655d874aca7b740d: Status 404 returned error can't find the container with id 38a8551324d46d1364e7ea576af1b79149f9c1348c0518a1655d874aca7b740d
Jul 21 16:23:39.674250 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.674232    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:23:39.694010 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.693983    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.695715 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.695676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" event={"ID":"3e61290001765e4592a72ddc939f835e","Type":"ContainerStarted","Data":"38a8551324d46d1364e7ea576af1b79149f9c1348c0518a1655d874aca7b740d"}
Jul 21 16:23:39.696692 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.696675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" event={"ID":"1aebb5d7600211fff1b0f477746bc1ef","Type":"ContainerStarted","Data":"f4066df56d9593849d1767a21d931d472113b466af85355e699bf2eec6bf9587"}
Jul 21 16:23:39.794263 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.794237    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.872804 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:39.872778    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:39.894778 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.894751    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:39.995282 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:39.995217    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:40.096049 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.096017    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found"
Jul 21 16:23:40.098829 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.098814    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:40.185220 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.185177    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:40.198075 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.198049    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:23:40.198981 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.198964    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"
Jul 21 16:23:40.209606 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.209578    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:23:40.559772 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.559734    2573 apiserver.go:52] "Watching apiserver"
Jul 21 16:23:40.574467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.574439    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 16:23:40.576243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.576212    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr","openshift-cluster-node-tuning-operator/tuned-bqsmc","openshift-dns/node-resolver-qmxdc","openshift-image-registry/node-ca-9lmkk","openshift-multus/multus-additional-cni-plugins-8nvmk","openshift-multus/multus-smsrp","openshift-multus/network-metrics-daemon-cp5xk","kube-system/global-pull-secret-syncer-t5vff","kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal","openshift-network-diagnostics/network-check-target-m288j","openshift-network-operator/iptables-alerter-gzdcj","openshift-ovn-kubernetes/ovnkube-node-v99m6","kube-system/konnectivity-agent-d2ttl"]
Jul 21 16:23:40.579467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.579087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:40.579467 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.579165    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:40.581645 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.581503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.584656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.584636    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n2228\""
Jul 21 16:23:40.584913 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.584880    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 16:23:40.584999 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.584911    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 16:23:40.585053 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.585030    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.585135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.585120    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 16:23:40.585189 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.585144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.585237 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.585209    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.585398 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.585380    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 16:23:40.585519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.585499    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 16:23:40.587174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.587153    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.587936 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.587918    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7tqsh\""
Jul 21 16:23:40.588391 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.588374    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.588624 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.588610    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.589384 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.589364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.589596 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.589581    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 16:23:40.589917 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.589878    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2lbc\""
Jul 21 16:23:40.590067 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.590045    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.590146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.590129    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.591988 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.591968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 16:23:40.592150 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.592121    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.592334 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.592315    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.592410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.592354    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 16:23:40.592467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.592439    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 16:23:40.592467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.592445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.592560 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.592359    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vtq4z\""
Jul 21 16:23:40.594817 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.594799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.595062 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.595041    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8hjnw\""
Jul 21 16:23:40.595383 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.595366    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 16:23:40.597027 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c6jl\" (UniqueName: \"kubernetes.io/projected/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-kube-api-access-6c6jl\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.597127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-systemd\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-cni-bin\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-cni-netd\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380a2811-539d-4a04-80db-bcd28c818aa0-tmp-dir\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.597299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-serviceca\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.597299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-kubelet\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-run-netns\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31ece8a9-2963-4317-8841-96b1c74e9b39-ovn-node-metrics-cert\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597315    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-log-socket\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/380a2811-539d-4a04-80db-bcd28c818aa0-hosts-file\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82t8\" (UniqueName: \"kubernetes.io/projected/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-kube-api-access-k82t8\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-var-lib-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-env-overrides\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfctx\" (UniqueName: \"kubernetes.io/projected/380a2811-539d-4a04-80db-bcd28c818aa0-kube-api-access-qfctx\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597512    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-systemd-units\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-run-ovn-kubernetes\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-ovnkube-script-lib\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.597617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmx2j\" (UniqueName: \"kubernetes.io/projected/31ece8a9-2963-4317-8841-96b1c74e9b39-kube-api-access-nmx2j\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-node-log\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-ovnkube-config\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-host\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-etc-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-ovn\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597776    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-slash\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.597989    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zhqk6\""
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.598004    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.598275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.598195    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:23:40.600170 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.600151    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.601453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.601437    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.601544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.601451    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 16:23:40.601759 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.601716    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbb5w\""
Jul 21 16:23:40.601987 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.601858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.603250 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.602711    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bwb8c\""
Jul 21 16:23:40.603250 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.602797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.603250 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.602846    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:40.603444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.603413    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.603733 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.603708    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.605733 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.605657    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:40.605733 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.605717    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:40.607679 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.607660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.610539 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.610522    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 16:23:40.610724 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.610703    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 16:23:40.611190 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.610587    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:23:40.611544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.611505    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-26twc\""
Jul 21 16:23:40.629598 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.629554    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6jhwh"
Jul 21 16:23:40.635356 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.635335    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6jhwh"
Jul 21 16:23:40.686511 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.686488    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 16:23:40.698438 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-host\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cg2h\" (UniqueName: \"kubernetes.io/projected/bf697387-c5fe-4888-bbc2-60146ae8f063-kube-api-access-8cg2h\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-host\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-dbus\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-multus-certs\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/958dba57-9f58-4dfc-af58-f4ce3923ccda-agent-certs\") pod \"konnectivity-agent-d2ttl\" (UID: \"958dba57-9f58-4dfc-af58-f4ce3923ccda\") " pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.698584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-ovn\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-slash\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cnibin\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-cnibin\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-slash\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698662    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-ovn\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-socket-dir-parent\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-daemon-config\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-modprobe-d\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-systemd\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-cni-bin\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380a2811-539d-4a04-80db-bcd28c818aa0-tmp-dir\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698829    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-systemd\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf697387-c5fe-4888-bbc2-60146ae8f063-iptables-alerter-script\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-system-cni-dir\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-cni-bin\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.698932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-hostroot\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-etc-selinux\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.698981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-kubernetes\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-os-release\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699058    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-netns\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-cni-multus\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/958dba57-9f58-4dfc-af58-f4ce3923ccda-konnectivity-ca\") pod \"konnectivity-agent-d2ttl\" (UID: \"958dba57-9f58-4dfc-af58-f4ce3923ccda\") " pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysctl-d\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/380a2811-539d-4a04-80db-bcd28c818aa0-hosts-file\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380a2811-539d-4a04-80db-bcd28c818aa0-tmp-dir\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysconfig\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysctl-conf\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699226    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/380a2811-539d-4a04-80db-bcd28c818aa0-hosts-file\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-var-lib-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-env-overrides\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-var-lib-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.699661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt828\" (UniqueName: \"kubernetes.io/projected/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-kube-api-access-gt828\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-tuned\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-run-ovn-kubernetes\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-run-ovn-kubernetes\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699437    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmx2j\" (UniqueName: \"kubernetes.io/projected/31ece8a9-2963-4317-8841-96b1c74e9b39-kube-api-access-nmx2j\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-kubelet-config\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-etc-kubernetes\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-sys-fs\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-node-log\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-run-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-ovnkube-config\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-os-release\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699738    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-env-overrides\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdln\" (UniqueName: \"kubernetes.io/projected/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-kube-api-access-7kdln\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.700474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-node-log\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-host\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-etc-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw4dl\" (UniqueName: \"kubernetes.io/projected/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-kube-api-access-bw4dl\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.699978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-system-cni-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-socket-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-run\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-var-lib-kubelet\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c6jl\" (UniqueName: \"kubernetes.io/projected/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-kube-api-access-6c6jl\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-cni-binary-copy\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-cni-netd\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-serviceca\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf697387-c5fe-4888-bbc2-60146ae8f063-host-slash\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-kubelet\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-run-netns\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31ece8a9-2963-4317-8841-96b1c74e9b39-ovn-node-metrics-cert\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-ovnkube-config\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-log-socket\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-cni-netd\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-cni-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-cni-bin\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700398    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-etc-openvswitch\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700513    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-registration-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-log-socket\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700590    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-run-netns\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.700609    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-kubelet\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-device-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.700690    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:41.200669626 +0000 UTC m=+3.017349057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700700    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-systemd\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.701848 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82t8\" (UniqueName: \"kubernetes.io/projected/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-kube-api-access-k82t8\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700795    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-serviceca\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfctx\" (UniqueName: \"kubernetes.io/projected/380a2811-539d-4a04-80db-bcd28c818aa0-kube-api-access-qfctx\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-k8s-cni-cncf-io\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-kubelet\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-conf-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-sys\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.700980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-lib-modules\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-systemd-units\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-ovnkube-script-lib\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701069    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-systemd-units\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b55b0786-376d-496a-b7d5-b3c5ffdfc859-tmp\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf97m\" (UniqueName: \"kubernetes.io/projected/b55b0786-376d-496a-b7d5-b3c5ffdfc859-kube-api-access-bf97m\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ece8a9-2963-4317-8841-96b1c74e9b39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.702680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.701966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31ece8a9-2963-4317-8841-96b1c74e9b39-ovnkube-script-lib\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.705714 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.705691    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31ece8a9-2963-4317-8841-96b1c74e9b39-ovn-node-metrics-cert\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.710025 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.709994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfctx\" (UniqueName: \"kubernetes.io/projected/380a2811-539d-4a04-80db-bcd28c818aa0-kube-api-access-qfctx\") pod \"node-resolver-qmxdc\" (UID: \"380a2811-539d-4a04-80db-bcd28c818aa0\") " pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.710327 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.710307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c6jl\" (UniqueName: \"kubernetes.io/projected/fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5-kube-api-access-6c6jl\") pod \"node-ca-9lmkk\" (UID: \"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5\") " pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.711476 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.711017    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmx2j\" (UniqueName: \"kubernetes.io/projected/31ece8a9-2963-4317-8841-96b1c74e9b39-kube-api-access-nmx2j\") pod \"ovnkube-node-v99m6\" (UID: \"31ece8a9-2963-4317-8841-96b1c74e9b39\") " pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.711476 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.711441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82t8\" (UniqueName: \"kubernetes.io/projected/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-kube-api-access-k82t8\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:40.801806 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.801753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cnibin\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.801806 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.801802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-cnibin\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802083 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.801829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-socket-dir-parent\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802083 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.801856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-daemon-config\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802083 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.801866    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cnibin\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.802083 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.801880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-modprobe-d\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-modprobe-d\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf697387-c5fe-4888-bbc2-60146ae8f063-iptables-alerter-script\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.802263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-socket-dir-parent\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802229    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-cnibin\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-system-cni-dir\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-hostroot\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-etc-selinux\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-system-cni-dir\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-kubernetes\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-os-release\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.802423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-hostroot\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-netns\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-etc-selinux\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-cni-multus\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-kubernetes\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/958dba57-9f58-4dfc-af58-f4ce3923ccda-konnectivity-ca\") pod \"konnectivity-agent-d2ttl\" (UID: \"958dba57-9f58-4dfc-af58-f4ce3923ccda\") " pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-netns\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysctl-d\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-cni-multus\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802545    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-os-release\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysconfig\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-daemon-config\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysctl-conf\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysconfig\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt828\" (UniqueName: \"kubernetes.io/projected/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-kube-api-access-gt828\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.802750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-tuned\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysctl-d\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-kubelet-config\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-sysctl-conf\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-etc-kubernetes\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf697387-c5fe-4888-bbc2-60146ae8f063-iptables-alerter-script\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802781    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-sys-fs\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802840    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-etc-kubernetes\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-kubelet-config\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802857    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-sys-fs\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-os-release\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdln\" (UniqueName: \"kubernetes.io/projected/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-kube-api-access-7kdln\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-host\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.802987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-os-release\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.803609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw4dl\" (UniqueName: \"kubernetes.io/projected/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-kube-api-access-bw4dl\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-host\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/958dba57-9f58-4dfc-af58-f4ce3923ccda-konnectivity-ca\") pod \"konnectivity-agent-d2ttl\" (UID: \"958dba57-9f58-4dfc-af58-f4ce3923ccda\") " pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803064    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-system-cni-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-socket-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-run\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-var-lib-kubelet\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803180    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-system-cni-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-cni-binary-copy\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-var-lib-kubelet\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-run\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-socket-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf697387-c5fe-4888-bbc2-60146ae8f063-host-slash\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-cni-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-cni-bin\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.804493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-registration-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf697387-c5fe-4888-bbc2-60146ae8f063-host-slash\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-device-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-systemd\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-cni-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803618    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-registration-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-cni-bin\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-device-dir\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-k8s-cni-cncf-io\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803700    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803713    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-cni-binary-copy\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-kubelet\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-conf-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.803764    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-sys\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-systemd\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.805240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-k8s-cni-cncf-io\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.803824    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:41.303805051 +0000 UTC m=+3.120484473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-lib-modules\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803820    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-var-lib-kubelet\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803865    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-sys\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-multus-conf-dir\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b55b0786-376d-496a-b7d5-b3c5ffdfc859-tmp\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf97m\" (UniqueName: \"kubernetes.io/projected/b55b0786-376d-496a-b7d5-b3c5ffdfc859-kube-api-access-bf97m\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cg2h\" (UniqueName: \"kubernetes.io/projected/bf697387-c5fe-4888-bbc2-60146ae8f063-kube-api-access-8cg2h\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b55b0786-376d-496a-b7d5-b3c5ffdfc859-lib-modules\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.803987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.804032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-dbus\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.804060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-multus-certs\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.804090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/958dba57-9f58-4dfc-af58-f4ce3923ccda-agent-certs\") pod \"konnectivity-agent-d2ttl\" (UID: \"958dba57-9f58-4dfc-af58-f4ce3923ccda\") " pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.804153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-dbus\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.804207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-host-run-multus-certs\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.806122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.805107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.806836 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.806244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b55b0786-376d-496a-b7d5-b3c5ffdfc859-etc-tuned\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.806952 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.806930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/958dba57-9f58-4dfc-af58-f4ce3923ccda-agent-certs\") pod \"konnectivity-agent-d2ttl\" (UID: \"958dba57-9f58-4dfc-af58-f4ce3923ccda\") " pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.807066 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.807042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b55b0786-376d-496a-b7d5-b3c5ffdfc859-tmp\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.811269 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.811203    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:40.811269 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.811231    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:40.811269 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.811261    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:40.811599 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:40.811322    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:41.311302945 +0000 UTC m=+3.127982384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:40.813838 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.813798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdln\" (UniqueName: \"kubernetes.io/projected/3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80-kube-api-access-7kdln\") pod \"aws-ebs-csi-driver-node-dppbr\" (UID: \"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.814259 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.814210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt828\" (UniqueName: \"kubernetes.io/projected/9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5-kube-api-access-gt828\") pod \"multus-smsrp\" (UID: \"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5\") " pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.814259 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.814241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf97m\" (UniqueName: \"kubernetes.io/projected/b55b0786-376d-496a-b7d5-b3c5ffdfc859-kube-api-access-bf97m\") pod \"tuned-bqsmc\" (UID: \"b55b0786-376d-496a-b7d5-b3c5ffdfc859\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.814510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.814488    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw4dl\" (UniqueName: \"kubernetes.io/projected/9c0e2256-a7e3-46a8-a75e-edb9ea61c89d-kube-api-access-bw4dl\") pod \"multus-additional-cni-plugins-8nvmk\" (UID: \"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d\") " pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.814553 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.814507    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cg2h\" (UniqueName: \"kubernetes.io/projected/bf697387-c5fe-4888-bbc2-60146ae8f063-kube-api-access-8cg2h\") pod \"iptables-alerter-gzdcj\" (UID: \"bf697387-c5fe-4888-bbc2-60146ae8f063\") " pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:40.895535 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.895504    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:23:40.903205 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.903179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qmxdc"
Jul 21 16:23:40.916976 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.916953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lmkk"
Jul 21 16:23:40.922768 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.922741    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nvmk"
Jul 21 16:23:40.928647 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.928625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-smsrp"
Jul 21 16:23:40.936505 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.936485    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:23:40.944339 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.944308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr"
Jul 21 16:23:40.952163 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.952144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqsmc"
Jul 21 16:23:40.959040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:40.959019    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gzdcj"
Jul 21 16:23:41.087367 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.087286    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:41.207409 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.207367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:41.207613 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.207499    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:41.207613 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.207563    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:42.207543652 +0000 UTC m=+4.024223090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:41.308504 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.308464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:41.308682 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.308654    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:41.308753 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.308740    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:42.30871777 +0000 UTC m=+4.125397207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:41.409870 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.409792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:41.410022 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.409979    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:41.410022 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.410002    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:41.410022 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.410013    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:41.410127 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.410071    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:42.410055511 +0000 UTC m=+4.226734934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:41.638398 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.638348    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:18:41 +0000 UTC" deadline="2028-03-30 21:16:59.161937584 +0000 UTC"
Jul 21 16:23:41.638398 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.638388    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14836h53m17.523554311s"
Jul 21 16:23:41.676179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.676095    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:41.693149 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:41.693118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:41.693299 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:41.693250    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:41.746133 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.746108    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958dba57_9f58_4dfc_af58_f4ce3923ccda.slice/crio-3e8359aee327a5e22b9abbd908d44980d3cd83ffcdbf66098cedadccd45c21d6 WatchSource:0}: Error finding container 3e8359aee327a5e22b9abbd908d44980d3cd83ffcdbf66098cedadccd45c21d6: Status 404 returned error can't find the container with id 3e8359aee327a5e22b9abbd908d44980d3cd83ffcdbf66098cedadccd45c21d6
Jul 21 16:23:41.747540 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.747516    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca8c040_f5b1_4c4d_9a97_02a5e53b0cc5.slice/crio-3f887c1df18e6cc394c84fdd7458467cc4cc6e48fcbcfeb218d9580366239f6b WatchSource:0}: Error finding container 3f887c1df18e6cc394c84fdd7458467cc4cc6e48fcbcfeb218d9580366239f6b: Status 404 returned error can't find the container with id 3f887c1df18e6cc394c84fdd7458467cc4cc6e48fcbcfeb218d9580366239f6b
Jul 21 16:23:41.748282 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.748235    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ece8a9_2963_4317_8841_96b1c74e9b39.slice/crio-f19cd64eb6a2d82552f2979b024264a7a400f97819228d68f6b4a7bf589feddf WatchSource:0}: Error finding container f19cd64eb6a2d82552f2979b024264a7a400f97819228d68f6b4a7bf589feddf: Status 404 returned error can't find the container with id f19cd64eb6a2d82552f2979b024264a7a400f97819228d68f6b4a7bf589feddf
Jul 21 16:23:41.749383 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.749354    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380a2811_539d_4a04_80db_bcd28c818aa0.slice/crio-929875e3834d8c7222bdd90e0e3c4f1b949e7baa1c60a5ed56052ad55f65d6d0 WatchSource:0}: Error finding container 929875e3834d8c7222bdd90e0e3c4f1b949e7baa1c60a5ed56052ad55f65d6d0: Status 404 returned error can't find the container with id 929875e3834d8c7222bdd90e0e3c4f1b949e7baa1c60a5ed56052ad55f65d6d0
Jul 21 16:23:41.749876 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.749853    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55b0786_376d_496a_b7d5_b3c5ffdfc859.slice/crio-0e66ae282fbf0c6cc67e0e5b08632133bec4973fec98835a12263081cf2199cf WatchSource:0}: Error finding container 0e66ae282fbf0c6cc67e0e5b08632133bec4973fec98835a12263081cf2199cf: Status 404 returned error can't find the container with id 0e66ae282fbf0c6cc67e0e5b08632133bec4973fec98835a12263081cf2199cf
Jul 21 16:23:41.774156 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.774129    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0e2256_a7e3_46a8_a75e_edb9ea61c89d.slice/crio-7de17af3006838a99a6f1c815f63059906ebeb17e5f492f35edb8dc4f5e34cb0 WatchSource:0}: Error finding container 7de17af3006838a99a6f1c815f63059906ebeb17e5f492f35edb8dc4f5e34cb0: Status 404 returned error can't find the container with id 7de17af3006838a99a6f1c815f63059906ebeb17e5f492f35edb8dc4f5e34cb0
Jul 21 16:23:41.775006 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.774977    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf697387_c5fe_4888_bbc2_60146ae8f063.slice/crio-116f77ac12392107b872e9a83721d02fadba4040114995396a37e05129a4f563 WatchSource:0}: Error finding container 116f77ac12392107b872e9a83721d02fadba4040114995396a37e05129a4f563: Status 404 returned error can't find the container with id 116f77ac12392107b872e9a83721d02fadba4040114995396a37e05129a4f563
Jul 21 16:23:41.776588 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.776563    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2a1fa7_b056_4bed_ba90_c7d728bcdaa5.slice/crio-e1b19c4010b9770ef2e70290539fab23ab3146d07ba33de712677d3f663b3ea4 WatchSource:0}: Error finding container e1b19c4010b9770ef2e70290539fab23ab3146d07ba33de712677d3f663b3ea4: Status 404 returned error can't find the container with id e1b19c4010b9770ef2e70290539fab23ab3146d07ba33de712677d3f663b3ea4
Jul 21 16:23:41.778469 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:23:41.778449    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8eaa69_ff1c_4c80_b1f1_8c81ba71aa80.slice/crio-d9697628b8355be8a5c52bae6d347a510f364f3a9126e2781c9074e9ab650c34 WatchSource:0}: Error finding container d9697628b8355be8a5c52bae6d347a510f364f3a9126e2781c9074e9ab650c34: Status 404 returned error can't find the container with id d9697628b8355be8a5c52bae6d347a510f364f3a9126e2781c9074e9ab650c34
Jul 21 16:23:42.216534 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.216284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:42.216534 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.216510    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:42.216791 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.216605    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:44.21658129 +0000 UTC m=+6.033260720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:42.318128 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.318011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:42.318290 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.318256    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:42.318364 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.318340    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:44.31831802 +0000 UTC m=+6.134997472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:42.419980 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.419310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:42.419980 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.419504    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:42.419980 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.419526    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:42.419980 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.419539    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:42.419980 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.419601    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:44.419580623 +0000 UTC m=+6.236260050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:42.639264 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.639134    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:18:41 +0000 UTC" deadline="2027-12-17 17:56:06.455982979 +0000 UTC"
Jul 21 16:23:42.639264 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.639201    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12337h32m23.816786084s"
Jul 21 16:23:42.698188 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.695126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:42.698188 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.695265    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:42.698188 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.698011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:42.698188 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:42.698126    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:42.720146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.720063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-smsrp" event={"ID":"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5","Type":"ContainerStarted","Data":"e1b19c4010b9770ef2e70290539fab23ab3146d07ba33de712677d3f663b3ea4"}
Jul 21 16:23:42.731688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.731587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gzdcj" event={"ID":"bf697387-c5fe-4888-bbc2-60146ae8f063","Type":"ContainerStarted","Data":"116f77ac12392107b872e9a83721d02fadba4040114995396a37e05129a4f563"}
Jul 21 16:23:42.743865 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.743828    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qmxdc" event={"ID":"380a2811-539d-4a04-80db-bcd28c818aa0","Type":"ContainerStarted","Data":"929875e3834d8c7222bdd90e0e3c4f1b949e7baa1c60a5ed56052ad55f65d6d0"}
Jul 21 16:23:42.747774 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.747631    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"f19cd64eb6a2d82552f2979b024264a7a400f97819228d68f6b4a7bf589feddf"}
Jul 21 16:23:42.753017 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.752933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2ttl" event={"ID":"958dba57-9f58-4dfc-af58-f4ce3923ccda","Type":"ContainerStarted","Data":"3e8359aee327a5e22b9abbd908d44980d3cd83ffcdbf66098cedadccd45c21d6"}
Jul 21 16:23:42.767574 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.766491    2573 generic.go:356] "Generic (PLEG): container finished" podID="3e61290001765e4592a72ddc939f835e" containerID="1dd4ef7a64515a21915d188043b1de1c22c074a14961625cbae381d214bcf1b7" exitCode=0
Jul 21 16:23:42.767574 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.766577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" event={"ID":"3e61290001765e4592a72ddc939f835e","Type":"ContainerDied","Data":"1dd4ef7a64515a21915d188043b1de1c22c074a14961625cbae381d214bcf1b7"}
Jul 21 16:23:42.774786 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.774761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" event={"ID":"1aebb5d7600211fff1b0f477746bc1ef","Type":"ContainerStarted","Data":"0fb3c78c7af4a4fbee5776d4f0904b08da3fe3f0cc0d36e9f2766b1b2b15ea97"}
Jul 21 16:23:42.789367 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.789310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerStarted","Data":"7de17af3006838a99a6f1c815f63059906ebeb17e5f492f35edb8dc4f5e34cb0"}
Jul 21 16:23:42.805006 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.804936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqsmc" event={"ID":"b55b0786-376d-496a-b7d5-b3c5ffdfc859","Type":"ContainerStarted","Data":"0e66ae282fbf0c6cc67e0e5b08632133bec4973fec98835a12263081cf2199cf"}
Jul 21 16:23:42.819981 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.819933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lmkk" event={"ID":"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5","Type":"ContainerStarted","Data":"3f887c1df18e6cc394c84fdd7458467cc4cc6e48fcbcfeb218d9580366239f6b"}
Jul 21 16:23:42.832424 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:42.832326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr" event={"ID":"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80","Type":"ContainerStarted","Data":"d9697628b8355be8a5c52bae6d347a510f364f3a9126e2781c9074e9ab650c34"}
Jul 21 16:23:43.693273 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:43.693233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:43.693781 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:43.693394    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:43.853053 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:43.853017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" event={"ID":"3e61290001765e4592a72ddc939f835e","Type":"ContainerStarted","Data":"67188b5ccb51156bf060a879cd9978614068b80966e5be79cf186a3bd41de381"}
Jul 21 16:23:43.870524 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:43.870224    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" podStartSLOduration=3.870203692 podStartE2EDuration="3.870203692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:23:42.804987651 +0000 UTC m=+4.621667100" watchObservedRunningTime="2026-07-21 16:23:43.870203692 +0000 UTC m=+5.686883140"
Jul 21 16:23:44.240262 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:44.239583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:44.240262 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.239784    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:44.240262 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.239849    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:48.239830469 +0000 UTC m=+10.056509912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:44.341521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:44.340894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:44.341521 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.341090    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:44.341521 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.341161    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:48.34113904 +0000 UTC m=+10.157818481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:44.442743 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:44.442053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:44.442743 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.442279    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:44.442743 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.442301    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:44.442743 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.442314    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:44.442743 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.442376    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:48.44235786 +0000 UTC m=+10.259037297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:44.695578 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:44.695490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:44.696067 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.695649    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:44.696137 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:44.696082    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:44.696219 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:44.696193    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:45.694039 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:45.693501    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:45.694039 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:45.693643    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:46.693549 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:46.693515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:46.694051 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:46.693672    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:46.694051 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:46.694020    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:46.694177 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:46.694147    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:47.693680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:47.693644    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:47.694285 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:47.693784    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:48.280029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:48.279989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:48.280196 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.280124    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:48.280196 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.280178    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:56.280164905 +0000 UTC m=+18.096844327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:48.380775 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:48.380719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:48.380976 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.380862    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:48.380976 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.380953    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:56.380918628 +0000 UTC m=+18.197598066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:48.481892 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:48.481779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:48.482104 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.481981    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:48.482104 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.482004    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:48.482104 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.482016    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:48.482104 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.482082    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:56.482064588 +0000 UTC m=+18.298744026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:48.694760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:48.694667    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:48.695211 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.694795    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:48.695272 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:48.695205    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:48.695323 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:48.695306    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:49.693615 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:49.693581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:49.693793 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:49.693728    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:50.692964 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:50.692933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:50.693429 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:50.693072    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:50.693429 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:50.693112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:50.693429 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:50.693235    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:51.693425 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:51.693384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:51.693950 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:51.693576    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:52.693042 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:52.692957    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:52.693197 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:52.693099    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:52.693197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:52.693183    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:52.693364 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:52.693338    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:53.692847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:53.692810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:53.693412 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:53.692980    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:54.693467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:54.693432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:54.693953 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:54.693562    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:54.693953 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:54.693432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:54.694121 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:54.694031    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:55.692789 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:55.692756    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:55.693014 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:55.692876    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:56.349708 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:56.349667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:56.350183 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.349840    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:56.350183 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.349938    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:12.349915015 +0000 UTC m=+34.166594435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:56.450016 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:56.449979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:56.450168 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.450110    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:56.450241 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.450174    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:12.450156598 +0000 UTC m=+34.266836024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:56.550488 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:56.550454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:56.550628 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.550570    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:56.550628 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.550585    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:56.550628 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.550593    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:56.550785 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.550639    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:12.550624847 +0000 UTC m=+34.367304268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:56.693214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:56.693126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:56.693214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:56.693134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:56.693445 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.693270    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:56.693445 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:56.693422    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:57.693132 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:57.693098    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:57.693573 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:57.693247    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:23:58.694065 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:58.694016    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:23:58.694532 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:58.694120    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:23:58.694532 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:58.694204    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:23:58.694532 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:58.694313    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:23:59.693683 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:23:59.693645    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:23:59.693866 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:23:59.693768    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:00.693672 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:00.693642    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:00.693672 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:00.693667    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:00.694307 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:00.693755    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:00.694307 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:00.693859    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:01.693735 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.693308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:01.694576 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:01.693779    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:01.905261 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.905222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr" event={"ID":"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80","Type":"ContainerStarted","Data":"cdeaf97f0c06cf41e30134e128c683fc3196a7e49da760f07f62750a5c24e4e7"}
Jul 21 16:24:01.906949 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.906916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-smsrp" event={"ID":"9c2a1fa7-b056-4bed-ba90-c7d728bcdaa5","Type":"ContainerStarted","Data":"ec3b5b58145731c5cb8a62ce1bce0283793993da6ffc474d7cf1f9f409f1856c"}
Jul 21 16:24:01.908622 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.908582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qmxdc" event={"ID":"380a2811-539d-4a04-80db-bcd28c818aa0","Type":"ContainerStarted","Data":"403a4f1eeb036e71a2bb8fca2c199d87fdef3e223d6579c802ac4988a92be1aa"}
Jul 21 16:24:01.912269 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.912242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"43a9568f595aaaf20d31ae93ba4f0fdabd5fd624711dcf17c593a754051e9bd2"}
Jul 21 16:24:01.912399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.912321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"7212e6e8b62a79d9ef96dac0ab764c5d80464dc7e831f648d387d1373c39a566"}
Jul 21 16:24:01.912399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.912375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"0c4f48ef7d97cb75a47ba0a1b5823ea1e1c6a5acec73de1e5d045b532fc382ac"}
Jul 21 16:24:01.912519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.912426    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"9c70d20f53ade559614918d285af6faca9b6475961840bf01dea3425f91fcc0a"}
Jul 21 16:24:01.912519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.912471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"7af9a83e5e4debc9f9dc44bc193ccd4992ec346ea090e805c1f7783d0efd5926"}
Jul 21 16:24:01.912519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.912516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"0599c743f93e59a61be382d46226e7efeca70f901171ff75a8156af84872eff6"}
Jul 21 16:24:01.913918 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.913865    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2ttl" event={"ID":"958dba57-9f58-4dfc-af58-f4ce3923ccda","Type":"ContainerStarted","Data":"0714088b2cbd4053d70493353134509085a7dfd4eee38b6c402a0e864fd23e08"}
Jul 21 16:24:01.915584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.915558    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c0e2256-a7e3-46a8-a75e-edb9ea61c89d" containerID="d4bf3fb5f36d3b23f116934af9016006ab51d4997f695159148be01f9588e460" exitCode=0
Jul 21 16:24:01.915691 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.915645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerDied","Data":"d4bf3fb5f36d3b23f116934af9016006ab51d4997f695159148be01f9588e460"}
Jul 21 16:24:01.918423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.918039    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqsmc" event={"ID":"b55b0786-376d-496a-b7d5-b3c5ffdfc859","Type":"ContainerStarted","Data":"9c5adfd4e95ed922971181a273b58b4f190838daa9346eaa9c148fcd6c7f42b7"}
Jul 21 16:24:01.920155 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.920132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lmkk" event={"ID":"fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5","Type":"ContainerStarted","Data":"0274f487fb27146509b82d6fc947ae053b789a62a577fdb53635207e099ce0c4"}
Jul 21 16:24:01.926572 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.926527    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-smsrp" podStartSLOduration=3.8968430720000002 podStartE2EDuration="22.926511835s" totalImagesPullingTime="19.029668763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:01.926439942 +0000 UTC m=+23.743119386" watchObservedRunningTime="2026-07-21 16:24:01.926511835 +0000 UTC m=+23.743191279"
Jul 21 16:24:01.926736 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.926716    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" podStartSLOduration=21.926709059 podStartE2EDuration="21.926709059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:23:43.870508728 +0000 UTC m=+5.687188177" watchObservedRunningTime="2026-07-21 16:24:01.926709059 +0000 UTC m=+23.743388525"
Jul 21 16:24:01.943694 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:01.943644    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9lmkk" podStartSLOduration=8.24586256 podStartE2EDuration="22.943633005s" totalImagesPullingTime="14.697770445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:01.943296853 +0000 UTC m=+23.759976296" watchObservedRunningTime="2026-07-21 16:24:01.943633005 +0000 UTC m=+23.760312448"
Jul 21 16:24:02.007087 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.006989    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qmxdc" podStartSLOduration=4.02571505 podStartE2EDuration="23.006971847s" totalImagesPullingTime="18.981256797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:01.98596158 +0000 UTC m=+23.802641022" watchObservedRunningTime="2026-07-21 16:24:02.006971847 +0000 UTC m=+23.823651321"
Jul 21 16:24:02.027365 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.027318    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d2ttl" podStartSLOduration=8.304592007 podStartE2EDuration="23.027299323s" totalImagesPullingTime="14.722707316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:02.006939749 +0000 UTC m=+23.823619191" watchObservedRunningTime="2026-07-21 16:24:02.027299323 +0000 UTC m=+23.843978768"
Jul 21 16:24:02.027510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.027458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bqsmc" podStartSLOduration=4.044001335 podStartE2EDuration="23.027452954s" totalImagesPullingTime="18.983451619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:02.027115982 +0000 UTC m=+23.843795424" watchObservedRunningTime="2026-07-21 16:24:02.027452954 +0000 UTC m=+23.844132397"
Jul 21 16:24:02.382672 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.382648    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 16:24:02.662755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.662578    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:24:02.382666052Z","UUID":"b3f8027a-6b7a-4439-ab23-d77e9816d36d","Handler":null,"Name":"","Endpoint":""}
Jul 21 16:24:02.663902 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.663864    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 16:24:02.664032 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.663925    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 16:24:02.693014 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.692983    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:02.693206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.692990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:02.693206 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:02.693103    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:02.693338 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:02.693198    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:02.924651 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.924565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr" event={"ID":"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80","Type":"ContainerStarted","Data":"878b4d2ab4c62a9e5cb617985b924781672ccc104a6e7498c69eb8feebf67039"}
Jul 21 16:24:02.926173 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.926130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gzdcj" event={"ID":"bf697387-c5fe-4888-bbc2-60146ae8f063","Type":"ContainerStarted","Data":"f1f5a2104c1554763f83114dfdbeeab2efd2af08ebea21977e99103673123c5e"}
Jul 21 16:24:02.948996 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:02.948947    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gzdcj" podStartSLOduration=5.024223591 podStartE2EDuration="23.948934274s" totalImagesPullingTime="18.924710683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:02.948547059 +0000 UTC m=+24.765226505" watchObservedRunningTime="2026-07-21 16:24:02.948934274 +0000 UTC m=+24.765613717"
Jul 21 16:24:03.477085 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.477055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:24:03.477854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.477828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:24:03.693459 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.693424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:03.693617 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:03.693559    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:03.931063 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.930970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr" event={"ID":"3c8eaa69-ff1c-4c80-b1f1-8c81ba71aa80","Type":"ContainerStarted","Data":"e0e881e57f141de1261f68e316b911887f1d4f15a2606a504032d08b427765fd"}
Jul 21 16:24:03.934741 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.934667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"0af82f476ab3a04cb1eef9a996d14751e22e4269e35d040f69d23deeb2de4bff"}
Jul 21 16:24:03.935127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.935099    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:24:03.935810 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.935788    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d2ttl"
Jul 21 16:24:03.950933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:03.950867    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dppbr" podStartSLOduration=3.635037518 podStartE2EDuration="24.950852572s" totalImagesPullingTime="21.315815054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:03.950826138 +0000 UTC m=+25.767505579" watchObservedRunningTime="2026-07-21 16:24:03.950852572 +0000 UTC m=+25.767532016"
Jul 21 16:24:04.693522 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:04.693487    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:04.693706 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:04.693492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:04.693706 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:04.693622    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:04.693706 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:04.693695    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:05.693465 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:05.693263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:05.693867 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:05.693567    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:06.693308 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:06.693273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:06.693479 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:06.693413    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:06.693479 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:06.693450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:06.693825 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:06.693528    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:07.692876 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.692623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:07.693031 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:07.692903    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:07.946097 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.946014    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c0e2256-a7e3-46a8-a75e-edb9ea61c89d" containerID="c641975d2836bbef7cf22f30e357d843c96dc294539b0f17744ae27b0af92ac9" exitCode=0
Jul 21 16:24:07.947007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.946099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerDied","Data":"c641975d2836bbef7cf22f30e357d843c96dc294539b0f17744ae27b0af92ac9"}
Jul 21 16:24:07.949362 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.949339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" event={"ID":"31ece8a9-2963-4317-8841-96b1c74e9b39","Type":"ContainerStarted","Data":"6994437e9343d569a8957c20932f86d1974a7aa0c98a494f451e2eeb6d8bf78a"}
Jul 21 16:24:07.949581 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.949560    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:24:07.949659 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.949625    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:24:07.949716 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.949676    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:24:07.964590 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.964566    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:24:07.964720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:07.964657    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:24:08.004960 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:08.004902    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6" podStartSLOduration=9.935415851 podStartE2EDuration="29.004864969s" totalImagesPullingTime="19.069449118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:08.004322984 +0000 UTC m=+29.821002429" watchObservedRunningTime="2026-07-21 16:24:08.004864969 +0000 UTC m=+29.821544414"
Jul 21 16:24:08.693511 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:08.693484    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:08.693797 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:08.693576    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:08.693797 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:08.693657    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:08.693797 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:08.693753    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:09.137610 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.137581    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cp5xk"]
Jul 21 16:24:09.137945 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.137709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:09.137945 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:09.137805    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:09.141600 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.141574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m288j"]
Jul 21 16:24:09.141720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.141677    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:09.141805 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:09.141781    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:09.142169 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.142145    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t5vff"]
Jul 21 16:24:09.142263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.142222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:09.142311 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:09.142292    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:09.955437 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.955408    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c0e2256-a7e3-46a8-a75e-edb9ea61c89d" containerID="fda58e641d83eb22c336e0fdc5f636b9d8abf816aa0ebd4ac2a9738b3a6f236d" exitCode=0
Jul 21 16:24:09.955598 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:09.955502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerDied","Data":"fda58e641d83eb22c336e0fdc5f636b9d8abf816aa0ebd4ac2a9738b3a6f236d"}
Jul 21 16:24:10.693067 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:10.692990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:10.693437 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:10.692996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:10.693437 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:10.693112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:10.693437 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:10.693112    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:10.693437 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:10.693196    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:10.693437 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:10.693269    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:11.962724 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:11.962473    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c0e2256-a7e3-46a8-a75e-edb9ea61c89d" containerID="d71a2cde1345e3d9b864a2d495d9702c3e547ddd0a45971686dbc57db3374934" exitCode=0
Jul 21 16:24:11.962724 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:11.962515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerDied","Data":"d71a2cde1345e3d9b864a2d495d9702c3e547ddd0a45971686dbc57db3374934"}
Jul 21 16:24:12.368514 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:12.368436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:12.368677 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.368593    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:24:12.368677 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.368671    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:44.368651549 +0000 UTC m=+66.185330985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:24:12.469082 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:12.469052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:12.469274 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.469198    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:24:12.469336 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.469280    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret podName:578cf7bc-822e-45e0-9a9e-5bcdeacd3e05 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:44.469258028 +0000 UTC m=+66.285937462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret") pod "global-pull-secret-syncer-t5vff" (UID: "578cf7bc-822e-45e0-9a9e-5bcdeacd3e05") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:24:12.570119 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:12.570090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:12.570299 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.570236    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:24:12.570299 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.570255    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:24:12.570299 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.570266    2573 projected.go:196] Error preparing data for projected volume kube-api-access-697gd for pod openshift-network-diagnostics/network-check-target-m288j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:24:12.570447 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.570321    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd podName:8eec3821-e993-4875-99ad-2fa234969133 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:44.570307881 +0000 UTC m=+66.386987306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-697gd" (UniqueName: "kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd") pod "network-check-target-m288j" (UID: "8eec3821-e993-4875-99ad-2fa234969133") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:24:12.693669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:12.693577    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:12.693669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:12.693634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:12.693669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:12.693651    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:12.693921 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.693746    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m288j" podUID="8eec3821-e993-4875-99ad-2fa234969133"
Jul 21 16:24:12.693921 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.693806    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:24:12.693921 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:12.693878    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t5vff" podUID="578cf7bc-822e-45e0-9a9e-5bcdeacd3e05"
Jul 21 16:24:13.459255 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.459221    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeReady"
Jul 21 16:24:13.459710 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.459369    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 16:24:13.494859 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.494789    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"]
Jul 21 16:24:13.497178 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.497157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:13.497899 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.497863    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77bb9c5c75-mvqkn"]
Jul 21 16:24:13.500001 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.499981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.500803 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.500782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 21 16:24:13.500912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.500782    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 21 16:24:13.500912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.500870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pwlmw\""
Jul 21 16:24:13.503235 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.503131    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 16:24:13.503339 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.503298    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 16:24:13.503486 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.503467    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kt5q5\""
Jul 21 16:24:13.503610 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.503486    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 16:24:13.508636 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.508618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 16:24:13.512287 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.512266    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"]
Jul 21 16:24:13.513164 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.512912    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-crz5z"]
Jul 21 16:24:13.516227 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.516207    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bb9c5c75-mvqkn"]
Jul 21 16:24:13.516315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.516303    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.519850 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.519830    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 16:24:13.520404 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.520383    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 16:24:13.520498 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.520384    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 16:24:13.520670 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.520647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4tvjl\""
Jul 21 16:24:13.525061 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.525043    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ld5xs"]
Jul 21 16:24:13.527523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.527500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.528436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.528417    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-crz5z"]
Jul 21 16:24:13.530301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.530284    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 16:24:13.530544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.530507    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 16:24:13.530544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.530540    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwsf5\""
Jul 21 16:24:13.537658 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.537637    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ld5xs"]
Jul 21 16:24:13.679158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-image-registry-private-configuration\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679355 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-certificates\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679355 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhd8b\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-kube-api-access-rhd8b\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679355 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fvtt\" (UniqueName: \"kubernetes.io/projected/62d8da46-8968-4210-be61-1918cdbe0d08-kube-api-access-5fvtt\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.679355 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:13.679355 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8375b1de-1c02-46e5-87e5-4ae126e409a7-cert\") pod \"ingress-canary-crz5z\" (UID: \"8375b1de-1c02-46e5-87e5-4ae126e409a7\") " pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.679355 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-installation-pull-secrets\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62d8da46-8968-4210-be61-1918cdbe0d08-config-volume\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.679652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d8da46-8968-4210-be61-1918cdbe0d08-tmp-dir\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.679652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-bound-sa-token\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-trusted-ca\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679919 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80546c4e-6dbd-4819-a320-7d3d6268f5f6-ca-trust-extracted\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.679919 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.679919 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39c670d6-4da9-4374-acb4-7499c8366821-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:13.679919 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.679737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bj5z\" (UniqueName: \"kubernetes.io/projected/8375b1de-1c02-46e5-87e5-4ae126e409a7-kube-api-access-2bj5z\") pod \"ingress-canary-crz5z\" (UID: \"8375b1de-1c02-46e5-87e5-4ae126e409a7\") " pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.780618 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-trusted-ca\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.780618 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780579    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80546c4e-6dbd-4819-a320-7d3d6268f5f6-ca-trust-extracted\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.780618 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.780618 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39c670d6-4da9-4374-acb4-7499c8366821-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bj5z\" (UniqueName: \"kubernetes.io/projected/8375b1de-1c02-46e5-87e5-4ae126e409a7-kube-api-access-2bj5z\") pod \"ingress-canary-crz5z\" (UID: \"8375b1de-1c02-46e5-87e5-4ae126e409a7\") " pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-image-registry-private-configuration\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-certificates\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhd8b\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-kube-api-access-rhd8b\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.780748    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fvtt\" (UniqueName: \"kubernetes.io/projected/62d8da46-8968-4210-be61-1918cdbe0d08-kube-api-access-5fvtt\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.780821    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:14.280800296 +0000 UTC m=+36.097479729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8375b1de-1c02-46e5-87e5-4ae126e409a7-cert\") pod \"ingress-canary-crz5z\" (UID: \"8375b1de-1c02-46e5-87e5-4ae126e409a7\") " pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.780951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-installation-pull-secrets\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.780972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62d8da46-8968-4210-be61-1918cdbe0d08-config-volume\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.780996    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.781001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.781025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d8da46-8968-4210-be61-1918cdbe0d08-tmp-dir\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.781037    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:14.281024983 +0000 UTC m=+36.097704404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.781043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80546c4e-6dbd-4819-a320-7d3d6268f5f6-ca-trust-extracted\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.781062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-bound-sa-token\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.781332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d8da46-8968-4210-be61-1918cdbe0d08-tmp-dir\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.781346    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:13.781414 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.781360    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:13.781803 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:13.781733    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:14.281387112 +0000 UTC m=+36.098066553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:13.781865 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.781825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62d8da46-8968-4210-be61-1918cdbe0d08-config-volume\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.782072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.782051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39c670d6-4da9-4374-acb4-7499c8366821-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:13.782298 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.782276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-certificates\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.782639 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.782615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-trusted-ca\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.786449 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.786233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-installation-pull-secrets\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.786449 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.786234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8375b1de-1c02-46e5-87e5-4ae126e409a7-cert\") pod \"ingress-canary-crz5z\" (UID: \"8375b1de-1c02-46e5-87e5-4ae126e409a7\") " pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.788323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.788296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-image-registry-private-configuration\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.790131 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.790106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-bound-sa-token\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.790651 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.790628    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhd8b\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-kube-api-access-rhd8b\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:13.791284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.791263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fvtt\" (UniqueName: \"kubernetes.io/projected/62d8da46-8968-4210-be61-1918cdbe0d08-kube-api-access-5fvtt\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:13.791353 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.791297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bj5z\" (UniqueName: \"kubernetes.io/projected/8375b1de-1c02-46e5-87e5-4ae126e409a7-kube-api-access-2bj5z\") pod \"ingress-canary-crz5z\" (UID: \"8375b1de-1c02-46e5-87e5-4ae126e409a7\") " pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.827543 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.827509    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-crz5z"
Jul 21 16:24:13.973786 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:13.973751    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-crz5z"]
Jul 21 16:24:13.977277 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:24:13.977252    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8375b1de_1c02_46e5_87e5_4ae126e409a7.slice/crio-c6fa3412220162700dda023530e7551c21d38376b693918efb95430bebd2d749 WatchSource:0}: Error finding container c6fa3412220162700dda023530e7551c21d38376b693918efb95430bebd2d749: Status 404 returned error can't find the container with id c6fa3412220162700dda023530e7551c21d38376b693918efb95430bebd2d749
Jul 21 16:24:14.284187 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.284152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.284240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.284277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284306    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284368    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284377    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.284357777 +0000 UTC m=+37.101037216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284380    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:14.284401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284399    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:14.284755 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284423    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.284413308 +0000 UTC m=+37.101092742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:14.284755 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:14.284462    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.284443946 +0000 UTC m=+37.101123387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:14.693504 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.693410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:14.694417 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.693500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:14.694417 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.693840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:14.702387 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.702361    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:24:14.702616 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.702593    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:24:14.702760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.702733    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:24:14.703653 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.703528    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:24:14.703653 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.703542    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwzzh\""
Jul 21 16:24:14.703653 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.703536    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwcv\""
Jul 21 16:24:14.971147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:14.971059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-crz5z" event={"ID":"8375b1de-1c02-46e5-87e5-4ae126e409a7","Type":"ContainerStarted","Data":"c6fa3412220162700dda023530e7551c21d38376b693918efb95430bebd2d749"}
Jul 21 16:24:15.293103 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:15.293019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:15.293298 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293196    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:15.293298 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:15.293212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:15.293298 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293255    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:17.293239531 +0000 UTC m=+39.109918955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:15.293298 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:15.293280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:15.293519 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293328    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:15.293519 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293377    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:15.293519 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293384    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:17.293365744 +0000 UTC m=+39.110045165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:15.293519 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293389    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:15.293519 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:15.293426    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:17.293415103 +0000 UTC m=+39.110094552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:16.757156 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:16.757112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:16.848334 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:16.848067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:16.911548 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:16.911508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:17.305537 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:17.305501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:17.305697 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:17.305546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:17.305697 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:17.305605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:17.305697 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305661    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:17.305863 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305714    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:17.305863 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305731    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:21.305710792 +0000 UTC m=+43.122390228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:17.305863 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305764    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:21.3057491 +0000 UTC m=+43.122428520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:17.305863 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305715    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:17.305863 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305783    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:17.305863 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:17.305815    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:21.305804574 +0000 UTC m=+43.122484010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:17.915074 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:17.915032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:17.977464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:17.977436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:18.988078 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:18.987991    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c0e2256-a7e3-46a8-a75e-edb9ea61c89d" containerID="7d1dae74a95b458bd26e150b168a42a4a05bb896ed9b09ecc0dba74c45f88002" exitCode=0
Jul 21 16:24:18.988078 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:18.988065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerDied","Data":"7d1dae74a95b458bd26e150b168a42a4a05bb896ed9b09ecc0dba74c45f88002"}
Jul 21 16:24:18.989555 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:18.989533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-crz5z" event={"ID":"8375b1de-1c02-46e5-87e5-4ae126e409a7","Type":"ContainerStarted","Data":"dca41f23209a9a8aab5cf2b9da3790ac830f715f51216b8b6495a3d8983234f6"}
Jul 21 16:24:19.027311 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:19.027265    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-crz5z" podStartSLOduration=2.124342005 podStartE2EDuration="6.027249465s" totalImagesPullingTime="3.90290746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:19.026701011 +0000 UTC m=+40.843380456" watchObservedRunningTime="2026-07-21 16:24:19.027249465 +0000 UTC m=+40.843929070"
Jul 21 16:24:19.954106 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:19.954073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:19.994077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:19.994050    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c0e2256-a7e3-46a8-a75e-edb9ea61c89d" containerID="ba94e1b9b6500302248ac59f9db5cf0c3c3464dfb763b8f5d572a6cdeae32ab7" exitCode=0
Jul 21 16:24:19.994447 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:19.994099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerDied","Data":"ba94e1b9b6500302248ac59f9db5cf0c3c3464dfb763b8f5d572a6cdeae32ab7"}
Jul 21 16:24:20.027639 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:20.027614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:20.776335 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:20.776299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:20.999772 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:20.999734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" event={"ID":"9c0e2256-a7e3-46a8-a75e-edb9ea61c89d","Type":"ContainerStarted","Data":"e3b84fb9dac96f2f651a144649cc812110842755c0d9f97a3e90b657ea60ebac"}
Jul 21 16:24:21.028933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:21.028831    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8nvmk" podStartSLOduration=9.803323926000001 podStartE2EDuration="42.028816014s" totalImagesPullingTime="32.225492088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:21.026746234 +0000 UTC m=+42.843425677" watchObservedRunningTime="2026-07-21 16:24:21.028816014 +0000 UTC m=+42.845495456"
Jul 21 16:24:21.166485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:21.166443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:21.230046 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:21.230016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:21.329513 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:21.329482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:21.329630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:21.329545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:21.329630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:21.329576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:21.329630 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329619    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:21.329735 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329632    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:21.329735 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329674    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:21.329735 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329679    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:29.329663958 +0000 UTC m=+51.146343380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:21.329735 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329684    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:21.329735 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329693    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:29.329686935 +0000 UTC m=+51.146366357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:21.329735 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:21.329718    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:29.329705011 +0000 UTC m=+51.146384453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:28.828994 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:28.828955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:28.929217 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:28.929173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:29.381963 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:29.381928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:29.381995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:29.382022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382044    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382102    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:45.382087405 +0000 UTC m=+67.198766829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382110    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382120    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:29.382164 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382143    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:29.382416 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382172    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:45.382155178 +0000 UTC m=+67.198834600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:29.382416 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:29.382197    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:45.382181588 +0000 UTC m=+67.198861009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:29.781797 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:29.781715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:29.840143 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:29.840109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:32.731733 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:32.731693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:39.969157 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:39.969129    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v99m6"
Jul 21 16:24:40.125337 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:40.125307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:40.188370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:40.188341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:40.913902 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:40.913860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:40.972416 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:40.972386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:44.386424 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.386386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:24:44.389667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.389646    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:24:44.397374 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:44.397346    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 16:24:44.397438 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:44.397415    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:48.397396844 +0000 UTC m=+130.214076266 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : secret "metrics-daemon-secret" not found
Jul 21 16:24:44.487707 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.487675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:44.490702 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.490687    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:24:44.500635 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.500608    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/578cf7bc-822e-45e0-9a9e-5bcdeacd3e05-original-pull-secret\") pod \"global-pull-secret-syncer-t5vff\" (UID: \"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05\") " pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:44.588800 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.588763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:44.591789 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.591770    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:24:44.602369 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.602352    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:24:44.613042 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.613015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-697gd\" (UniqueName: \"kubernetes.io/projected/8eec3821-e993-4875-99ad-2fa234969133-kube-api-access-697gd\") pod \"network-check-target-m288j\" (UID: \"8eec3821-e993-4875-99ad-2fa234969133\") " pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:44.708324 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.708239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t5vff"
Jul 21 16:24:44.727043 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.727017    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwcv\""
Jul 21 16:24:44.734565 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.734542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:44.843250 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.843218    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t5vff"]
Jul 21 16:24:44.846075 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:24:44.846044    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578cf7bc_822e_45e0_9a9e_5bcdeacd3e05.slice/crio-bc43614536ee54f659d78695f01ec06cae03c6b0efce0f2645496d9f72885f1d WatchSource:0}: Error finding container bc43614536ee54f659d78695f01ec06cae03c6b0efce0f2645496d9f72885f1d: Status 404 returned error can't find the container with id bc43614536ee54f659d78695f01ec06cae03c6b0efce0f2645496d9f72885f1d
Jul 21 16:24:44.860847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:44.860822    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m288j"]
Jul 21 16:24:44.863359 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:24:44.863337    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eec3821_e993_4875_99ad_2fa234969133.slice/crio-0c1a5080a19e73d2fb95fd87920783ff30fe121503b15657ba6bdf8b84c7e8c7 WatchSource:0}: Error finding container 0c1a5080a19e73d2fb95fd87920783ff30fe121503b15657ba6bdf8b84c7e8c7: Status 404 returned error can't find the container with id 0c1a5080a19e73d2fb95fd87920783ff30fe121503b15657ba6bdf8b84c7e8c7
Jul 21 16:24:45.053677 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.053647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m288j" event={"ID":"8eec3821-e993-4875-99ad-2fa234969133","Type":"ContainerStarted","Data":"0c1a5080a19e73d2fb95fd87920783ff30fe121503b15657ba6bdf8b84c7e8c7"}
Jul 21 16:24:45.054698 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.054678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t5vff" event={"ID":"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05","Type":"ContainerStarted","Data":"bc43614536ee54f659d78695f01ec06cae03c6b0efce0f2645496d9f72885f1d"}
Jul 21 16:24:45.395179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.395095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:24:45.395179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.395140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:24:45.395179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.395181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395253    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395291    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395311    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395323    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395326    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:17.395308075 +0000 UTC m=+99.211987516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395343    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:17.39533616 +0000 UTC m=+99.212015581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:45.395610 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:24:45.395372    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:17.395356143 +0000 UTC m=+99.212035592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:24:45.410329 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.410297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:45.511560 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.511487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:45.883349 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.883267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:45.983523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:45.983474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:46.602755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:46.602707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:46.665583 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:46.665533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:24:50.072814 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:50.072776    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m288j" event={"ID":"8eec3821-e993-4875-99ad-2fa234969133","Type":"ContainerStarted","Data":"4e770cdec4d7a51fd76690e4f83e457c94209ce6b74f5e3c8a9f1c7e10bdd3f3"}
Jul 21 16:24:50.073243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:50.072910    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:24:50.074171 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:50.074149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t5vff" event={"ID":"578cf7bc-822e-45e0-9a9e-5bcdeacd3e05","Type":"ContainerStarted","Data":"003b4ba573eddc77056e0632ed96d00b19106d33a42011716a0fdc021e790f48"}
Jul 21 16:24:50.088593 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:50.088555    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m288j" podStartSLOduration=66.417359548 podStartE2EDuration="1m11.088542648s" totalImagesPullingTime="4.6711831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:50.088306174 +0000 UTC m=+71.904985618" watchObservedRunningTime="2026-07-21 16:24:50.088542648 +0000 UTC m=+71.905222113"
Jul 21 16:24:50.103122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:24:50.103088    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t5vff" podStartSLOduration=66.409586875 podStartE2EDuration="1m11.103075188s" totalImagesPullingTime="4.693488313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:50.10300859 +0000 UTC m=+71.919688033" watchObservedRunningTime="2026-07-21 16:24:50.103075188 +0000 UTC m=+71.919754630"
Jul 21 16:25:07.840760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:07.840643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:07.902716 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:07.902679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:17.437633 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:17.437597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:25:17.437633 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:17.437635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:17.437668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437729    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437746    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437757    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437777    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437799    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:21.437784827 +0000 UTC m=+163.254464248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437831    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:21.43780977 +0000 UTC m=+163.254489202 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:17.438209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:17.437855    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:21.437845181 +0000 UTC m=+163.254524607 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:25:21.078995 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:21.078963    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m288j"
Jul 21 16:25:41.367202 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:41.367169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:41.422225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:41.422194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:48.456750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:25:48.456702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:25:48.457229 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:48.456849    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 16:25:48.457229 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:25:48.456929    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:50.456913433 +0000 UTC m=+252.273592855 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : secret "metrics-daemon-secret" not found
Jul 21 16:26:16.509771 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:16.509727    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs" podUID="39c670d6-4da9-4374-acb4-7499c8366821"
Jul 21 16:26:16.515982 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:16.515964    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6"
Jul 21 16:26:16.537323 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:16.537284    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ld5xs" podUID="62d8da46-8968-4210-be61-1918cdbe0d08"
Jul 21 16:26:17.278865 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:17.278838    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:26:17.279048 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:17.278839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:26:17.279048 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:17.278843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:26:17.716766 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:17.716714    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:26:21.488467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:21.488423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:26:21.488467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:21.488471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:21.488503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488584    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488594    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488611    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488625    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb9c5c75-mvqkn: secret "image-registry-tls" not found
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488636    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls podName:62d8da46-8968-4210-be61-1918cdbe0d08 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.488622662 +0000 UTC m=+285.305302083 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls") pod "dns-default-ld5xs" (UID: "62d8da46-8968-4210-be61-1918cdbe0d08") : secret "dns-default-metrics-tls" not found
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488664    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert podName:39c670d6-4da9-4374-acb4-7499c8366821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.488645711 +0000 UTC m=+285.305325151 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f5xrs" (UID: "39c670d6-4da9-4374-acb4-7499c8366821") : secret "networking-console-plugin-cert" not found
Jul 21 16:26:21.488984 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:26:21.488685    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls podName:80546c4e-6dbd-4819-a320-7d3d6268f5f6 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.488674026 +0000 UTC m=+285.305353447 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls") pod "image-registry-77bb9c5c75-mvqkn" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6") : secret "image-registry-tls" not found
Jul 21 16:26:32.693521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:26:32.693430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:27:23.989490 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:23.989459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:50.485102 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:50.485065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:27:50.485589 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:50.485176    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 16:27:50.485589 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:50.485240    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs podName:cb9a824b-a9ae-4e1a-bde8-421045bfebe2 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:52.485225257 +0000 UTC m=+374.301904678 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs") pod "network-metrics-daemon-cp5xk" (UID: "cb9a824b-a9ae-4e1a-bde8-421045bfebe2") : secret "metrics-daemon-secret" not found
Jul 21 16:27:51.808151 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.808120    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"]
Jul 21 16:27:51.810956 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.810940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"
Jul 21 16:27:51.814904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.814875    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2gtjh\""
Jul 21 16:27:51.816128 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.816111    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.816204 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.816141    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.823728 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.823703    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"]
Jul 21 16:27:51.826520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.826505    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-4zxkf"]
Jul 21 16:27:51.826640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.826624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.829544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.829527    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"]
Jul 21 16:27:51.829702 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.829659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.829842 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.829817    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 16:27:51.830435 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.830115    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 16:27:51.830435 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.830156    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.830435 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.830387    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mjxnn\""
Jul 21 16:27:51.830666 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.830650    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.832619 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.832599    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"]
Jul 21 16:27:51.832740 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.832697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:51.833539 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.833292    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 16:27:51.834040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.833941    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 16:27:51.834253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.834203    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.834553 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.834406    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.834712 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.834693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"]
Jul 21 16:27:51.835445 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.835419    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jx268\""
Jul 21 16:27:51.835688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.835668    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k69m5\""
Jul 21 16:27:51.835774 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.835759    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.837537 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.837513    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.838161 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.838143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 16:27:51.840749 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.840731    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 16:27:51.842741 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.842727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"]
Jul 21 16:27:51.846728 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.846709    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-4zxkf"]
Jul 21 16:27:51.894077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mww8x\" (UniqueName: \"kubernetes.io/projected/10af9cc1-6f96-4de9-9070-6e4b37928744-kube-api-access-mww8x\") pod \"volume-data-source-validator-78cf4c6f6-kkg88\" (UID: \"10af9cc1-6f96-4de9-9070-6e4b37928744\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"
Jul 21 16:27:51.894237 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-trusted-ca\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.894237 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdpw\" (UniqueName: \"kubernetes.io/projected/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-kube-api-access-tkdpw\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.894237 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxcgk\" (UniqueName: \"kubernetes.io/projected/a263039b-51ed-4fdc-983f-badb7f77fcbd-kube-api-access-hxcgk\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.894237 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a263039b-51ed-4fdc-983f-badb7f77fcbd-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.894457 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hllmv\" (UniqueName: \"kubernetes.io/projected/f7879988-66f9-4b2b-9ce1-a58f17f3279c-kube-api-access-hllmv\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:51.894457 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-config\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.894457 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-serving-cert\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.894457 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a263039b-51ed-4fdc-983f-badb7f77fcbd-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.894457 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.894414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:51.905684 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.905659    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"]
Jul 21 16:27:51.908760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.908529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"
Jul 21 16:27:51.909797 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.909775    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-8d44g"]
Jul 21 16:27:51.912104 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.912083    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4lqtj\""
Jul 21 16:27:51.912668 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.912651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59f856cfbd-lm9zd"]
Jul 21 16:27:51.912765 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.912752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.916724 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.916702    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:51.916820 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.916790    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.917085 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.917066    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 16:27:51.917533 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.917516    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 16:27:51.917975 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.917945    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.918167 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.918149    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-75bp2\""
Jul 21 16:27:51.922513 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.922495    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.922913 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.922898    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lspp2\""
Jul 21 16:27:51.923075 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.923059    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 16:27:51.923075 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.923072    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 16:27:51.923313 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.923299    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 16:27:51.923389 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.923377    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.923676 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.923663    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 16:27:51.926648 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.926630    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 16:27:51.927833 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.927815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-8d44g"]
Jul 21 16:27:51.933519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.933495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59f856cfbd-lm9zd"]
Jul 21 16:27:51.934459 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.934440    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"]
Jul 21 16:27:51.995155 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84578956-b209-46c3-a514-bb177be7c4d5-serving-cert\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.995312 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:51.995312 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdpw\" (UniqueName: \"kubernetes.io/projected/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-kube-api-access-tkdpw\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.995312 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84578956-b209-46c3-a514-bb177be7c4d5-tmp\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.995473 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:51.995323    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:27:51.995473 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84578956-b209-46c3-a514-bb177be7c4d5-snapshots\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.995473 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:51.995452    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls podName:f7879988-66f9-4b2b-9ce1-a58f17f3279c nodeName:}" failed. No retries permitted until 2026-07-21 16:27:52.495429531 +0000 UTC m=+254.312108953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zn8mz" (UID: "f7879988-66f9-4b2b-9ce1-a58f17f3279c") : secret "samples-operator-tls" not found
Jul 21 16:27:51.995630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mfq\" (UniqueName: \"kubernetes.io/projected/84578956-b209-46c3-a514-bb177be7c4d5-kube-api-access-q4mfq\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.995630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mww8x\" (UniqueName: \"kubernetes.io/projected/10af9cc1-6f96-4de9-9070-6e4b37928744-kube-api-access-mww8x\") pod \"volume-data-source-validator-78cf4c6f6-kkg88\" (UID: \"10af9cc1-6f96-4de9-9070-6e4b37928744\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"
Jul 21 16:27:51.995630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-trusted-ca\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.995630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxcgk\" (UniqueName: \"kubernetes.io/projected/a263039b-51ed-4fdc-983f-badb7f77fcbd-kube-api-access-hxcgk\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.995630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:51.995854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84578956-b209-46c3-a514-bb177be7c4d5-service-ca-bundle\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.995854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-default-certificate\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:51.995854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lssbj\" (UniqueName: \"kubernetes.io/projected/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-kube-api-access-lssbj\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:51.995854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a263039b-51ed-4fdc-983f-badb7f77fcbd-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.995854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hllmv\" (UniqueName: \"kubernetes.io/projected/f7879988-66f9-4b2b-9ce1-a58f17f3279c-kube-api-access-hllmv\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:51.996113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84578956-b209-46c3-a514-bb177be7c4d5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:51.996113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.995978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-config\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.996113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:51.996113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-stats-auth\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:51.996113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-serving-cert\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.996337 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a263039b-51ed-4fdc-983f-badb7f77fcbd-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.996337 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88qz\" (UniqueName: \"kubernetes.io/projected/f85ff27b-1e00-4518-9db8-05835b9d3cea-kube-api-access-p88qz\") pod \"network-check-source-7bc5b6bf85-sw2c5\" (UID: \"f85ff27b-1e00-4518-9db8-05835b9d3cea\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"
Jul 21 16:27:51.996498 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-trusted-ca\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.996630 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996608    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-config\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:51.996691 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.996679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a263039b-51ed-4fdc-983f-badb7f77fcbd-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.998045 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.998023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a263039b-51ed-4fdc-983f-badb7f77fcbd-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:51.998233 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:51.998215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-serving-cert\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:52.005509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.005481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hllmv\" (UniqueName: \"kubernetes.io/projected/f7879988-66f9-4b2b-9ce1-a58f17f3279c-kube-api-access-hllmv\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:52.005590 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.005566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxcgk\" (UniqueName: \"kubernetes.io/projected/a263039b-51ed-4fdc-983f-badb7f77fcbd-kube-api-access-hxcgk\") pod \"kube-storage-version-migrator-operator-7658d9b749-kg7kc\" (UID: \"a263039b-51ed-4fdc-983f-badb7f77fcbd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:52.005738 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.005723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdpw\" (UniqueName: \"kubernetes.io/projected/128d24cd-aa73-42c4-9e55-e86f5cdcfe9f-kube-api-access-tkdpw\") pod \"console-operator-565b7b569d-4zxkf\" (UID: \"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f\") " pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:52.005984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.005964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mww8x\" (UniqueName: \"kubernetes.io/projected/10af9cc1-6f96-4de9-9070-6e4b37928744-kube-api-access-mww8x\") pod \"volume-data-source-validator-78cf4c6f6-kkg88\" (UID: \"10af9cc1-6f96-4de9-9070-6e4b37928744\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"
Jul 21 16:27:52.081283 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.081213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:52.097264 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mfq\" (UniqueName: \"kubernetes.io/projected/84578956-b209-46c3-a514-bb177be7c4d5-kube-api-access-q4mfq\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.097386 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.097386 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84578956-b209-46c3-a514-bb177be7c4d5-service-ca-bundle\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.097386 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-default-certificate\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.097386 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lssbj\" (UniqueName: \"kubernetes.io/projected/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-kube-api-access-lssbj\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.097384    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84578956-b209-46c3-a514-bb177be7c4d5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.097441    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:52.597423813 +0000 UTC m=+254.414103240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : secret "router-metrics-certs-default" not found
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-stats-auth\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p88qz\" (UniqueName: \"kubernetes.io/projected/f85ff27b-1e00-4518-9db8-05835b9d3cea-kube-api-access-p88qz\") pod \"network-check-source-7bc5b6bf85-sw2c5\" (UID: \"f85ff27b-1e00-4518-9db8-05835b9d3cea\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"
Jul 21 16:27:52.097580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84578956-b209-46c3-a514-bb177be7c4d5-serving-cert\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.097940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84578956-b209-46c3-a514-bb177be7c4d5-tmp\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.097940 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.097638    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:52.597623126 +0000 UTC m=+254.414302562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : configmap references non-existent config key: service-ca.crt
Jul 21 16:27:52.097940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.097657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84578956-b209-46c3-a514-bb177be7c4d5-snapshots\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.098102 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.098045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84578956-b209-46c3-a514-bb177be7c4d5-service-ca-bundle\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.098102 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.098041    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84578956-b209-46c3-a514-bb177be7c4d5-tmp\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.098283 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.098265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84578956-b209-46c3-a514-bb177be7c4d5-snapshots\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.098479 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.098456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84578956-b209-46c3-a514-bb177be7c4d5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.099953 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.099928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-default-certificate\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.099953 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.099952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-stats-auth\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.100072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.099973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84578956-b209-46c3-a514-bb177be7c4d5-serving-cert\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.108399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.108378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88qz\" (UniqueName: \"kubernetes.io/projected/f85ff27b-1e00-4518-9db8-05835b9d3cea-kube-api-access-p88qz\") pod \"network-check-source-7bc5b6bf85-sw2c5\" (UID: \"f85ff27b-1e00-4518-9db8-05835b9d3cea\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"
Jul 21 16:27:52.108504 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.108452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lssbj\" (UniqueName: \"kubernetes.io/projected/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-kube-api-access-lssbj\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.108681 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.108663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mfq\" (UniqueName: \"kubernetes.io/projected/84578956-b209-46c3-a514-bb177be7c4d5-kube-api-access-q4mfq\") pod \"insights-operator-555d9d7885-8d44g\" (UID: \"84578956-b209-46c3-a514-bb177be7c4d5\") " pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.119738 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.119722    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"
Jul 21 16:27:52.138933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.138913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"
Jul 21 16:27:52.145825 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.145807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:27:52.184218 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.184151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:52.221931 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.221900    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"
Jul 21 16:27:52.229637 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.229607    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-8d44g"
Jul 21 16:27:52.266933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.266873    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88"]
Jul 21 16:27:52.274470 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:27:52.274403    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10af9cc1_6f96_4de9_9070_6e4b37928744.slice/crio-562a24a51a7c6822a71a19fc8d773992ff6b0d867cea92a0c01dcf55ec7ceae3 WatchSource:0}: Error finding container 562a24a51a7c6822a71a19fc8d773992ff6b0d867cea92a0c01dcf55ec7ceae3: Status 404 returned error can't find the container with id 562a24a51a7c6822a71a19fc8d773992ff6b0d867cea92a0c01dcf55ec7ceae3
Jul 21 16:27:52.298736 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.298678    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc"]
Jul 21 16:27:52.317039 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.317016    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-4zxkf"]
Jul 21 16:27:52.320440 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:27:52.320409    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128d24cd_aa73_42c4_9e55_e86f5cdcfe9f.slice/crio-5c90523aab3dc49de7ef8bb98e8b86dc9b6b5587888a10b7ef7e0f63c991f311 WatchSource:0}: Error finding container 5c90523aab3dc49de7ef8bb98e8b86dc9b6b5587888a10b7ef7e0f63c991f311: Status 404 returned error can't find the container with id 5c90523aab3dc49de7ef8bb98e8b86dc9b6b5587888a10b7ef7e0f63c991f311
Jul 21 16:27:52.368225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.368198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5"]
Jul 21 16:27:52.373032 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:27:52.373000    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85ff27b_1e00_4518_9db8_05835b9d3cea.slice/crio-4f60a27bcbbca0609366c86284576a136453c6fa7212a074ce59edaed4fbb4c3 WatchSource:0}: Error finding container 4f60a27bcbbca0609366c86284576a136453c6fa7212a074ce59edaed4fbb4c3: Status 404 returned error can't find the container with id 4f60a27bcbbca0609366c86284576a136453c6fa7212a074ce59edaed4fbb4c3
Jul 21 16:27:52.386730 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.386705    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-8d44g"]
Jul 21 16:27:52.389159 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:27:52.389137    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84578956_b209_46c3_a514_bb177be7c4d5.slice/crio-8c276bab94e7df4342b10c803708728600d9336447fa81aa791603cc369ec538 WatchSource:0}: Error finding container 8c276bab94e7df4342b10c803708728600d9336447fa81aa791603cc369ec538: Status 404 returned error can't find the container with id 8c276bab94e7df4342b10c803708728600d9336447fa81aa791603cc369ec538
Jul 21 16:27:52.500621 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.500587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:52.500850 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.500708    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:27:52.500850 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.500769    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls podName:f7879988-66f9-4b2b-9ce1-a58f17f3279c nodeName:}" failed. No retries permitted until 2026-07-21 16:27:53.500750069 +0000 UTC m=+255.317429493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zn8mz" (UID: "f7879988-66f9-4b2b-9ce1-a58f17f3279c") : secret "samples-operator-tls" not found
Jul 21 16:27:52.501506 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.501486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" event={"ID":"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f","Type":"ContainerStarted","Data":"5c90523aab3dc49de7ef8bb98e8b86dc9b6b5587888a10b7ef7e0f63c991f311"}
Jul 21 16:27:52.502577 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.502557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc" event={"ID":"a263039b-51ed-4fdc-983f-badb7f77fcbd","Type":"ContainerStarted","Data":"cbbb3155bd87abb91a95ff0b3409ca21b8c75df98c70313d164a498f0daf2e00"}
Jul 21 16:27:52.503933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.503915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5" event={"ID":"f85ff27b-1e00-4518-9db8-05835b9d3cea","Type":"ContainerStarted","Data":"8eef95fd968ceb0093a847f9fee3217bf0181a4317d2c1b2b1c7001b8f95d505"}
Jul 21 16:27:52.504039 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.503951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5" event={"ID":"f85ff27b-1e00-4518-9db8-05835b9d3cea","Type":"ContainerStarted","Data":"4f60a27bcbbca0609366c86284576a136453c6fa7212a074ce59edaed4fbb4c3"}
Jul 21 16:27:52.504979 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.504959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-8d44g" event={"ID":"84578956-b209-46c3-a514-bb177be7c4d5","Type":"ContainerStarted","Data":"8c276bab94e7df4342b10c803708728600d9336447fa81aa791603cc369ec538"}
Jul 21 16:27:52.505939 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.505918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88" event={"ID":"10af9cc1-6f96-4de9-9070-6e4b37928744","Type":"ContainerStarted","Data":"562a24a51a7c6822a71a19fc8d773992ff6b0d867cea92a0c01dcf55ec7ceae3"}
Jul 21 16:27:52.521458 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.521421    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-sw2c5" podStartSLOduration=1.521408544 podStartE2EDuration="1.521408544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:52.520562414 +0000 UTC m=+254.337241857" watchObservedRunningTime="2026-07-21 16:27:52.521408544 +0000 UTC m=+254.338087986"
Jul 21 16:27:52.601970 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.601903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.602066 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:52.601967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:52.602066 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.602018    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:27:52.602134 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.602083    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:53.6020678 +0000 UTC m=+255.418747236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : secret "router-metrics-certs-default" not found
Jul 21 16:27:52.602134 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:52.602100    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:53.602091891 +0000 UTC m=+255.418771312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : configmap references non-existent config key: service-ca.crt
Jul 21 16:27:53.511824 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:53.511631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:53.511824 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:53.511788    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:27:53.512371 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:53.511849    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls podName:f7879988-66f9-4b2b-9ce1-a58f17f3279c nodeName:}" failed. No retries permitted until 2026-07-21 16:27:55.511831782 +0000 UTC m=+257.328511207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zn8mz" (UID: "f7879988-66f9-4b2b-9ce1-a58f17f3279c") : secret "samples-operator-tls" not found
Jul 21 16:27:53.612826 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:53.612797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:53.612954 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:53.612864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:53.613401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:53.613305    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:27:53.613401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:53.613369    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:55.613350108 +0000 UTC m=+257.430029542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : secret "router-metrics-certs-default" not found
Jul 21 16:27:53.613564 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:53.613406    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:55.613387281 +0000 UTC m=+257.430066715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : configmap references non-existent config key: service-ca.crt
Jul 21 16:27:54.516486 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:54.516452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88" event={"ID":"10af9cc1-6f96-4de9-9070-6e4b37928744","Type":"ContainerStarted","Data":"d882bfe8953eff576efa6573f04de00041c9e0557d08b20b26fabfadd392f9ff"}
Jul 21 16:27:54.533928 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:54.533862    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkg88" podStartSLOduration=2.201585725 podStartE2EDuration="3.533848779s" totalImagesPullingTime="1.332263054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:54.533536697 +0000 UTC m=+256.350216141" watchObservedRunningTime="2026-07-21 16:27:54.533848779 +0000 UTC m=+256.350528222"
Jul 21 16:27:54.613556 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:54.613525    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:54.673315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:54.673275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:55.294509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:55.294473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:55.530439 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:55.529907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:55.530439 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:55.530072    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:27:55.530439 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:55.530128    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls podName:f7879988-66f9-4b2b-9ce1-a58f17f3279c nodeName:}" failed. No retries permitted until 2026-07-21 16:27:59.530110791 +0000 UTC m=+261.346790229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zn8mz" (UID: "f7879988-66f9-4b2b-9ce1-a58f17f3279c") : secret "samples-operator-tls" not found
Jul 21 16:27:55.631285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:55.631248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:55.631486 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:55.631304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:55.631486 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:55.631437    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:59.631423539 +0000 UTC m=+261.448102961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : configmap references non-existent config key: service-ca.crt
Jul 21 16:27:55.631793 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:55.631713    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:27:55.631793 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:55.631771    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:59.631753954 +0000 UTC m=+261.448433389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : secret "router-metrics-certs-default" not found
Jul 21 16:27:55.758210 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:55.758176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:55.860372 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:55.860304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:56.001181 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.001149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:56.100668 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.100637    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:56.523284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.523247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-8d44g" event={"ID":"84578956-b209-46c3-a514-bb177be7c4d5","Type":"ContainerStarted","Data":"ed1084da533f3e6e96842d19e6f40b0a4bc1a4369bde17fe4e75892081498b07"}
Jul 21 16:27:56.525128 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.525103    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/0.log"
Jul 21 16:27:56.525262 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.525144    2573 generic.go:356] "Generic (PLEG): container finished" podID="128d24cd-aa73-42c4-9e55-e86f5cdcfe9f" containerID="fb4ad18d3192dce94e89dca5b69f8dc9e8bf47bfd4a0ed3d885568c84d9a6c1a" exitCode=255
Jul 21 16:27:56.525406 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.525352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" event={"ID":"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f","Type":"ContainerDied","Data":"fb4ad18d3192dce94e89dca5b69f8dc9e8bf47bfd4a0ed3d885568c84d9a6c1a"}
Jul 21 16:27:56.525475 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.525440    2573 scope.go:117] "RemoveContainer" containerID="fb4ad18d3192dce94e89dca5b69f8dc9e8bf47bfd4a0ed3d885568c84d9a6c1a"
Jul 21 16:27:56.527501 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.527402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc" event={"ID":"a263039b-51ed-4fdc-983f-badb7f77fcbd","Type":"ContainerStarted","Data":"2282e6348f6685107351e39f33aaa9b2fd7836c28d435cd5c5f7eb623f120bf2"}
Jul 21 16:27:56.544037 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.543980    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-8d44g" podStartSLOduration=2.423830778 podStartE2EDuration="5.543958825s" totalImagesPullingTime="3.120128047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:56.543211529 +0000 UTC m=+258.359890972" watchObservedRunningTime="2026-07-21 16:27:56.543958825 +0000 UTC m=+258.360638272"
Jul 21 16:27:56.562529 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.562480    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc" podStartSLOduration=2.354291526 podStartE2EDuration="5.56246157s" totalImagesPullingTime="3.208170044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:56.562065858 +0000 UTC m=+258.378745313" watchObservedRunningTime="2026-07-21 16:27:56.56246157 +0000 UTC m=+258.379141015"
Jul 21 16:27:56.645453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.644515    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cq7x6"]
Jul 21 16:27:56.648228 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.648193    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.652510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.651830    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 16:27:56.652510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.652055    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 16:27:56.652510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.652234    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pk7c\""
Jul 21 16:27:56.663565 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.663533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cq7x6"]
Jul 21 16:27:56.671655 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.671616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:56.740356 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.740331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:56.742225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.742206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd46952a-489d-4ba9-b3a1-3a3381e10f24-crio-socket\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.742305 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.742247    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.742305 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.742265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg66c\" (UniqueName: \"kubernetes.io/projected/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-api-access-xg66c\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.742372 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.742346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.742432 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.742419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd46952a-489d-4ba9-b3a1-3a3381e10f24-data-volume\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.842874 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.842838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd46952a-489d-4ba9-b3a1-3a3381e10f24-data-volume\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.843044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.842936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd46952a-489d-4ba9-b3a1-3a3381e10f24-crio-socket\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.843044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.842980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.843044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.843005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg66c\" (UniqueName: \"kubernetes.io/projected/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-api-access-xg66c\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.843209 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.843046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.843209 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.843059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd46952a-489d-4ba9-b3a1-3a3381e10f24-crio-socket\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.843209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:56.843085    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:27:56.843209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:56.843157    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:56.843209 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:56.843160    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:57.343138534 +0000 UTC m=+259.159817973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : configmap "kube-rbac-proxy" not found
Jul 21 16:27:56.843387 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:56.843214    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:57.343198675 +0000 UTC m=+259.159878109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:56.843387 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.843236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd46952a-489d-4ba9-b3a1-3a3381e10f24-data-volume\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:56.854038 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:56.854012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg66c\" (UniqueName: \"kubernetes.io/projected/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-api-access-xg66c\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:57.112795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.112723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:57.209760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.209734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:57.311264 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.311224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:57.347522 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.347479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:57.347649 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.347543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:57.347649 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:57.347594    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:27:57.347766 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:57.347654    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:58.347639761 +0000 UTC m=+260.164319182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : configmap "kube-rbac-proxy" not found
Jul 21 16:27:57.347766 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:57.347680    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:57.347766 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:57.347732    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:58.347717996 +0000 UTC m=+260.164397438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:57.535792 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.535765    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:27:57.536217 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.536201    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/0.log"
Jul 21 16:27:57.536267 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.536234    2573 generic.go:356] "Generic (PLEG): container finished" podID="128d24cd-aa73-42c4-9e55-e86f5cdcfe9f" containerID="542bfd4e46280a18fe3ea6088a23cd14efe260e32f1521e80b01c8c93b71f972" exitCode=255
Jul 21 16:27:57.536313 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.536300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" event={"ID":"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f","Type":"ContainerDied","Data":"542bfd4e46280a18fe3ea6088a23cd14efe260e32f1521e80b01c8c93b71f972"}
Jul 21 16:27:57.536370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.536361    2573 scope.go:117] "RemoveContainer" containerID="fb4ad18d3192dce94e89dca5b69f8dc9e8bf47bfd4a0ed3d885568c84d9a6c1a"
Jul 21 16:27:57.536632 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.536612    2573 scope.go:117] "RemoveContainer" containerID="542bfd4e46280a18fe3ea6088a23cd14efe260e32f1521e80b01c8c93b71f972"
Jul 21 16:27:57.536806 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:57.536783    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-4zxkf_openshift-console-operator(128d24cd-aa73-42c4-9e55-e86f5cdcfe9f)\"" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" podUID="128d24cd-aa73-42c4-9e55-e86f5cdcfe9f"
Jul 21 16:27:57.601639 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.601618    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wcldj"]
Jul 21 16:27:57.605502 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.605480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.608389 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.608374    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 16:27:57.608521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.608501    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xscjr\""
Jul 21 16:27:57.608592 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.608578    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 16:27:57.608688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.608676    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 16:27:57.608749 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.608738    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 16:27:57.614415 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.614396    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wcldj"]
Jul 21 16:27:57.643160 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.643135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:57.649152 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.649132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9f17110c-8c41-4e1c-800a-69cfd80c88bb-signing-cabundle\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.649464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.649435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9f17110c-8c41-4e1c-800a-69cfd80c88bb-signing-key\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.649593 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.649561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc559\" (UniqueName: \"kubernetes.io/projected/9f17110c-8c41-4e1c-800a-69cfd80c88bb-kube-api-access-kc559\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.712763 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.712741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:57.749838 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.749810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9f17110c-8c41-4e1c-800a-69cfd80c88bb-signing-key\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.749918 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.749857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc559\" (UniqueName: \"kubernetes.io/projected/9f17110c-8c41-4e1c-800a-69cfd80c88bb-kube-api-access-kc559\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.750038 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.750022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9f17110c-8c41-4e1c-800a-69cfd80c88bb-signing-cabundle\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.750594 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.750573    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9f17110c-8c41-4e1c-800a-69cfd80c88bb-signing-cabundle\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.752373 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.752356    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9f17110c-8c41-4e1c-800a-69cfd80c88bb-signing-key\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.758658 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.758639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc559\" (UniqueName: \"kubernetes.io/projected/9f17110c-8c41-4e1c-800a-69cfd80c88bb-kube-api-access-kc559\") pod \"service-ca-58598695f7-wcldj\" (UID: \"9f17110c-8c41-4e1c-800a-69cfd80c88bb\") " pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:57.914505 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:57.914454    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wcldj"
Jul 21 16:27:58.042868 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.042848    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wcldj"]
Jul 21 16:27:58.045307 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:27:58.045285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f17110c_8c41_4e1c_800a_69cfd80c88bb.slice/crio-a989dce6783cfca747c186957a13e03d0caae1e68d5f28b02fe03cf04176ea3c WatchSource:0}: Error finding container a989dce6783cfca747c186957a13e03d0caae1e68d5f28b02fe03cf04176ea3c: Status 404 returned error can't find the container with id a989dce6783cfca747c186957a13e03d0caae1e68d5f28b02fe03cf04176ea3c
Jul 21 16:27:58.356009 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.355969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:58.356009 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.356025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:27:58.356256 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:58.356107    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:27:58.356256 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:58.356144    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:58.356256 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:58.356180    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.356160118 +0000 UTC m=+262.172839540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : configmap "kube-rbac-proxy" not found
Jul 21 16:27:58.356256 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:58.356198    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.356189945 +0000 UTC m=+262.172869367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:58.541799 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.541770    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:27:58.542195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.542171    2573 scope.go:117] "RemoveContainer" containerID="542bfd4e46280a18fe3ea6088a23cd14efe260e32f1521e80b01c8c93b71f972"
Jul 21 16:27:58.542372 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:58.542347    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-4zxkf_openshift-console-operator(128d24cd-aa73-42c4-9e55-e86f5cdcfe9f)\"" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" podUID="128d24cd-aa73-42c4-9e55-e86f5cdcfe9f"
Jul 21 16:27:58.543166 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.543131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wcldj" event={"ID":"9f17110c-8c41-4e1c-800a-69cfd80c88bb","Type":"ContainerStarted","Data":"a989dce6783cfca747c186957a13e03d0caae1e68d5f28b02fe03cf04176ea3c"}
Jul 21 16:27:58.595409 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.595369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:58.818221 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:58.818202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qmxdc_380a2811-539d-4a04-80db-bcd28c818aa0/dns-node-resolver/0.log"
Jul 21 16:27:59.564698 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:59.564663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:27:59.564879 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:59.564819    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:27:59.564978 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:59.564922    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls podName:f7879988-66f9-4b2b-9ce1-a58f17f3279c nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.564898482 +0000 UTC m=+269.381577924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zn8mz" (UID: "f7879988-66f9-4b2b-9ce1-a58f17f3279c") : secret "samples-operator-tls" not found
Jul 21 16:27:59.618102 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:59.618075    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lmkk_fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5/node-ca/0.log"
Jul 21 16:27:59.665235 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:59.665196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:59.665406 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:27:59.665255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:27:59.665406 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:59.665385    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:27:59.665488 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:59.665397    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.665382496 +0000 UTC m=+269.482061920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : configmap references non-existent config key: service-ca.crt
Jul 21 16:27:59.665488 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:27:59.665460    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs podName:cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.665443194 +0000 UTC m=+269.482122623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs") pod "router-default-59f856cfbd-lm9zd" (UID: "cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d") : secret "router-metrics-certs-default" not found
Jul 21 16:28:00.371688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:00.371659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:00.372151 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:00.371699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:00.372151 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:00.371774    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:00.372151 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:00.371815    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:00.372151 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:00.371848    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:04.371831893 +0000 UTC m=+266.188511314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:00.372151 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:00.371861    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:04.371855408 +0000 UTC m=+266.188534829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:00.555781 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:00.555709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wcldj" event={"ID":"9f17110c-8c41-4e1c-800a-69cfd80c88bb","Type":"ContainerStarted","Data":"44d9ee143c929d257ee6c4c9318317515431e0ccfc8e4389b2691303568947de"}
Jul 21 16:28:00.617323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:00.617297    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-crz5z_8375b1de-1c02-46e5-87e5-4ae126e409a7/serve-healthcheck-canary/0.log"
Jul 21 16:28:01.277364 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:01.277334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:01.464280 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:01.464185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:01.913532 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:01.913504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:02.017400 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:02.017371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:02.146673 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:02.146644    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:28:02.146843 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:02.146696    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:28:02.147047 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:02.147035    2573 scope.go:117] "RemoveContainer" containerID="542bfd4e46280a18fe3ea6088a23cd14efe260e32f1521e80b01c8c93b71f972"
Jul 21 16:28:02.147198 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:02.147180    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-4zxkf_openshift-console-operator(128d24cd-aa73-42c4-9e55-e86f5cdcfe9f)\"" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" podUID="128d24cd-aa73-42c4-9e55-e86f5cdcfe9f"
Jul 21 16:28:02.184600 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:02.184510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:02.781761 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:02.781730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:03.377708 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:03.377673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:03.578845 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:03.578816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:04.315781 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:04.315751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:04.405327 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:04.405298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:04.405495 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:04.405343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:04.405495 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:04.405443    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:04.405495 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:04.405462    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:04.405637 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:04.405521    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:12.405499219 +0000 UTC m=+274.222178653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:04.405637 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:04.405542    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls podName:fd46952a-489d-4ba9-b3a1-3a3381e10f24 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:12.405533029 +0000 UTC m=+274.222212453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cq7x6" (UID: "fd46952a-489d-4ba9-b3a1-3a3381e10f24") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:04.416515 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:04.416492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:04.989151 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:04.989116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:05.173973 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:05.173938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:05.309017 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:05.308984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:05.410669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:05.410639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:05.581650 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:05.581568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:05.783080 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:05.783049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:06.175827 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:06.175787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:06.769901 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:06.769852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:07.173547 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.173516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:07.572512 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.572484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:07.630131 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.630107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:28:07.632497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.632469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7879988-66f9-4b2b-9ce1-a58f17f3279c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zn8mz\" (UID: \"f7879988-66f9-4b2b-9ce1-a58f17f3279c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:28:07.730932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.730905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:07.731065 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.731018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:07.731471 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.731452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-service-ca-bundle\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:07.733190 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.733168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d-metrics-certs\") pod \"router-default-59f856cfbd-lm9zd\" (UID: \"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d\") " pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:07.750896 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.750861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"
Jul 21 16:28:07.766487 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.766461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:07.835238 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.835166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:07.883104 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.883045    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-wcldj" podStartSLOduration=9.037892327 podStartE2EDuration="10.883025139s" totalImagesPullingTime="1.845132812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:00.57592528 +0000 UTC m=+262.392604723" watchObservedRunningTime="2026-07-21 16:28:07.883025139 +0000 UTC m=+269.699704583"
Jul 21 16:28:07.883928 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.883905    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz"]
Jul 21 16:28:07.971053 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.971023    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59f856cfbd-lm9zd"]
Jul 21 16:28:07.974770 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:07.974726    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3d910f_80f7_4f3e_b8d8_6b73ed781e5d.slice/crio-91fccc6ffad36b8ae50757f81b2f333e2f38dca4819f1c949d1bcd5d78dae573 WatchSource:0}: Error finding container 91fccc6ffad36b8ae50757f81b2f333e2f38dca4819f1c949d1bcd5d78dae573: Status 404 returned error can't find the container with id 91fccc6ffad36b8ae50757f81b2f333e2f38dca4819f1c949d1bcd5d78dae573
Jul 21 16:28:07.974921 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:07.974799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:08.170414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.170341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:08.582412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.582373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz" event={"ID":"f7879988-66f9-4b2b-9ce1-a58f17f3279c","Type":"ContainerStarted","Data":"ac43b28d42475bf801b518213fa0f2692e6b5d6f6d0d58611361b58516871393"}
Jul 21 16:28:08.584257 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.584028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59f856cfbd-lm9zd" event={"ID":"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d","Type":"ContainerStarted","Data":"c8516428fa9c973a95638c5085e834401a66f9e3c20447d40017a5db8a2416ce"}
Jul 21 16:28:08.584257 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.584078    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59f856cfbd-lm9zd" event={"ID":"cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d","Type":"ContainerStarted","Data":"91fccc6ffad36b8ae50757f81b2f333e2f38dca4819f1c949d1bcd5d78dae573"}
Jul 21 16:28:08.585999 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.585969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:08.606519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.606480    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59f856cfbd-lm9zd" podStartSLOduration=17.606462867 podStartE2EDuration="17.606462867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:08.605714863 +0000 UTC m=+270.422394308" watchObservedRunningTime="2026-07-21 16:28:08.606462867 +0000 UTC m=+270.423142319"
Jul 21 16:28:08.836077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.836006    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:08.839282 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.839256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:08.946606 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:08.946570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:09.175227 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:09.175153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:09.587681 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:09.587658    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:09.588901 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:09.588816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:09.589147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:09.589124    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59f856cfbd-lm9zd"
Jul 21 16:28:09.980453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:09.980371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:10.175277 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:10.175243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:10.275234 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:10.275171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:10.375318 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:10.375292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:10.592259 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:10.592226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz" event={"ID":"f7879988-66f9-4b2b-9ce1-a58f17f3279c","Type":"ContainerStarted","Data":"c7d6272698a037f2196e89984c8f407bdb1da6d39cbeded4750dea0b3dcfa54f"}
Jul 21 16:28:10.592424 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:10.592287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz" event={"ID":"f7879988-66f9-4b2b-9ce1-a58f17f3279c","Type":"ContainerStarted","Data":"8710da14e950e9b84e75338b563bcd5d15e17e54d7683c78c175fffe51a7e252"}
Jul 21 16:28:10.609442 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:10.609386    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zn8mz" podStartSLOduration=17.855285701 podStartE2EDuration="19.609368573s" totalImagesPullingTime="1.754082872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:10.60934024 +0000 UTC m=+272.426019684" watchObservedRunningTime="2026-07-21 16:28:10.609368573 +0000 UTC m=+272.426048019"
Jul 21 16:28:11.377091 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:11.377062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:11.571753 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:11.571723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:11.773143 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:11.773062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:11.976474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:11.976442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:12.472819 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.472782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:12.473233 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.472828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:12.473418 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.473399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd46952a-489d-4ba9-b3a1-3a3381e10f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:12.475009 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.474992    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd46952a-489d-4ba9-b3a1-3a3381e10f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq7x6\" (UID: \"fd46952a-489d-4ba9-b3a1-3a3381e10f24\") " pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:12.560448 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.560418    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cq7x6"
Jul 21 16:28:12.680676 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.680656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cq7x6"]
Jul 21 16:28:12.682805 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:12.682783    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd46952a_489d_4ba9_b3a1_3a3381e10f24.slice/crio-f410d4f38c1e2798c4c3e78136fe883cdd003939364ce6e3d3b93c74395812b5 WatchSource:0}: Error finding container f410d4f38c1e2798c4c3e78136fe883cdd003939364ce6e3d3b93c74395812b5: Status 404 returned error can't find the container with id f410d4f38c1e2798c4c3e78136fe883cdd003939364ce6e3d3b93c74395812b5
Jul 21 16:28:12.693326 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:12.693310    2573 scope.go:117] "RemoveContainer" containerID="542bfd4e46280a18fe3ea6088a23cd14efe260e32f1521e80b01c8c93b71f972"
Jul 21 16:28:13.264740 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.264704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:13.370366 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.370320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:13.430269 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.430227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:13.560769 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.560739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:13.605464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.605437    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:28:13.605618 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.605577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" event={"ID":"128d24cd-aa73-42c4-9e55-e86f5cdcfe9f","Type":"ContainerStarted","Data":"2ef8d724e9eb00bf763f1732e033e267fe2ac25c1087b116c6c9d610cc7b4830"}
Jul 21 16:28:13.606131 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.606110    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:28:13.607285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.607255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq7x6" event={"ID":"fd46952a-489d-4ba9-b3a1-3a3381e10f24","Type":"ContainerStarted","Data":"f410d4f38c1e2798c4c3e78136fe883cdd003939364ce6e3d3b93c74395812b5"}
Jul 21 16:28:13.612455 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.612427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf"
Jul 21 16:28:13.625184 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.625139    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-4zxkf" podStartSLOduration=19.43937677 podStartE2EDuration="22.625123909s" totalImagesPullingTime="3.185747139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:13.623968079 +0000 UTC m=+275.440647521" watchObservedRunningTime="2026-07-21 16:28:13.625123909 +0000 UTC m=+275.441803351"
Jul 21 16:28:13.735000 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.734970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:13.798522 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:13.798476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:14.167243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:14.167211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:14.222701 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:14.222672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:14.565796 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:14.565765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:14.621564 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:14.621528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:14.980682 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:14.980597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:15.155840 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:15.155777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:15.339730 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:15.339700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:15.969579 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:15.969511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:16.031247 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:16.031210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:16.724547 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:16.724505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:16.783398 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:16.783360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:18.516146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:18.516113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:18.618223 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:18.618170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:18.627619 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:18.627579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq7x6" event={"ID":"fd46952a-489d-4ba9-b3a1-3a3381e10f24","Type":"ContainerStarted","Data":"28cd7a90ef2eee25a394554c72768484824310ec5d6e584eef59f7b9d1591320"}
Jul 21 16:28:19.458215 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:19.458155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:19.525388 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:19.525352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:20.279672 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:20.279629    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs" podUID="39c670d6-4da9-4374-acb4-7499c8366821"
Jul 21 16:28:20.279672 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:20.279629    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6"
Jul 21 16:28:20.279911 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:20.279628    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ld5xs" podUID="62d8da46-8968-4210-be61-1918cdbe0d08"
Jul 21 16:28:20.633802 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:20.633770    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:28:20.634295 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:20.633772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:28:20.634295 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:20.633772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:28:21.571784 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.571750    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b65f5b7f9-l9j95"]
Jul 21 16:28:21.574853 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.574837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.578214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.578124    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 16:28:21.578649 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.578624    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 16:28:21.580111 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.579565    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.580111 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.579861    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 16:28:21.580111 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.579957    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 16:28:21.580301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.580211    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.580301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.580230    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-654wr\""
Jul 21 16:28:21.580365 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.580345    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 16:28:21.585348 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.585328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65f5b7f9-l9j95"]
Jul 21 16:28:21.638866 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.638837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq7x6" event={"ID":"fd46952a-489d-4ba9-b3a1-3a3381e10f24","Type":"ContainerStarted","Data":"168beb99abbcb46b5b529e869d55698cef810577ca3c4d591f5d81efe5ab52c2"}
Jul 21 16:28:21.759974 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.759945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h2jn\" (UniqueName: \"kubernetes.io/projected/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-kube-api-access-7h2jn\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.760146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.760003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-oauth-serving-cert\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.760146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.760060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-config\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.760146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.760105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-service-ca\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.760146 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.760143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-serving-cert\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.760328 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.760226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-oauth-config\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.860924 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.860823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-oauth-config\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.860924 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.860906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h2jn\" (UniqueName: \"kubernetes.io/projected/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-kube-api-access-7h2jn\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.861147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.860944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-oauth-serving-cert\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.861147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.860969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-config\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.861147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.860995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-service-ca\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.861147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.861039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-serving-cert\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.861800 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.861752    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-config\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.861800 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.861782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-service-ca\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.862009 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.861805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-oauth-serving-cert\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.863595 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.863572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-oauth-config\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.863821 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.863802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-serving-cert\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.871527 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.871483    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h2jn\" (UniqueName: \"kubernetes.io/projected/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-kube-api-access-7h2jn\") pod \"console-b65f5b7f9-l9j95\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") " pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:21.886194 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:21.886173    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:22.027082 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:22.027048    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65f5b7f9-l9j95"]
Jul 21 16:28:22.030843 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:22.030813    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08ea4c1_3793_4c0c_aa87_4d657a597bc1.slice/crio-de9da12878e5110a555284c3b03f943fdbcb3ee16e36fb3ec420aa5b274d9531 WatchSource:0}: Error finding container de9da12878e5110a555284c3b03f943fdbcb3ee16e36fb3ec420aa5b274d9531: Status 404 returned error can't find the container with id de9da12878e5110a555284c3b03f943fdbcb3ee16e36fb3ec420aa5b274d9531
Jul 21 16:28:22.644352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:22.644312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f5b7f9-l9j95" event={"ID":"e08ea4c1-3793-4c0c-aa87-4d657a597bc1","Type":"ContainerStarted","Data":"de9da12878e5110a555284c3b03f943fdbcb3ee16e36fb3ec420aa5b274d9531"}
Jul 21 16:28:23.576338 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.576293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:28:23.576516 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.576461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:28:23.576587 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.576515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:28:23.579285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.579238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"image-registry-77bb9c5c75-mvqkn\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") " pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:28:23.579420 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.579347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d8da46-8968-4210-be61-1918cdbe0d08-metrics-tls\") pod \"dns-default-ld5xs\" (UID: \"62d8da46-8968-4210-be61-1918cdbe0d08\") " pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:28:23.579692 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.579662    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c670d6-4da9-4374-acb4-7499c8366821-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f5xrs\" (UID: \"39c670d6-4da9-4374-acb4-7499c8366821\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:28:23.639135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.639103    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kt5q5\""
Jul 21 16:28:23.639262 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.639141    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwsf5\""
Jul 21 16:28:23.639262 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.639163    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pwlmw\""
Jul 21 16:28:23.644945 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.644925    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"
Jul 21 16:28:23.645314 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.644950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:28:23.645314 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:23.645045    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:28:26.029861 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.029739    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bb9c5c75-mvqkn"]
Jul 21 16:28:26.032968 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:26.032935    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80546c4e_6dbd_4819_a320_7d3d6268f5f6.slice/crio-f8633ea59ad588ff0e1f279e666b719c09801e9cbb6b82341f8a734cb50af0b4 WatchSource:0}: Error finding container f8633ea59ad588ff0e1f279e666b719c09801e9cbb6b82341f8a734cb50af0b4: Status 404 returned error can't find the container with id f8633ea59ad588ff0e1f279e666b719c09801e9cbb6b82341f8a734cb50af0b4
Jul 21 16:28:26.252322 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.252250    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs"]
Jul 21 16:28:26.255017 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:26.254990    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c670d6_4da9_4374_acb4_7499c8366821.slice/crio-cf6b2ea02c9f92a1221282a8169c9b7c5eff18ab2bc02ad3a5f4fdf8dac342bc WatchSource:0}: Error finding container cf6b2ea02c9f92a1221282a8169c9b7c5eff18ab2bc02ad3a5f4fdf8dac342bc: Status 404 returned error can't find the container with id cf6b2ea02c9f92a1221282a8169c9b7c5eff18ab2bc02ad3a5f4fdf8dac342bc
Jul 21 16:28:26.256064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.256045    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ld5xs"]
Jul 21 16:28:26.258335 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:26.258310    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d8da46_8968_4210_be61_1918cdbe0d08.slice/crio-be0c0551c0aa88688ace8b88c7e6032d961be4ebf367b620c9b92aa3e5af7bc0 WatchSource:0}: Error finding container be0c0551c0aa88688ace8b88c7e6032d961be4ebf367b620c9b92aa3e5af7bc0: Status 404 returned error can't find the container with id be0c0551c0aa88688ace8b88c7e6032d961be4ebf367b620c9b92aa3e5af7bc0
Jul 21 16:28:26.588684 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.588655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:26.659535 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.659503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f5b7f9-l9j95" event={"ID":"e08ea4c1-3793-4c0c-aa87-4d657a597bc1","Type":"ContainerStarted","Data":"7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f"}
Jul 21 16:28:26.660634 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.660611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs" event={"ID":"39c670d6-4da9-4374-acb4-7499c8366821","Type":"ContainerStarted","Data":"cf6b2ea02c9f92a1221282a8169c9b7c5eff18ab2bc02ad3a5f4fdf8dac342bc"}
Jul 21 16:28:26.661932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.661911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" event={"ID":"80546c4e-6dbd-4819-a320-7d3d6268f5f6","Type":"ContainerStarted","Data":"3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6"}
Jul 21 16:28:26.662002 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.661950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" event={"ID":"80546c4e-6dbd-4819-a320-7d3d6268f5f6","Type":"ContainerStarted","Data":"f8633ea59ad588ff0e1f279e666b719c09801e9cbb6b82341f8a734cb50af0b4"}
Jul 21 16:28:26.662002 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.661984    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:28:26.663829 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.663812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq7x6" event={"ID":"fd46952a-489d-4ba9-b3a1-3a3381e10f24","Type":"ContainerStarted","Data":"8140188fe7154a8c6f195e3c4475651507b6fba13f620d8ef4aa0e78dd828467"}
Jul 21 16:28:26.664796 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.664780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ld5xs" event={"ID":"62d8da46-8968-4210-be61-1918cdbe0d08","Type":"ContainerStarted","Data":"be0c0551c0aa88688ace8b88c7e6032d961be4ebf367b620c9b92aa3e5af7bc0"}
Jul 21 16:28:26.678594 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.678559    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b65f5b7f9-l9j95" podStartSLOduration=1.827332103 podStartE2EDuration="5.67854646s" totalImagesPullingTime="3.851214357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:26.675863128 +0000 UTC m=+288.492542582" watchObservedRunningTime="2026-07-21 16:28:26.67854646 +0000 UTC m=+288.495225882"
Jul 21 16:28:26.682759 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.682742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:26.697029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.696997    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" podStartSLOduration=287.696986622 podStartE2EDuration="4m47.696986622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:26.69636466 +0000 UTC m=+288.513044103" watchObservedRunningTime="2026-07-21 16:28:26.696986622 +0000 UTC m=+288.513666065"
Jul 21 16:28:26.717268 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:26.714936    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cq7x6" podStartSLOduration=17.63438191 podStartE2EDuration="30.714919875s" totalImagesPullingTime="13.080537965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:26.713524097 +0000 UTC m=+288.530203540" watchObservedRunningTime="2026-07-21 16:28:26.714919875 +0000 UTC m=+288.531599320"
Jul 21 16:28:27.670507 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:27.670472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs" event={"ID":"39c670d6-4da9-4374-acb4-7499c8366821","Type":"ContainerStarted","Data":"88bfdc77b8495ceefb30b9288677f6df65c590cf62bedad2a8bbe590101a1004"}
Jul 21 16:28:27.687530 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:27.687487    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f5xrs" podStartSLOduration=268.455321587 podStartE2EDuration="4m29.687472405s" totalImagesPullingTime="1.232150818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:27.686565921 +0000 UTC m=+289.503245364" watchObservedRunningTime="2026-07-21 16:28:27.687472405 +0000 UTC m=+289.504151825"
Jul 21 16:28:27.804715 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:27.804683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:27.900566 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:27.900515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:27.987252 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:27.987221    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:28.216334 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:28.216256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:28.676108 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:28.676069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ld5xs" event={"ID":"62d8da46-8968-4210-be61-1918cdbe0d08","Type":"ContainerStarted","Data":"07727a95d313c836a8ad91bd74663834fc8490f5a250a6b7a8e8e8efb4112f2b"}
Jul 21 16:28:28.676449 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:28.676133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ld5xs" event={"ID":"62d8da46-8968-4210-be61-1918cdbe0d08","Type":"ContainerStarted","Data":"6816a117e25dcfa2eccfed2760f57b541e3b0d2c0aaf2b2353b1624a392c278a"}
Jul 21 16:28:28.695199 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:28.695149    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ld5xs" podStartSLOduration=253.678769285 podStartE2EDuration="4m15.695130333s" totalImagesPullingTime="2.016361048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:28.693492684 +0000 UTC m=+290.510172127" watchObservedRunningTime="2026-07-21 16:28:28.695130333 +0000 UTC m=+290.511809778"
Jul 21 16:28:29.365133 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:29.365104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:29.420529 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:29.420499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:29.679430 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:29.679364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:28:31.886948 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:31.886911    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:31.887323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:31.886969    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:31.888301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:31.888275    2573 patch_prober.go:28] interesting pod/console-b65f5b7f9-l9j95 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
Jul 21 16:28:31.888418 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:31.888327    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b65f5b7f9-l9j95" podUID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused"
Jul 21 16:28:32.176677 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:32.176602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:32.249090 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:32.249060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:35.694667 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:35.694621    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cp5xk" podUID="cb9a824b-a9ae-4e1a-bde8-421045bfebe2"
Jul 21 16:28:38.597855 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:38.597822    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:28:38.598430 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:38.597987    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:28:38.609375 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:38.609351    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 16:28:39.314401 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:39.314368    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:39.367944 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:39.367916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:39.685101 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:39.685025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ld5xs"
Jul 21 16:28:40.010012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.009942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.077254 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.077229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.134759 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.134738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.235226 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.235208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.290159 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.290132    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.382571 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.382538    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bb9c5c75-mvqkn"]
Jul 21 16:28:40.478575 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.478550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.580353 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.580295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:40.735554 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:40.735507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:41.890615 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:41.890583    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:41.894281 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:41.894261    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:28:42.643277 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:42.643244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.166866 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.166834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.381487 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.381455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.478545 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.478460    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vnd9n"]
Jul 21 16:28:44.485159 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.485139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.489740 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.489715    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 16:28:44.490103 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.490085    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 16:28:44.490400 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.490382    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 16:28:44.490797 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.490776    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 16:28:44.491692 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.491606    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7zcbj\""
Jul 21 16:28:44.492880 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.492140    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 16:28:44.492880 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.492526    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 16:28:44.502713 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.502682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.532583 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2r7g\" (UniqueName: \"kubernetes.io/projected/ed77d135-3e89-4076-a6ff-f991b3e157ec-kube-api-access-d2r7g\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532696 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-textfile\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532696 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-sys\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532696 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-tls\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532849 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532849 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-root\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532849 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.532849 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532826    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-wtmp\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.533063 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.532857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed77d135-3e89-4076-a6ff-f991b3e157ec-metrics-client-ca\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.580989 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.580960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.634160 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-textfile\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-sys\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-tls\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-sys\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-root\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-root\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-wtmp\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634643    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-wtmp\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-textfile\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed77d135-3e89-4076-a6ff-f991b3e157ec-metrics-client-ca\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.634933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.634762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2r7g\" (UniqueName: \"kubernetes.io/projected/ed77d135-3e89-4076-a6ff-f991b3e157ec-kube-api-access-d2r7g\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.635370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.635342    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed77d135-3e89-4076-a6ff-f991b3e157ec-metrics-client-ca\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.635482 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.635398    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.636643 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.636620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-tls\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.636974 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.636954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed77d135-3e89-4076-a6ff-f991b3e157ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.644382 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.644356    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2r7g\" (UniqueName: \"kubernetes.io/projected/ed77d135-3e89-4076-a6ff-f991b3e157ec-kube-api-access-d2r7g\") pod \"node-exporter-vnd9n\" (UID: \"ed77d135-3e89-4076-a6ff-f991b3e157ec\") " pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.650113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.650080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.750069 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.749989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.801983 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.801955    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vnd9n"
Jul 21 16:28:44.815395 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:44.815370    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded77d135_3e89_4076_a6ff_f991b3e157ec.slice/crio-aecef4dee18e77153f688be8179fe75fc3acf514c1596dc6735758594bcf8f05 WatchSource:0}: Error finding container aecef4dee18e77153f688be8179fe75fc3acf514c1596dc6735758594bcf8f05: Status 404 returned error can't find the container with id aecef4dee18e77153f688be8179fe75fc3acf514c1596dc6735758594bcf8f05
Jul 21 16:28:44.817063 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.817041    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:28:44.850869 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.850844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.943121 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:44.943091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.052149 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.052123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.261806 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.261779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.419072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.418981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.523523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.523469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.525341 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.525315    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:28:45.529460 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.529434    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.532402 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.532380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 16:28:45.532402 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.532392    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 16:28:45.532628 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.532468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 16:28:45.533021 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.532780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 16:28:45.533021 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.532793    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 16:28:45.533021 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.532926    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-skpqt\""
Jul 21 16:28:45.533230 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.533028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 16:28:45.533270 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.533235    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 16:28:45.533352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.533336    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 16:28:45.533397 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.533384    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 16:28:45.544381 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.544362    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:28:45.643829 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.643798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.643829 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.643834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hld\" (UniqueName: \"kubernetes.io/projected/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-kube-api-access-99hld\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.643877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.643919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.643966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-config-out\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.643987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-web-config\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.644345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.644288    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.665734 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.665705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.734440 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.734418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnd9n" event={"ID":"ed77d135-3e89-4076-a6ff-f991b3e157ec","Type":"ContainerStarted","Data":"aecef4dee18e77153f688be8179fe75fc3acf514c1596dc6735758594bcf8f05"}
Jul 21 16:28:45.744895 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.744863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.744976 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.744909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-web-config\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.744976 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.744937    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.744976 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.744964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745109 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.744991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99hld\" (UniqueName: \"kubernetes.io/projected/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-kube-api-access-99hld\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745109 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745109 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-config-out\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745479 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745479 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.745971 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.745928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.748084 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.748059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-web-config\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.748189 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.748085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.748308 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.748279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.748579 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.748556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.748927 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.748905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.748998 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.748934    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.749494 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.749474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.749643 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.749627    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-config-out\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.750054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.750033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.750212 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.750193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.754180 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.754161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hld\" (UniqueName: \"kubernetes.io/projected/9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90-kube-api-access-99hld\") pod \"alertmanager-main-0\" (UID: \"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.841284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.841265    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:28:45.978677 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:45.978648    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:28:45.982566 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:45.982514    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba1a17f_5ab9_4143_b0b8_6bb3ef078f90.slice/crio-f08599e12b2007c23b419ead5d7cc61dec6612dd1effe03277947e202d393787 WatchSource:0}: Error finding container f08599e12b2007c23b419ead5d7cc61dec6612dd1effe03277947e202d393787: Status 404 returned error can't find the container with id f08599e12b2007c23b419ead5d7cc61dec6612dd1effe03277947e202d393787
Jul 21 16:28:46.721842 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:46.721807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.740210 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:46.740178    2573 generic.go:356] "Generic (PLEG): container finished" podID="ed77d135-3e89-4076-a6ff-f991b3e157ec" containerID="74a94d9a93b2151ac584273b3d5cd77f9076e2d742673acf2a09cec9b78df40c" exitCode=0
Jul 21 16:28:46.740364 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:46.740261    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnd9n" event={"ID":"ed77d135-3e89-4076-a6ff-f991b3e157ec","Type":"ContainerDied","Data":"74a94d9a93b2151ac584273b3d5cd77f9076e2d742673acf2a09cec9b78df40c"}
Jul 21 16:28:46.741608 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:46.741587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"f08599e12b2007c23b419ead5d7cc61dec6612dd1effe03277947e202d393787"}
Jul 21 16:28:46.781082 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:46.781049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.367783 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.367756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.446892 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.446859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.626844 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.626811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.747454 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.747418    2573 generic.go:356] "Generic (PLEG): container finished" podID="9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90" containerID="c258a272898f9d7543319f9bf86dc70ad2bd5f89937517ccad478c2520ac1714" exitCode=0
Jul 21 16:28:47.747880 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.747502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerDied","Data":"c258a272898f9d7543319f9bf86dc70ad2bd5f89937517ccad478c2520ac1714"}
Jul 21 16:28:47.750010 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.749991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnd9n" event={"ID":"ed77d135-3e89-4076-a6ff-f991b3e157ec","Type":"ContainerStarted","Data":"d754fe73895389eae2a3489a88fcc13edbdc3d297d495035f556fd2f7ad4743b"}
Jul 21 16:28:47.750092 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.750030    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnd9n" event={"ID":"ed77d135-3e89-4076-a6ff-f991b3e157ec","Type":"ContainerStarted","Data":"379437e8aac24f131d20e6117ccc31a702c6facd5919e88c7d155ab684604619"}
Jul 21 16:28:47.779154 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.779122    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.794004 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:47.793964    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vnd9n" podStartSLOduration=2.813422382 podStartE2EDuration="3.793952203s" totalImagesPullingTime="915.632542ms" totalInitContainerRuntime="64.897279ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:47.792877339 +0000 UTC m=+309.609556782" watchObservedRunningTime="2026-07-21 16:28:47.793952203 +0000 UTC m=+309.610631646"
Jul 21 16:28:48.616430 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.616390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:48.716608 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.716564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:48.730950 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.730927    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"]
Jul 21 16:28:48.762029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.761994    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"]
Jul 21 16:28:48.762443 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.762113    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.767052 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.766873    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 16:28:48.767052 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.766917    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 16:28:48.767052 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.766955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 16:28:48.767052 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.766973    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7f2p86q0ak05j\""
Jul 21 16:28:48.767052 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.766982    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 16:28:48.767052 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.766985    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xffzn\""
Jul 21 16:28:48.872843 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.872769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-secret-metrics-server-tls\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.872843 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.872820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a9f59f70-460b-4dbb-97d4-3538757ca4dd-metrics-server-audit-profiles\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.873072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.872876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a9f59f70-460b-4dbb-97d4-3538757ca4dd-audit-log\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.873072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.872970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-client-ca-bundle\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.873072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.873034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjt2\" (UniqueName: \"kubernetes.io/projected/a9f59f70-460b-4dbb-97d4-3538757ca4dd-kube-api-access-frjt2\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.873236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.873094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-secret-metrics-server-client-certs\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.873236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.873185    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f59f70-460b-4dbb-97d4-3538757ca4dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.973744 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f59f70-460b-4dbb-97d4-3538757ca4dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.973912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-secret-metrics-server-tls\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.973912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a9f59f70-460b-4dbb-97d4-3538757ca4dd-metrics-server-audit-profiles\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.973912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a9f59f70-460b-4dbb-97d4-3538757ca4dd-audit-log\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.973912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-client-ca-bundle\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.973912 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjt2\" (UniqueName: \"kubernetes.io/projected/a9f59f70-460b-4dbb-97d4-3538757ca4dd-kube-api-access-frjt2\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.974153 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.973919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-secret-metrics-server-client-certs\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.974324 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.974274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a9f59f70-460b-4dbb-97d4-3538757ca4dd-audit-log\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.974505 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.974480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f59f70-460b-4dbb-97d4-3538757ca4dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.974932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.974913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a9f59f70-460b-4dbb-97d4-3538757ca4dd-metrics-server-audit-profiles\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.976342 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.976325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-secret-metrics-server-tls\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.976746 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.976721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-secret-metrics-server-client-certs\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.976823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.976786    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9f59f70-460b-4dbb-97d4-3538757ca4dd-client-ca-bundle\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:48.982397 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:48.982379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjt2\" (UniqueName: \"kubernetes.io/projected/a9f59f70-460b-4dbb-97d4-3538757ca4dd-kube-api-access-frjt2\") pod \"metrics-server-65cc7dcb55-7fgc5\" (UID: \"a9f59f70-460b-4dbb-97d4-3538757ca4dd\") " pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:49.072975 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.072944    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:28:49.207274 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.207246    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"]
Jul 21 16:28:49.209451 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.209403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.226174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.226124    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"]
Jul 21 16:28:49.226288 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.226247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.231276 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.231252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 16:28:49.231385 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.231292    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wq72w\""
Jul 21 16:28:49.253127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.253103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"]
Jul 21 16:28:49.277284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.277247    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rpbh\" (UniqueName: \"kubernetes.io/projected/de4805ac-7f09-4245-9268-d2e9e43d161e-kube-api-access-2rpbh\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.277412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.277391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de4805ac-7f09-4245-9268-d2e9e43d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.298528 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.298502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.378159 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.378134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rpbh\" (UniqueName: \"kubernetes.io/projected/de4805ac-7f09-4245-9268-d2e9e43d161e-kube-api-access-2rpbh\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.378315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.378217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de4805ac-7f09-4245-9268-d2e9e43d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.378384 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:49.378341    2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 21 16:28:49.378438 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:28:49.378399    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4805ac-7f09-4245-9268-d2e9e43d161e-monitoring-plugin-cert podName:de4805ac-7f09-4245-9268-d2e9e43d161e nodeName:}" failed. No retries permitted until 2026-07-21 16:28:49.878378934 +0000 UTC m=+311.695058358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/de4805ac-7f09-4245-9268-d2e9e43d161e-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-v4d5h" (UID: "de4805ac-7f09-4245-9268-d2e9e43d161e") : secret "monitoring-plugin-cert" not found
Jul 21 16:28:49.388057 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.388029    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rpbh\" (UniqueName: \"kubernetes.io/projected/de4805ac-7f09-4245-9268-d2e9e43d161e-kube-api-access-2rpbh\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.550255 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:49.550227    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f59f70_460b_4dbb_97d4_3538757ca4dd.slice/crio-e27ceaba9643c1823ad48661670d33404778d33f62432a619a54a278f2b9b679 WatchSource:0}: Error finding container e27ceaba9643c1823ad48661670d33404778d33f62432a619a54a278f2b9b679: Status 404 returned error can't find the container with id e27ceaba9643c1823ad48661670d33404778d33f62432a619a54a278f2b9b679
Jul 21 16:28:49.652349 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.652319    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"]
Jul 21 16:28:49.667332 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.667308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.670422 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.670398    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 16:28:49.670618 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.670596    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"]
Jul 21 16:28:49.670728 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.670686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 16:28:49.670998 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.670982    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 16:28:49.671127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.671067    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 16:28:49.671301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.671283    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 16:28:49.671368 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.671287    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qtn4z\""
Jul 21 16:28:49.678656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.678635    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 16:28:49.701593 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.701567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.758578 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.758553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5" event={"ID":"a9f59f70-460b-4dbb-97d4-3538757ca4dd","Type":"ContainerStarted","Data":"e27ceaba9643c1823ad48661670d33404778d33f62432a619a54a278f2b9b679"}
Jul 21 16:28:49.782038 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-telemeter-client-tls\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-serving-certs-ca-bundle\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-secret-telemeter-client\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpf48\" (UniqueName: \"kubernetes.io/projected/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-kube-api-access-zpf48\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-federate-client-tls\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-metrics-client-ca\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.782399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.782326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.882769 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.882714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-telemeter-client-tls\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.882769 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.882755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-serving-certs-ca-bundle\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.882975 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.882774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-secret-telemeter-client\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.883032 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.882989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de4805ac-7f09-4245-9268-d2e9e43d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.883032 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.883019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpf48\" (UniqueName: \"kubernetes.io/projected/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-kube-api-access-zpf48\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.883135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.883042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-federate-client-tls\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.883135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.883061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.883135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.883122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-metrics-client-ca\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.883289 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.883159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.883908 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.883859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-serving-certs-ca-bundle\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.884130 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.884102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-metrics-client-ca\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.884318 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.884296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.885535 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.885507    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-secret-telemeter-client\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.886193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.886173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-federate-client-tls\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.886284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.886263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.886324 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.886263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de4805ac-7f09-4245-9268-d2e9e43d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v4d5h\" (UID: \"de4805ac-7f09-4245-9268-d2e9e43d161e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:49.886595 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.886581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-telemeter-client-tls\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.893187 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.893168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpf48\" (UniqueName: \"kubernetes.io/projected/e22db16d-c1d1-4eb8-acea-0e68b63b9a69-kube-api-access-zpf48\") pod \"telemeter-client-7c77dbb78-jzgv7\" (UID: \"e22db16d-c1d1-4eb8-acea-0e68b63b9a69\") " pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:49.978755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:49.978733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"
Jul 21 16:28:50.143424 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.143352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:50.175671 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.175639    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c77dbb78-jzgv7"]
Jul 21 16:28:50.180418 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:50.180126    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22db16d_c1d1_4eb8_acea_0e68b63b9a69.slice/crio-3829c455e85334cf9801abcae3f326f4453e05aef8af8d4843dcfddd7688d22c WatchSource:0}: Error finding container 3829c455e85334cf9801abcae3f326f4453e05aef8af8d4843dcfddd7688d22c: Status 404 returned error can't find the container with id 3829c455e85334cf9801abcae3f326f4453e05aef8af8d4843dcfddd7688d22c
Jul 21 16:28:50.302715 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.302689    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"]
Jul 21 16:28:50.305945 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:50.305915    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4805ac_7f09_4245_9268_d2e9e43d161e.slice/crio-8aa8e72ecd488c7589ea05291c3e2539a6da026921fd911afad315f60b7936d8 WatchSource:0}: Error finding container 8aa8e72ecd488c7589ea05291c3e2539a6da026921fd911afad315f60b7936d8: Status 404 returned error can't find the container with id 8aa8e72ecd488c7589ea05291c3e2539a6da026921fd911afad315f60b7936d8
Jul 21 16:28:50.391229 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.391210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:28:50.623771 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.623736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:50.693073 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.693000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:28:50.764973 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.764934    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7" event={"ID":"e22db16d-c1d1-4eb8-acea-0e68b63b9a69","Type":"ContainerStarted","Data":"3829c455e85334cf9801abcae3f326f4453e05aef8af8d4843dcfddd7688d22c"}
Jul 21 16:28:50.768513 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.768483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"5ffbfdf435b5d67ab81385483c394bd829bee017f95b3de33acfd4bbe5202585"}
Jul 21 16:28:50.768640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.768542    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"06391d93cfc0c1a38fdfbfdc82d781e6bdd65e0fc81d2aa298d9c1c32244fc75"}
Jul 21 16:28:50.768640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.768589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"9840dc0f8ef01d6bfb4f8bc979065825857bcbfdda7cd8633c1d9ffdac29ba52"}
Jul 21 16:28:50.768640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.768625    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"f7d5fc8f03dc6c5b1d2faa9c6b9851a6f291ae5288e5d944e7ea0218ff93ca3e"}
Jul 21 16:28:50.768796 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.768662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"d7d0e7a4d6cc70a3b5b438fa59d061bdeb6a00e3dfa9894f11e5620a8171b68d"}
Jul 21 16:28:50.769799 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:50.769772    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h" event={"ID":"de4805ac-7f09-4245-9268-d2e9e43d161e","Type":"ContainerStarted","Data":"8aa8e72ecd488c7589ea05291c3e2539a6da026921fd911afad315f60b7936d8"}
Jul 21 16:28:51.775634 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:51.775594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5" event={"ID":"a9f59f70-460b-4dbb-97d4-3538757ca4dd","Type":"ContainerStarted","Data":"849160259f5567e3d07daac98e28ea6c6f9178c3c4e2c3dce8f1dae11be353f5"}
Jul 21 16:28:51.795512 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:51.795452    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5" podStartSLOduration=2.124475382 podStartE2EDuration="3.795432742s" totalImagesPullingTime="1.67095736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:51.795135738 +0000 UTC m=+313.611815183" watchObservedRunningTime="2026-07-21 16:28:51.795432742 +0000 UTC m=+313.612112186"
Jul 21 16:28:52.781916 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:52.781828    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90","Type":"ContainerStarted","Data":"695d3b5068165f3d317e9704c9c37d0559abbacd7af19c93cf886c0c4ded913e"}
Jul 21 16:28:52.783266 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:52.783243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h" event={"ID":"de4805ac-7f09-4245-9268-d2e9e43d161e","Type":"ContainerStarted","Data":"d3ea74d6f941c740b08ed2d2f73246146ad2882bfdec49a1cccc8f75a211f4d3"}
Jul 21 16:28:52.783389 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:52.783288    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:52.788147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:52.788122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h"
Jul 21 16:28:52.811570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:52.811524    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.621918929 podStartE2EDuration="7.811508929s" totalImagesPullingTime="5.168340164s" totalInitContainerRuntime="21.249836ms" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:52.811101058 +0000 UTC m=+314.627780539" watchObservedRunningTime="2026-07-21 16:28:52.811508929 +0000 UTC m=+314.628188374"
Jul 21 16:28:52.830265 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:52.830227    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v4d5h" podStartSLOduration=1.8430909519999998 podStartE2EDuration="3.830214364s" totalImagesPullingTime="1.987123412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:52.830143861 +0000 UTC m=+314.646823316" watchObservedRunningTime="2026-07-21 16:28:52.830214364 +0000 UTC m=+314.646893806"
Jul 21 16:28:53.072605 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:53.072579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:53.135132 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:53.135106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:53.788755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:53.788721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7" event={"ID":"e22db16d-c1d1-4eb8-acea-0e68b63b9a69","Type":"ContainerStarted","Data":"66e0fb484d818058e07b50aa4739c3b98d37b23a87f95f22eb04aa422f8b5a0c"}
Jul 21 16:28:53.789179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:53.788782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7" event={"ID":"e22db16d-c1d1-4eb8-acea-0e68b63b9a69","Type":"ContainerStarted","Data":"37fd545d30dbfa96938261296b6199ca5c1f0610dc98b0b392b759b35b91bde0"}
Jul 21 16:28:53.789179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:53.788809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7" event={"ID":"e22db16d-c1d1-4eb8-acea-0e68b63b9a69","Type":"ContainerStarted","Data":"fa69659fd2ce65aaa67d3e685bdd5d79f4ca074752b5705a62ca14f938c02b95"}
Jul 21 16:28:53.816257 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:53.816207    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c77dbb78-jzgv7" podStartSLOduration=2.192592368 podStartE2EDuration="4.816191253s" totalImagesPullingTime="2.623598885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:53.813686112 +0000 UTC m=+315.630365567" watchObservedRunningTime="2026-07-21 16:28:53.816191253 +0000 UTC m=+315.632870709"
Jul 21 16:28:54.718039 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.718009    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b958bb4b6-cbmlm"]
Jul 21 16:28:54.721312 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.721293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.730297 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.730276    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 16:28:54.731261 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.731242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b958bb4b6-cbmlm"]
Jul 21 16:28:54.827854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.827828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-console-config\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.828214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.827859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-oauth-config\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.828214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.827881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-oauth-serving-cert\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.828214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.827947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztqhn\" (UniqueName: \"kubernetes.io/projected/4dc01d08-43df-4c08-9510-a7b05ce97920-kube-api-access-ztqhn\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.828214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.827966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-trusted-ca-bundle\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.828214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.827992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-service-ca\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.828214 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.828053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-serving-cert\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.929029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.928988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-service-ca\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.929029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-serving-cert\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.929255 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-console-config\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.929255 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-oauth-config\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.929255 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-oauth-serving-cert\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.930086 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztqhn\" (UniqueName: \"kubernetes.io/projected/4dc01d08-43df-4c08-9510-a7b05ce97920-kube-api-access-ztqhn\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.930086 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-trusted-ca-bundle\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.930086 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.929904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-console-config\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.930086 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.930026    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-service-ca\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.930086 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.930075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-oauth-serving-cert\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.930717 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.930692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-trusted-ca-bundle\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.931726 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.931705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-serving-cert\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.931817 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.931803    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-oauth-config\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:54.938294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:54.938266    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztqhn\" (UniqueName: \"kubernetes.io/projected/4dc01d08-43df-4c08-9510-a7b05ce97920-kube-api-access-ztqhn\") pod \"console-7b958bb4b6-cbmlm\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") " pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:55.032406 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:55.032345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:28:55.157201 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:55.157178    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b958bb4b6-cbmlm"]
Jul 21 16:28:55.159449 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:28:55.159424    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc01d08_43df_4c08_9510_a7b05ce97920.slice/crio-f786e876baa034dda7f74ac1b4d2dd57f634e25eb8d9d633af4e0e5d97dbca30 WatchSource:0}: Error finding container f786e876baa034dda7f74ac1b4d2dd57f634e25eb8d9d633af4e0e5d97dbca30: Status 404 returned error can't find the container with id f786e876baa034dda7f74ac1b4d2dd57f634e25eb8d9d633af4e0e5d97dbca30
Jul 21 16:28:55.798830 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:55.798795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b958bb4b6-cbmlm" event={"ID":"4dc01d08-43df-4c08-9510-a7b05ce97920","Type":"ContainerStarted","Data":"9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d"}
Jul 21 16:28:55.799016 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:55.798842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b958bb4b6-cbmlm" event={"ID":"4dc01d08-43df-4c08-9510-a7b05ce97920","Type":"ContainerStarted","Data":"f786e876baa034dda7f74ac1b4d2dd57f634e25eb8d9d633af4e0e5d97dbca30"}
Jul 21 16:28:55.818322 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:28:55.818272    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b958bb4b6-cbmlm" podStartSLOduration=1.8182569229999999 podStartE2EDuration="1.818256923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:55.817243635 +0000 UTC m=+317.633923079" watchObservedRunningTime="2026-07-21 16:28:55.818256923 +0000 UTC m=+317.634936366"
Jul 21 16:29:01.730096 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:01.730062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:01.833541 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:01.833487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:02.187093 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:02.187062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:02.255090 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:02.255057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:05.033303 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.033271    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:29:05.033700 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.033324    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:29:05.037756 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.037737    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:29:05.401792 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.401747    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6" containerName="registry" containerID="cri-o://3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6" gracePeriod=30
Jul 21 16:29:05.640115 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.640094    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:29:05.723955 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.723859    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-installation-pull-secrets\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.723955 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.723947    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-image-registry-private-configuration\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724172 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.723977    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80546c4e-6dbd-4819-a320-7d3d6268f5f6-ca-trust-extracted\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724172 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724019    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-bound-sa-token\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724172 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724049    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-trusted-ca\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724172 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724108    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-certificates\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724172 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724422 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724219    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhd8b\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-kube-api-access-rhd8b\") pod \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\" (UID: \"80546c4e-6dbd-4819-a320-7d3d6268f5f6\") "
Jul 21 16:29:05.724581 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724559    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:05.724640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.724585    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:05.726418 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.726392    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:05.726616 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.726594    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:05.726691 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.726637    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:05.726929 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.726909    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-kube-api-access-rhd8b" (OuterVolumeSpecName: "kube-api-access-rhd8b") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "kube-api-access-rhd8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:05.727005 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.726954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:05.732323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.732299    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80546c4e-6dbd-4819-a320-7d3d6268f5f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "80546c4e-6dbd-4819-a320-7d3d6268f5f6" (UID: "80546c4e-6dbd-4819-a320-7d3d6268f5f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:05.825298 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825266    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-trusted-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825298 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825293    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-certificates\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825298 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825302    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-registry-tls\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825311    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhd8b\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-kube-api-access-rhd8b\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825319    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-installation-pull-secrets\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825328    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80546c4e-6dbd-4819-a320-7d3d6268f5f6-image-registry-private-configuration\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825338    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80546c4e-6dbd-4819-a320-7d3d6268f5f6-ca-trust-extracted\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.825521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.825346    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80546c4e-6dbd-4819-a320-7d3d6268f5f6-bound-sa-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:05.837700 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.837672    2573 generic.go:356] "Generic (PLEG): container finished" podID="80546c4e-6dbd-4819-a320-7d3d6268f5f6" containerID="3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6" exitCode=0
Jul 21 16:29:05.837847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.837718    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn"
Jul 21 16:29:05.837847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.837763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" event={"ID":"80546c4e-6dbd-4819-a320-7d3d6268f5f6","Type":"ContainerDied","Data":"3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6"}
Jul 21 16:29:05.837847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.837813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb9c5c75-mvqkn" event={"ID":"80546c4e-6dbd-4819-a320-7d3d6268f5f6","Type":"ContainerDied","Data":"f8633ea59ad588ff0e1f279e666b719c09801e9cbb6b82341f8a734cb50af0b4"}
Jul 21 16:29:05.837847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.837839    2573 scope.go:117] "RemoveContainer" containerID="3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6"
Jul 21 16:29:05.841871 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.841847    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:29:05.846476 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.846461    2573 scope.go:117] "RemoveContainer" containerID="3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6"
Jul 21 16:29:05.846703 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:29:05.846686    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6\": container with ID starting with 3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6 not found: ID does not exist" containerID="3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6"
Jul 21 16:29:05.846758 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.846707    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6"} err="failed to get container status \"3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6\": rpc error: code = NotFound desc = could not find container \"3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6\": container with ID starting with 3d66e3b3b15fb3a771dc62051907c7d5aa7ba0aa6a0515f50010313e36d880b6 not found: ID does not exist"
Jul 21 16:29:05.877148 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.877121    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bb9c5c75-mvqkn"]
Jul 21 16:29:05.880137 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.880113    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77bb9c5c75-mvqkn"]
Jul 21 16:29:05.894961 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.894936    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b65f5b7f9-l9j95"]
Jul 21 16:29:05.973526 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:05.973496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:06.072383 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:06.072352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:06.176529 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:06.176487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:06.698165 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:06.698129    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6" path="/var/lib/kubelet/pods/80546c4e-6dbd-4819-a320-7d3d6268f5f6/volumes"
Jul 21 16:29:09.073876 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:09.073833    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:29:09.074273 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:09.073919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:29:11.862718 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:11.862687    2573 generic.go:356] "Generic (PLEG): container finished" podID="a263039b-51ed-4fdc-983f-badb7f77fcbd" containerID="2282e6348f6685107351e39f33aaa9b2fd7836c28d435cd5c5f7eb623f120bf2" exitCode=0
Jul 21 16:29:11.863133 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:11.862762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc" event={"ID":"a263039b-51ed-4fdc-983f-badb7f77fcbd","Type":"ContainerDied","Data":"2282e6348f6685107351e39f33aaa9b2fd7836c28d435cd5c5f7eb623f120bf2"}
Jul 21 16:29:11.863133 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:11.863122    2573 scope.go:117] "RemoveContainer" containerID="2282e6348f6685107351e39f33aaa9b2fd7836c28d435cd5c5f7eb623f120bf2"
Jul 21 16:29:12.867840 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:12.867809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kg7kc" event={"ID":"a263039b-51ed-4fdc-983f-badb7f77fcbd","Type":"ContainerStarted","Data":"af1e2a07bfa3322ae00e803869c83180dd36c883e43d30c349eca6ad9c31a3ea"}
Jul 21 16:29:13.590407 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:13.590375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:13.657278 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:13.657245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.722459 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:16.722425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.779854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:16.779820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.884972 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:16.884940    2573 generic.go:356] "Generic (PLEG): container finished" podID="84578956-b209-46c3-a514-bb177be7c4d5" containerID="ed1084da533f3e6e96842d19e6f40b0a4bc1a4369bde17fe4e75892081498b07" exitCode=0
Jul 21 16:29:16.885113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:16.885012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-8d44g" event={"ID":"84578956-b209-46c3-a514-bb177be7c4d5","Type":"ContainerDied","Data":"ed1084da533f3e6e96842d19e6f40b0a4bc1a4369bde17fe4e75892081498b07"}
Jul 21 16:29:16.885337 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:16.885322    2573 scope.go:117] "RemoveContainer" containerID="ed1084da533f3e6e96842d19e6f40b0a4bc1a4369bde17fe4e75892081498b07"
Jul 21 16:29:17.890893 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:17.890850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-8d44g" event={"ID":"84578956-b209-46c3-a514-bb177be7c4d5","Type":"ContainerStarted","Data":"dfab5e58728f6132e76be4f31e1107e4ac6fe77844c6609b5d35f79b3b2eec6b"}
Jul 21 16:29:29.079225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:29.079197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:29:29.083606 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:29.083566    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65cc7dcb55-7fgc5"
Jul 21 16:29:30.917815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:30.917727    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b65f5b7f9-l9j95" podUID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" containerName="console" containerID="cri-o://7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f" gracePeriod=15
Jul 21 16:29:31.197119 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.197092    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:29:31.244875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.244844    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-serving-cert\") pod \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") "
Jul 21 16:29:31.245044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.244940    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h2jn\" (UniqueName: \"kubernetes.io/projected/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-kube-api-access-7h2jn\") pod \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") "
Jul 21 16:29:31.245044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.244966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-oauth-config\") pod \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") "
Jul 21 16:29:31.245044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.245010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-oauth-serving-cert\") pod \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") "
Jul 21 16:29:31.245044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.245038    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-service-ca\") pod \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") "
Jul 21 16:29:31.245239 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.245082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-config\") pod \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\" (UID: \"e08ea4c1-3793-4c0c-aa87-4d657a597bc1\") "
Jul 21 16:29:31.245473 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.245426    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e08ea4c1-3793-4c0c-aa87-4d657a597bc1" (UID: "e08ea4c1-3793-4c0c-aa87-4d657a597bc1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:31.245690 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.245477    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-service-ca" (OuterVolumeSpecName: "service-ca") pod "e08ea4c1-3793-4c0c-aa87-4d657a597bc1" (UID: "e08ea4c1-3793-4c0c-aa87-4d657a597bc1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:31.245690 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.245641    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-config" (OuterVolumeSpecName: "console-config") pod "e08ea4c1-3793-4c0c-aa87-4d657a597bc1" (UID: "e08ea4c1-3793-4c0c-aa87-4d657a597bc1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:31.247446 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.247412    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-kube-api-access-7h2jn" (OuterVolumeSpecName: "kube-api-access-7h2jn") pod "e08ea4c1-3793-4c0c-aa87-4d657a597bc1" (UID: "e08ea4c1-3793-4c0c-aa87-4d657a597bc1"). InnerVolumeSpecName "kube-api-access-7h2jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:31.247669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.247645    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e08ea4c1-3793-4c0c-aa87-4d657a597bc1" (UID: "e08ea4c1-3793-4c0c-aa87-4d657a597bc1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:31.247669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.247659    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e08ea4c1-3793-4c0c-aa87-4d657a597bc1" (UID: "e08ea4c1-3793-4c0c-aa87-4d657a597bc1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:31.346116 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.346080    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h2jn\" (UniqueName: \"kubernetes.io/projected/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-kube-api-access-7h2jn\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:31.346116 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.346117    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-oauth-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:31.346294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.346132    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-oauth-serving-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:31.346294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.346146    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:31.346294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.346162    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:31.346294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.346174    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08ea4c1-3793-4c0c-aa87-4d657a597bc1-console-serving-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:29:31.946038 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.946000    2573 generic.go:356] "Generic (PLEG): container finished" podID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" containerID="7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f" exitCode=0
Jul 21 16:29:31.946550 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.946049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f5b7f9-l9j95" event={"ID":"e08ea4c1-3793-4c0c-aa87-4d657a597bc1","Type":"ContainerDied","Data":"7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f"}
Jul 21 16:29:31.946550 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.946052    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65f5b7f9-l9j95"
Jul 21 16:29:31.946550 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.946087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65f5b7f9-l9j95" event={"ID":"e08ea4c1-3793-4c0c-aa87-4d657a597bc1","Type":"ContainerDied","Data":"de9da12878e5110a555284c3b03f943fdbcb3ee16e36fb3ec420aa5b274d9531"}
Jul 21 16:29:31.946550 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.946106    2573 scope.go:117] "RemoveContainer" containerID="7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f"
Jul 21 16:29:31.955137 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.955120    2573 scope.go:117] "RemoveContainer" containerID="7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f"
Jul 21 16:29:31.955401 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:29:31.955381    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f\": container with ID starting with 7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f not found: ID does not exist" containerID="7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f"
Jul 21 16:29:31.955495 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.955405    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f"} err="failed to get container status \"7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f\": rpc error: code = NotFound desc = could not find container \"7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f\": container with ID starting with 7bcfd1f99c22d3429b63ee76ad02b94e732870d6adfb3d2ee6fd00bf8ff2958f not found: ID does not exist"
Jul 21 16:29:31.968283 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.968263    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b65f5b7f9-l9j95"]
Jul 21 16:29:31.971950 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:31.971929    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b65f5b7f9-l9j95"]
Jul 21 16:29:32.701077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:32.701036    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" path="/var/lib/kubelet/pods/e08ea4c1-3793-4c0c-aa87-4d657a597bc1/volumes"
Jul 21 16:29:52.518139 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:52.518109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:29:52.520387 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:52.520365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9a824b-a9ae-4e1a-bde8-421045bfebe2-metrics-certs\") pod \"network-metrics-daemon-cp5xk\" (UID: \"cb9a824b-a9ae-4e1a-bde8-421045bfebe2\") " pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:29:52.797016 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:52.796987    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwzzh\""
Jul 21 16:29:52.804297 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:52.804279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp5xk"
Jul 21 16:29:52.937774 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:52.937753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cp5xk"]
Jul 21 16:29:52.940417 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:29:52.940386    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9a824b_a9ae_4e1a_bde8_421045bfebe2.slice/crio-510af0747b3706a674aadcf149aded23a22d27c3bbc3ee1d97ff8cd29a897b03 WatchSource:0}: Error finding container 510af0747b3706a674aadcf149aded23a22d27c3bbc3ee1d97ff8cd29a897b03: Status 404 returned error can't find the container with id 510af0747b3706a674aadcf149aded23a22d27c3bbc3ee1d97ff8cd29a897b03
Jul 21 16:29:53.029371 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:53.029340    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cp5xk" event={"ID":"cb9a824b-a9ae-4e1a-bde8-421045bfebe2","Type":"ContainerStarted","Data":"510af0747b3706a674aadcf149aded23a22d27c3bbc3ee1d97ff8cd29a897b03"}
Jul 21 16:29:55.040178 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:55.040144    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cp5xk" event={"ID":"cb9a824b-a9ae-4e1a-bde8-421045bfebe2","Type":"ContainerStarted","Data":"18e2788dba53abdd7e6eec4d787c6b4a44a99aec7112c17be2a32a1996119ada"}
Jul 21 16:29:55.040539 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:55.040195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cp5xk" event={"ID":"cb9a824b-a9ae-4e1a-bde8-421045bfebe2","Type":"ContainerStarted","Data":"8ee4fd740f516603d773253fc7fe1aef362a9e963b1767da60c8c6d878bc9fe2"}
Jul 21 16:29:55.057703 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:55.057660    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cp5xk" podStartSLOduration=374.903171573 podStartE2EDuration="6m16.057645847s" totalImagesPullingTime="1.154474274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:55.056365003 +0000 UTC m=+376.873044446" watchObservedRunningTime="2026-07-21 16:29:55.057645847 +0000 UTC m=+376.874325289"
Jul 21 16:29:55.288347 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:55.288319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:55.343422 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:55.343365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:57.007276 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:57.007241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:57.061686 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:29:57.061655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:00.536520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:00.536486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:00.591695 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:00.591659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:02.437056 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437021    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7fd4d9cc-pxh52"]
Jul 21 16:30:02.437444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437319    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6" containerName="registry"
Jul 21 16:30:02.437444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437331    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6" containerName="registry"
Jul 21 16:30:02.437444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437342    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" containerName="console"
Jul 21 16:30:02.437444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437348    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" containerName="console"
Jul 21 16:30:02.437444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437397    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="80546c4e-6dbd-4819-a320-7d3d6268f5f6" containerName="registry"
Jul 21 16:30:02.437444 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.437411    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e08ea4c1-3793-4c0c-aa87-4d657a597bc1" containerName="console"
Jul 21 16:30:02.440536 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.440512    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.454809 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.454787    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7fd4d9cc-pxh52"]
Jul 21 16:30:02.498206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.498173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:02.559541 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.559511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:02.596487 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-config\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.596660 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2wl\" (UniqueName: \"kubernetes.io/projected/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-kube-api-access-cc2wl\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.596660 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-serving-cert\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.596660 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-oauth-serving-cert\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.596660 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-service-ca\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.596851 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-trusted-ca-bundle\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.596851 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.596745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-oauth-config\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.697721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.697644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-oauth-config\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.697721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.697684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-config\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.697917 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.697783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2wl\" (UniqueName: \"kubernetes.io/projected/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-kube-api-access-cc2wl\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.697917 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.697817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-serving-cert\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.697917 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.697839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-oauth-serving-cert\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.697917 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.697863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-service-ca\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.698121 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.698014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-trusted-ca-bundle\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.698556 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.698532    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-oauth-serving-cert\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.698556 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.698540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-config\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.698765 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.698620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-service-ca\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.698861 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.698841    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-trusted-ca-bundle\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.700294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.700277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-serving-cert\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.700635 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.700620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-oauth-config\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.705526 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.705499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2wl\" (UniqueName: \"kubernetes.io/projected/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-kube-api-access-cc2wl\") pod \"console-5d7fd4d9cc-pxh52\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") " pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.750580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.750552    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:02.880710 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:02.880642    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7fd4d9cc-pxh52"]
Jul 21 16:30:02.883290 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:30:02.883260    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4bccb7_709c_43e5_8f2e_c39896fbeae2.slice/crio-da6a13d73bf4ab9212027066857183a0c9ab3abd466c3247ffc3fc7a5548e2bb WatchSource:0}: Error finding container da6a13d73bf4ab9212027066857183a0c9ab3abd466c3247ffc3fc7a5548e2bb: Status 404 returned error can't find the container with id da6a13d73bf4ab9212027066857183a0c9ab3abd466c3247ffc3fc7a5548e2bb
Jul 21 16:30:03.076304 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:03.076268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7fd4d9cc-pxh52" event={"ID":"5d4bccb7-709c-43e5-8f2e-c39896fbeae2","Type":"ContainerStarted","Data":"7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24"}
Jul 21 16:30:03.076497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:03.076347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7fd4d9cc-pxh52" event={"ID":"5d4bccb7-709c-43e5-8f2e-c39896fbeae2","Type":"ContainerStarted","Data":"da6a13d73bf4ab9212027066857183a0c9ab3abd466c3247ffc3fc7a5548e2bb"}
Jul 21 16:30:03.097655 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:03.097597    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7fd4d9cc-pxh52" podStartSLOduration=1.097583242 podStartE2EDuration="1.097583242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:03.096851275 +0000 UTC m=+384.913530719" watchObservedRunningTime="2026-07-21 16:30:03.097583242 +0000 UTC m=+384.914262685"
Jul 21 16:30:12.357540 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:12.357503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:12.409714 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:12.409683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:12.751664 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:12.751578    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:12.751664 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:12.751647    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:12.757024 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:12.757003    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:13.120026 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:13.119998    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:30:13.166035 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:13.166007    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b958bb4b6-cbmlm"]
Jul 21 16:30:13.351862 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:13.351826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:13.840219 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:13.840187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:13.941113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:13.941077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:16.760069 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:16.760036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:16.857995 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:16.857965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:38.190748 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.190685    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b958bb4b6-cbmlm" podUID="4dc01d08-43df-4c08-9510-a7b05ce97920" containerName="console" containerID="cri-o://9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d" gracePeriod=15
Jul 21 16:30:38.439193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.439166    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:30:38.576723 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-console-config\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.576940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576771    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-serving-cert\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.576940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576804    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-service-ca\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.576940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztqhn\" (UniqueName: \"kubernetes.io/projected/4dc01d08-43df-4c08-9510-a7b05ce97920-kube-api-access-ztqhn\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.576940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576909    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-oauth-config\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.577147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576952    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-trusted-ca-bundle\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.577147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.576987    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-oauth-serving-cert\") pod \"4dc01d08-43df-4c08-9510-a7b05ce97920\" (UID: \"4dc01d08-43df-4c08-9510-a7b05ce97920\") "
Jul 21 16:30:38.577147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.577091    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-console-config" (OuterVolumeSpecName: "console-config") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:30:38.577347 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.577320    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-service-ca" (OuterVolumeSpecName: "service-ca") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:30:38.577416 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.577346    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-console-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:38.577512 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.577424    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:30:38.577512 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.577452    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:30:38.578941 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.578917    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc01d08-43df-4c08-9510-a7b05ce97920-kube-api-access-ztqhn" (OuterVolumeSpecName: "kube-api-access-ztqhn") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "kube-api-access-ztqhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:30:38.579385 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.579362    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:38.579385 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.579374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4dc01d08-43df-4c08-9510-a7b05ce97920" (UID: "4dc01d08-43df-4c08-9510-a7b05ce97920"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:38.677872 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.677847    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-oauth-serving-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:38.677872 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.677867    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-serving-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:38.677872 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.677877    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:38.678079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.677905    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztqhn\" (UniqueName: \"kubernetes.io/projected/4dc01d08-43df-4c08-9510-a7b05ce97920-kube-api-access-ztqhn\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:38.678079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.677913    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dc01d08-43df-4c08-9510-a7b05ce97920-console-oauth-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:38.678079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:38.677921    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc01d08-43df-4c08-9510-a7b05ce97920-trusted-ca-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:30:39.222544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.222508    2573 generic.go:356] "Generic (PLEG): container finished" podID="4dc01d08-43df-4c08-9510-a7b05ce97920" containerID="9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d" exitCode=0
Jul 21 16:30:39.222544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.222549    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b958bb4b6-cbmlm"
Jul 21 16:30:39.223007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.222552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b958bb4b6-cbmlm" event={"ID":"4dc01d08-43df-4c08-9510-a7b05ce97920","Type":"ContainerDied","Data":"9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d"}
Jul 21 16:30:39.223007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.222653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b958bb4b6-cbmlm" event={"ID":"4dc01d08-43df-4c08-9510-a7b05ce97920","Type":"ContainerDied","Data":"f786e876baa034dda7f74ac1b4d2dd57f634e25eb8d9d633af4e0e5d97dbca30"}
Jul 21 16:30:39.223007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.222672    2573 scope.go:117] "RemoveContainer" containerID="9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d"
Jul 21 16:30:39.230869 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.230859    2573 scope.go:117] "RemoveContainer" containerID="9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d"
Jul 21 16:30:39.231136 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:30:39.231116    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d\": container with ID starting with 9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d not found: ID does not exist" containerID="9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d"
Jul 21 16:30:39.231206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.231148    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d"} err="failed to get container status \"9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d\": rpc error: code = NotFound desc = could not find container \"9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d\": container with ID starting with 9f5c4eaf46938d2f6c6dd80395c798d632c8b2f28d159f3957b2afee6ceb492d not found: ID does not exist"
Jul 21 16:30:39.239483 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.239461    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b958bb4b6-cbmlm"]
Jul 21 16:30:39.244913 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.244879    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b958bb4b6-cbmlm"]
Jul 21 16:30:39.428794 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:39.428763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:40.697982 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:40.697951    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dc01d08-43df-4c08-9510-a7b05ce97920" path="/var/lib/kubelet/pods/4dc01d08-43df-4c08-9510-a7b05ce97920/volumes"
Jul 21 16:30:47.929955 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:47.929920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:48.013087 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:48.013056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:59.568561 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:30:59.568524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:04.338711 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:04.338635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:04.429986 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:04.429952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:05.049378 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.049343    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"]
Jul 21 16:31:05.049648 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.049637    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc01d08-43df-4c08-9510-a7b05ce97920" containerName="console"
Jul 21 16:31:05.049705 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.049650    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc01d08-43df-4c08-9510-a7b05ce97920" containerName="console"
Jul 21 16:31:05.049742 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.049718    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dc01d08-43df-4c08-9510-a7b05ce97920" containerName="console"
Jul 21 16:31:05.052661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.052641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.055602 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.055585    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:31:05.056701 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.056677    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:31:05.056811 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.056707    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j78t2\""
Jul 21 16:31:05.062669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.062644    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"]
Jul 21 16:31:05.183011 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.182978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.183191 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.183030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jf8f\" (UniqueName: \"kubernetes.io/projected/1afe0b50-d90f-44e3-889f-57e06527edba-kube-api-access-7jf8f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.183191 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.183086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.284284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.284245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.284484 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.284340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.284484 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.284390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jf8f\" (UniqueName: \"kubernetes.io/projected/1afe0b50-d90f-44e3-889f-57e06527edba-kube-api-access-7jf8f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.284649 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.284629    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.284713 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.284655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.293477 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.293446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jf8f\" (UniqueName: \"kubernetes.io/projected/1afe0b50-d90f-44e3-889f-57e06527edba-kube-api-access-7jf8f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.361999 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.361929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:05.491543 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:05.491518    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"]
Jul 21 16:31:05.494094 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:31:05.494073    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afe0b50_d90f_44e3_889f_57e06527edba.slice/crio-27b397a1ffbd24cff0943328d03c449d281abf4552c0fc359ca3b076b988c901 WatchSource:0}: Error finding container 27b397a1ffbd24cff0943328d03c449d281abf4552c0fc359ca3b076b988c901: Status 404 returned error can't find the container with id 27b397a1ffbd24cff0943328d03c449d281abf4552c0fc359ca3b076b988c901
Jul 21 16:31:06.338462 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:06.338424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb" event={"ID":"1afe0b50-d90f-44e3-889f-57e06527edba","Type":"ContainerStarted","Data":"27b397a1ffbd24cff0943328d03c449d281abf4552c0fc359ca3b076b988c901"}
Jul 21 16:31:12.369236 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:12.369200    2573 generic.go:356] "Generic (PLEG): container finished" podID="1afe0b50-d90f-44e3-889f-57e06527edba" containerID="409c7c22d723612480dafd9ba30485a88c63b1325bd5ec6191a5071294385a52" exitCode=0
Jul 21 16:31:12.369622 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:12.369291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb" event={"ID":"1afe0b50-d90f-44e3-889f-57e06527edba","Type":"ContainerDied","Data":"409c7c22d723612480dafd9ba30485a88c63b1325bd5ec6191a5071294385a52"}
Jul 21 16:31:16.387215 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:16.387179    2573 generic.go:356] "Generic (PLEG): container finished" podID="1afe0b50-d90f-44e3-889f-57e06527edba" containerID="1724076910a0dee0b6acbe88d6c3c9080049e7ca939b3340c1fd25b94325147a" exitCode=0
Jul 21 16:31:16.387684 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:16.387261    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb" event={"ID":"1afe0b50-d90f-44e3-889f-57e06527edba","Type":"ContainerDied","Data":"1724076910a0dee0b6acbe88d6c3c9080049e7ca939b3340c1fd25b94325147a"}
Jul 21 16:31:24.423520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:24.423487    2573 generic.go:356] "Generic (PLEG): container finished" podID="1afe0b50-d90f-44e3-889f-57e06527edba" containerID="085b680e8df3afd3b106bd1161039d705aaa1b1fc09790babe75d210a2582213" exitCode=0
Jul 21 16:31:24.423937 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:24.423555    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb" event={"ID":"1afe0b50-d90f-44e3-889f-57e06527edba","Type":"ContainerDied","Data":"085b680e8df3afd3b106bd1161039d705aaa1b1fc09790babe75d210a2582213"}
Jul 21 16:31:25.555506 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.555480    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:25.656830 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.656805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jf8f\" (UniqueName: \"kubernetes.io/projected/1afe0b50-d90f-44e3-889f-57e06527edba-kube-api-access-7jf8f\") pod \"1afe0b50-d90f-44e3-889f-57e06527edba\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") "
Jul 21 16:31:25.656990 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.656840    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-util\") pod \"1afe0b50-d90f-44e3-889f-57e06527edba\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") "
Jul 21 16:31:25.656990 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.656936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-bundle\") pod \"1afe0b50-d90f-44e3-889f-57e06527edba\" (UID: \"1afe0b50-d90f-44e3-889f-57e06527edba\") "
Jul 21 16:31:25.657569 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.657541    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-bundle" (OuterVolumeSpecName: "bundle") pod "1afe0b50-d90f-44e3-889f-57e06527edba" (UID: "1afe0b50-d90f-44e3-889f-57e06527edba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:25.658967 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.658943    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1afe0b50-d90f-44e3-889f-57e06527edba-kube-api-access-7jf8f" (OuterVolumeSpecName: "kube-api-access-7jf8f") pod "1afe0b50-d90f-44e3-889f-57e06527edba" (UID: "1afe0b50-d90f-44e3-889f-57e06527edba"). InnerVolumeSpecName "kube-api-access-7jf8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:31:25.660764 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.660742    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-util" (OuterVolumeSpecName: "util") pod "1afe0b50-d90f-44e3-889f-57e06527edba" (UID: "1afe0b50-d90f-44e3-889f-57e06527edba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:25.757613 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.757563    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:31:25.757613 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.757586    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jf8f\" (UniqueName: \"kubernetes.io/projected/1afe0b50-d90f-44e3-889f-57e06527edba-kube-api-access-7jf8f\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:31:25.757613 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:25.757595    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afe0b50-d90f-44e3-889f-57e06527edba-util\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:31:26.433494 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:26.433458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb" event={"ID":"1afe0b50-d90f-44e3-889f-57e06527edba","Type":"ContainerDied","Data":"27b397a1ffbd24cff0943328d03c449d281abf4552c0fc359ca3b076b988c901"}
Jul 21 16:31:26.433494 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:26.433479    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfzsb"
Jul 21 16:31:26.433681 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:26.433505    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27b397a1ffbd24cff0943328d03c449d281abf4552c0fc359ca3b076b988c901"
Jul 21 16:31:31.095575 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:31.095538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:32.109703 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:32.109668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:33.184416 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184385    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"]
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184670    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="extract"
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184679    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="extract"
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="util"
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184695    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="util"
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184704    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="pull"
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184710    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="pull"
Jul 21 16:31:33.184762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.184765    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afe0b50-d90f-44e3-889f-57e06527edba" containerName="extract"
Jul 21 16:31:33.187467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.187453    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.190490 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.190470    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:31:33.190623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.190569    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lv4l9\""
Jul 21 16:31:33.190623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.190601    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 16:31:33.201042 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.201024    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"]
Jul 21 16:31:33.207447 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.207426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksrkw\" (UniqueName: \"kubernetes.io/projected/5d4d3852-dad9-4940-9af4-c416276d82fe-kube-api-access-ksrkw\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmnp2\" (UID: \"5d4d3852-dad9-4940-9af4-c416276d82fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.207566 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.207461    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4d3852-dad9-4940-9af4-c416276d82fe-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmnp2\" (UID: \"5d4d3852-dad9-4940-9af4-c416276d82fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.307795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.307760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksrkw\" (UniqueName: \"kubernetes.io/projected/5d4d3852-dad9-4940-9af4-c416276d82fe-kube-api-access-ksrkw\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmnp2\" (UID: \"5d4d3852-dad9-4940-9af4-c416276d82fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.307944 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.307805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4d3852-dad9-4940-9af4-c416276d82fe-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmnp2\" (UID: \"5d4d3852-dad9-4940-9af4-c416276d82fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.308118 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.308101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4d3852-dad9-4940-9af4-c416276d82fe-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmnp2\" (UID: \"5d4d3852-dad9-4940-9af4-c416276d82fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.316676 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.316656    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksrkw\" (UniqueName: \"kubernetes.io/projected/5d4d3852-dad9-4940-9af4-c416276d82fe-kube-api-access-ksrkw\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmnp2\" (UID: \"5d4d3852-dad9-4940-9af4-c416276d82fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.496690 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.496609    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"
Jul 21 16:31:33.626798 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:33.626770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2"]
Jul 21 16:31:33.630988 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:31:33.630963    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4d3852_dad9_4940_9af4_c416276d82fe.slice/crio-7133fbd75b4e77065933b66e085fe65993e1a07178b16c6c9c19bdafad19b3dc WatchSource:0}: Error finding container 7133fbd75b4e77065933b66e085fe65993e1a07178b16c6c9c19bdafad19b3dc: Status 404 returned error can't find the container with id 7133fbd75b4e77065933b66e085fe65993e1a07178b16c6c9c19bdafad19b3dc
Jul 21 16:31:34.471082 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:34.471051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2" event={"ID":"5d4d3852-dad9-4940-9af4-c416276d82fe","Type":"ContainerStarted","Data":"7133fbd75b4e77065933b66e085fe65993e1a07178b16c6c9c19bdafad19b3dc"}
Jul 21 16:31:35.451202 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:35.451170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:35.549015 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:35.548988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.319699 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:36.319648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.420997 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:36.420967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.480994 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:36.480966    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2" event={"ID":"5d4d3852-dad9-4940-9af4-c416276d82fe","Type":"ContainerStarted","Data":"7681e62d508d58cbc3e3b9e16d260d566383a77f26e77c3761ebb8ff8c43d98c"}
Jul 21 16:31:36.508897 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:36.508841    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmnp2" podStartSLOduration=1.6041390020000001 podStartE2EDuration="3.508826925s" totalImagesPullingTime="1.904687923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:36.505779505 +0000 UTC m=+478.322458959" watchObservedRunningTime="2026-07-21 16:31:36.508826925 +0000 UTC m=+478.325506368"
Jul 21 16:31:36.975989 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:36.975963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:37.123942 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.123910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:37.264937 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.264850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:37.443183 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.443152    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcd9x"]
Jul 21 16:31:37.446624 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.446604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.449728 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.449709    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 16:31:37.449832 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.449707    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 16:31:37.451039 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.451024    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bvnxm\""
Jul 21 16:31:37.456096 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.456077    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcd9x"]
Jul 21 16:31:37.545990 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.545962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ctlc\" (UniqueName: \"kubernetes.io/projected/249ca23d-02a4-4065-a415-a55d70e58afc-kube-api-access-5ctlc\") pod \"cert-manager-webhook-6486ffd997-lcd9x\" (UID: \"249ca23d-02a4-4065-a415-a55d70e58afc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.546106 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.546084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/249ca23d-02a4-4065-a415-a55d70e58afc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcd9x\" (UID: \"249ca23d-02a4-4065-a415-a55d70e58afc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.646427 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.646396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ctlc\" (UniqueName: \"kubernetes.io/projected/249ca23d-02a4-4065-a415-a55d70e58afc-kube-api-access-5ctlc\") pod \"cert-manager-webhook-6486ffd997-lcd9x\" (UID: \"249ca23d-02a4-4065-a415-a55d70e58afc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.646576 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.646445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/249ca23d-02a4-4065-a415-a55d70e58afc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcd9x\" (UID: \"249ca23d-02a4-4065-a415-a55d70e58afc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.655218 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.655189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/249ca23d-02a4-4065-a415-a55d70e58afc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcd9x\" (UID: \"249ca23d-02a4-4065-a415-a55d70e58afc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.655421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.655402    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ctlc\" (UniqueName: \"kubernetes.io/projected/249ca23d-02a4-4065-a415-a55d70e58afc-kube-api-access-5ctlc\") pod \"cert-manager-webhook-6486ffd997-lcd9x\" (UID: \"249ca23d-02a4-4065-a415-a55d70e58afc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.768652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.768621    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:37.901005 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:37.900983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcd9x"]
Jul 21 16:31:37.903061 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:31:37.903032    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod249ca23d_02a4_4065_a415_a55d70e58afc.slice/crio-5bc2d908e836c0bbe85baf2b78e6dfa595b4bc926bdfe339737b92ee0dca3fb0 WatchSource:0}: Error finding container 5bc2d908e836c0bbe85baf2b78e6dfa595b4bc926bdfe339737b92ee0dca3fb0: Status 404 returned error can't find the container with id 5bc2d908e836c0bbe85baf2b78e6dfa595b4bc926bdfe339737b92ee0dca3fb0
Jul 21 16:31:38.490365 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:38.490330    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x" event={"ID":"249ca23d-02a4-4065-a415-a55d70e58afc","Type":"ContainerStarted","Data":"5bc2d908e836c0bbe85baf2b78e6dfa595b4bc926bdfe339737b92ee0dca3fb0"}
Jul 21 16:31:38.644250 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:38.644218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:39.064290 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:39.064227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:41.507147 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:41.507114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x" event={"ID":"249ca23d-02a4-4065-a415-a55d70e58afc","Type":"ContainerStarted","Data":"36fa5aa721941da0bbccfc727e30e08c55d295e6bb322310153d06dbc7c1602f"}
Jul 21 16:31:41.507482 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:41.507234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:41.524254 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:41.524207    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x" podStartSLOduration=1.143701283 podStartE2EDuration="4.524195323s" totalImagesPullingTime="3.38049404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:41.523766488 +0000 UTC m=+483.340445932" watchObservedRunningTime="2026-07-21 16:31:41.524195323 +0000 UTC m=+483.340874765"
Jul 21 16:31:41.691129 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:41.691102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:41.745774 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:41.745752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:45.809710 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:45.809676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:45.878109 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:45.878081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:46.058091 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:46.058058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:47.513588 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.513552    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lcd9x"
Jul 21 16:31:47.558773 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.556482    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grblq"]
Jul 21 16:31:47.561293 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.561112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.564421 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.564395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ls74s\""
Jul 21 16:31:47.567587 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.567565    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grblq"]
Jul 21 16:31:47.628985 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.628952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45071419-59ee-4a54-8643-8ff0e7a329ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-grblq\" (UID: \"45071419-59ee-4a54-8643-8ff0e7a329ee\") " pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.629122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.629010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4tl5\" (UniqueName: \"kubernetes.io/projected/45071419-59ee-4a54-8643-8ff0e7a329ee-kube-api-access-h4tl5\") pod \"cert-manager-55b4d954d5-grblq\" (UID: \"45071419-59ee-4a54-8643-8ff0e7a329ee\") " pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.729899 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.729849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4tl5\" (UniqueName: \"kubernetes.io/projected/45071419-59ee-4a54-8643-8ff0e7a329ee-kube-api-access-h4tl5\") pod \"cert-manager-55b4d954d5-grblq\" (UID: \"45071419-59ee-4a54-8643-8ff0e7a329ee\") " pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.730043 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.729979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45071419-59ee-4a54-8643-8ff0e7a329ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-grblq\" (UID: \"45071419-59ee-4a54-8643-8ff0e7a329ee\") " pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.738817 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.738796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45071419-59ee-4a54-8643-8ff0e7a329ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-grblq\" (UID: \"45071419-59ee-4a54-8643-8ff0e7a329ee\") " pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.739064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.739046    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4tl5\" (UniqueName: \"kubernetes.io/projected/45071419-59ee-4a54-8643-8ff0e7a329ee-kube-api-access-h4tl5\") pod \"cert-manager-55b4d954d5-grblq\" (UID: \"45071419-59ee-4a54-8643-8ff0e7a329ee\") " pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:47.872350 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:47.872321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grblq"
Jul 21 16:31:48.007474 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:48.007450    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grblq"]
Jul 21 16:31:48.009248 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:31:48.009220    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45071419_59ee_4a54_8643_8ff0e7a329ee.slice/crio-7e482725f7a3df7f32d76fc3ff166c294f101f0a4512dee2a23b7c7c2e840879 WatchSource:0}: Error finding container 7e482725f7a3df7f32d76fc3ff166c294f101f0a4512dee2a23b7c7c2e840879: Status 404 returned error can't find the container with id 7e482725f7a3df7f32d76fc3ff166c294f101f0a4512dee2a23b7c7c2e840879
Jul 21 16:31:48.537451 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:48.537420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grblq" event={"ID":"45071419-59ee-4a54-8643-8ff0e7a329ee","Type":"ContainerStarted","Data":"d543fbb08e3b4e664b91a633a8c7695ef394dac501a564408c6eca82235fc11e"}
Jul 21 16:31:48.537810 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:48.537459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grblq" event={"ID":"45071419-59ee-4a54-8643-8ff0e7a329ee","Type":"ContainerStarted","Data":"7e482725f7a3df7f32d76fc3ff166c294f101f0a4512dee2a23b7c7c2e840879"}
Jul 21 16:31:48.555317 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:31:48.555272    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-grblq" podStartSLOduration=1.5552595550000001 podStartE2EDuration="1.555259555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:48.553737896 +0000 UTC m=+490.370417360" watchObservedRunningTime="2026-07-21 16:31:48.555259555 +0000 UTC m=+490.371938998"
Jul 21 16:32:01.600206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:01.600173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:01.698832 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:01.698799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:03.317075 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.317038    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"]
Jul 21 16:32:03.320125 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.320109    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.322626 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.322608    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:32:03.323923 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.323908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-x9dnw\""
Jul 21 16:32:03.323988 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.323908    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 16:32:03.328082 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.328058    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"]
Jul 21 16:32:03.447866 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.447839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ed8fc3-2aeb-4198-8963-7db3fe971ad6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hsc95\" (UID: \"73ed8fc3-2aeb-4198-8963-7db3fe971ad6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.447991 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.447915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srt86\" (UniqueName: \"kubernetes.io/projected/73ed8fc3-2aeb-4198-8963-7db3fe971ad6-kube-api-access-srt86\") pod \"openshift-lws-operator-fd8ccff4c-hsc95\" (UID: \"73ed8fc3-2aeb-4198-8963-7db3fe971ad6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.548623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.548595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ed8fc3-2aeb-4198-8963-7db3fe971ad6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hsc95\" (UID: \"73ed8fc3-2aeb-4198-8963-7db3fe971ad6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.548752 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.548651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srt86\" (UniqueName: \"kubernetes.io/projected/73ed8fc3-2aeb-4198-8963-7db3fe971ad6-kube-api-access-srt86\") pod \"openshift-lws-operator-fd8ccff4c-hsc95\" (UID: \"73ed8fc3-2aeb-4198-8963-7db3fe971ad6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.549002 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.548973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ed8fc3-2aeb-4198-8963-7db3fe971ad6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hsc95\" (UID: \"73ed8fc3-2aeb-4198-8963-7db3fe971ad6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.560485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.560457    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srt86\" (UniqueName: \"kubernetes.io/projected/73ed8fc3-2aeb-4198-8963-7db3fe971ad6-kube-api-access-srt86\") pod \"openshift-lws-operator-fd8ccff4c-hsc95\" (UID: \"73ed8fc3-2aeb-4198-8963-7db3fe971ad6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.631023 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.630967    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"
Jul 21 16:32:03.758294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:03.758270    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95"]
Jul 21 16:32:03.760291 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:32:03.760260    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73ed8fc3_2aeb_4198_8963_7db3fe971ad6.slice/crio-7fab4bd8a2ab817a5718918444f486f2e400efd9f06ac4bdf85b798a4fed5069 WatchSource:0}: Error finding container 7fab4bd8a2ab817a5718918444f486f2e400efd9f06ac4bdf85b798a4fed5069: Status 404 returned error can't find the container with id 7fab4bd8a2ab817a5718918444f486f2e400efd9f06ac4bdf85b798a4fed5069
Jul 21 16:32:04.609720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:04.609678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95" event={"ID":"73ed8fc3-2aeb-4198-8963-7db3fe971ad6","Type":"ContainerStarted","Data":"7fab4bd8a2ab817a5718918444f486f2e400efd9f06ac4bdf85b798a4fed5069"}
Jul 21 16:32:10.639610 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:10.639570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95" event={"ID":"73ed8fc3-2aeb-4198-8963-7db3fe971ad6","Type":"ContainerStarted","Data":"5a6ddde41e89ab286b33b46deca90ed7d2531efac70a336bd87fa7727215de84"}
Jul 21 16:32:10.657858 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:10.657809    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hsc95" podStartSLOduration=1.425478053 podStartE2EDuration="7.657796605s" totalImagesPullingTime="6.232318552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:10.657003468 +0000 UTC m=+512.473682913" watchObservedRunningTime="2026-07-21 16:32:10.657796605 +0000 UTC m=+512.474476048"
Jul 21 16:32:11.381306 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:11.381271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:11.475414 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:11.475386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:13.051413 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.051382    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"]
Jul 21 16:32:13.054987 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.054970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.057984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.057952    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:32:13.057984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.057966    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:32:13.058244 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.058229    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j78t2\""
Jul 21 16:32:13.064211 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.064188    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"]
Jul 21 16:32:13.165721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.165694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:13.225098 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.225065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.225260 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.225213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.225260 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.225249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpsgx\" (UniqueName: \"kubernetes.io/projected/0df1bdfd-8827-46bc-bc59-066aeb6e7645-kube-api-access-kpsgx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.326438 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.326361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.326573 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.326442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.326573 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.326471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpsgx\" (UniqueName: \"kubernetes.io/projected/0df1bdfd-8827-46bc-bc59-066aeb6e7645-kube-api-access-kpsgx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.326741 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.326719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.326811 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.326794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.335087 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.335066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpsgx\" (UniqueName: \"kubernetes.io/projected/0df1bdfd-8827-46bc-bc59-066aeb6e7645-kube-api-access-kpsgx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.364012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.363992    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:13.493139 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.493103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"]
Jul 21 16:32:13.495344 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:32:13.495321    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df1bdfd_8827_46bc_bc59_066aeb6e7645.slice/crio-844e9cecee32af7f173b0af86b7373b323de9047be58855e51d90da5adffffdb WatchSource:0}: Error finding container 844e9cecee32af7f173b0af86b7373b323de9047be58855e51d90da5adffffdb: Status 404 returned error can't find the container with id 844e9cecee32af7f173b0af86b7373b323de9047be58855e51d90da5adffffdb
Jul 21 16:32:13.654678 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.654651    2573 generic.go:356] "Generic (PLEG): container finished" podID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerID="416bbd4676901d5980db220568ba6cfdc5677356568a526984b137f8fe4f5c37" exitCode=0
Jul 21 16:32:13.654804 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.654706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr" event={"ID":"0df1bdfd-8827-46bc-bc59-066aeb6e7645","Type":"ContainerDied","Data":"416bbd4676901d5980db220568ba6cfdc5677356568a526984b137f8fe4f5c37"}
Jul 21 16:32:13.654804 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:13.654756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr" event={"ID":"0df1bdfd-8827-46bc-bc59-066aeb6e7645","Type":"ContainerStarted","Data":"844e9cecee32af7f173b0af86b7373b323de9047be58855e51d90da5adffffdb"}
Jul 21 16:32:14.660716 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:14.660651    2573 generic.go:356] "Generic (PLEG): container finished" podID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerID="54aa3f19c1efe1c5cb3b2136585a3cfa14fa1bf139a58c4c77920d856e1bb840" exitCode=0
Jul 21 16:32:14.661106 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:14.660727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr" event={"ID":"0df1bdfd-8827-46bc-bc59-066aeb6e7645","Type":"ContainerDied","Data":"54aa3f19c1efe1c5cb3b2136585a3cfa14fa1bf139a58c4c77920d856e1bb840"}
Jul 21 16:32:15.667510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:15.667472    2573 generic.go:356] "Generic (PLEG): container finished" podID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerID="452dab7142791308eefcfeb9b7160d7548e1e349629a9c43d04780cd92d43c77" exitCode=0
Jul 21 16:32:15.667510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:15.667506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr" event={"ID":"0df1bdfd-8827-46bc-bc59-066aeb6e7645","Type":"ContainerDied","Data":"452dab7142791308eefcfeb9b7160d7548e1e349629a9c43d04780cd92d43c77"}
Jul 21 16:32:16.803910 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.803873    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:16.956190 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.956127    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpsgx\" (UniqueName: \"kubernetes.io/projected/0df1bdfd-8827-46bc-bc59-066aeb6e7645-kube-api-access-kpsgx\") pod \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") "
Jul 21 16:32:16.956190 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.956170    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-util\") pod \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") "
Jul 21 16:32:16.956340 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.956215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-bundle\") pod \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\" (UID: \"0df1bdfd-8827-46bc-bc59-066aeb6e7645\") "
Jul 21 16:32:16.956919 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.956872    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-bundle" (OuterVolumeSpecName: "bundle") pod "0df1bdfd-8827-46bc-bc59-066aeb6e7645" (UID: "0df1bdfd-8827-46bc-bc59-066aeb6e7645"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:16.958166 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.958142    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df1bdfd-8827-46bc-bc59-066aeb6e7645-kube-api-access-kpsgx" (OuterVolumeSpecName: "kube-api-access-kpsgx") pod "0df1bdfd-8827-46bc-bc59-066aeb6e7645" (UID: "0df1bdfd-8827-46bc-bc59-066aeb6e7645"). InnerVolumeSpecName "kube-api-access-kpsgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:16.962337 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:16.962313    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-util" (OuterVolumeSpecName: "util") pod "0df1bdfd-8827-46bc-bc59-066aeb6e7645" (UID: "0df1bdfd-8827-46bc-bc59-066aeb6e7645"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:17.056790 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.056756    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpsgx\" (UniqueName: \"kubernetes.io/projected/0df1bdfd-8827-46bc-bc59-066aeb6e7645-kube-api-access-kpsgx\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:32:17.056790 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.056783    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-util\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:32:17.056979 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.056798    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0df1bdfd-8827-46bc-bc59-066aeb6e7645-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:32:17.408170 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408139    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"]
Jul 21 16:32:17.408446 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408435    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="extract"
Jul 21 16:32:17.408489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408448    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="extract"
Jul 21 16:32:17.408489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408461    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="util"
Jul 21 16:32:17.408489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408466    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="util"
Jul 21 16:32:17.408489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408483    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="pull"
Jul 21 16:32:17.408489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408488    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="pull"
Jul 21 16:32:17.408632 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.408544    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df1bdfd-8827-46bc-bc59-066aeb6e7645" containerName="extract"
Jul 21 16:32:17.411315 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.411300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.414761 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.414736    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 16:32:17.414761 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.414761    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 16:32:17.416302 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.416285    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cdt8l\""
Jul 21 16:32:17.416415 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.416317    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 16:32:17.419540 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.419523    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"]
Jul 21 16:32:17.560666 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.560640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c25bf65-c359-4bb4-8292-f67824013ee2-metrics-cert\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.560795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.560681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c25bf65-c359-4bb4-8292-f67824013ee2-cert\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.560795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.560749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c25bf65-c359-4bb4-8292-f67824013ee2-manager-config\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.560870 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.560797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28wwm\" (UniqueName: \"kubernetes.io/projected/6c25bf65-c359-4bb4-8292-f67824013ee2-kube-api-access-28wwm\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.628156 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.628135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:17.661851 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.661790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28wwm\" (UniqueName: \"kubernetes.io/projected/6c25bf65-c359-4bb4-8292-f67824013ee2-kube-api-access-28wwm\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.661851 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.661824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c25bf65-c359-4bb4-8292-f67824013ee2-metrics-cert\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.662041 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.661855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c25bf65-c359-4bb4-8292-f67824013ee2-cert\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.662041 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.661952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c25bf65-c359-4bb4-8292-f67824013ee2-manager-config\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.662576 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.662557    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c25bf65-c359-4bb4-8292-f67824013ee2-manager-config\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.664363 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.664337    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c25bf65-c359-4bb4-8292-f67824013ee2-cert\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.664363 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.664352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c25bf65-c359-4bb4-8292-f67824013ee2-metrics-cert\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.678820 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.678804    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr"
Jul 21 16:32:17.678922 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.678810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afplbrr" event={"ID":"0df1bdfd-8827-46bc-bc59-066aeb6e7645","Type":"ContainerDied","Data":"844e9cecee32af7f173b0af86b7373b323de9047be58855e51d90da5adffffdb"}
Jul 21 16:32:17.678922 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.678857    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="844e9cecee32af7f173b0af86b7373b323de9047be58855e51d90da5adffffdb"
Jul 21 16:32:17.680191 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.680172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28wwm\" (UniqueName: \"kubernetes.io/projected/6c25bf65-c359-4bb4-8292-f67824013ee2-kube-api-access-28wwm\") pod \"lws-controller-manager-76d8f8b6b-nd8p2\" (UID: \"6c25bf65-c359-4bb4-8292-f67824013ee2\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.720975 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.720953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:17.733996 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.733975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:17.851753 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:17.851733    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"]
Jul 21 16:32:17.853576 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:32:17.853551    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c25bf65_c359_4bb4_8292_f67824013ee2.slice/crio-ef74bfa84761fa7f81c28b4a35445f09d967522a1c8b4f92b5351931ad6219ad WatchSource:0}: Error finding container ef74bfa84761fa7f81c28b4a35445f09d967522a1c8b4f92b5351931ad6219ad: Status 404 returned error can't find the container with id ef74bfa84761fa7f81c28b4a35445f09d967522a1c8b4f92b5351931ad6219ad
Jul 21 16:32:18.684872 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:18.684831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2" event={"ID":"6c25bf65-c359-4bb4-8292-f67824013ee2","Type":"ContainerStarted","Data":"ef74bfa84761fa7f81c28b4a35445f09d967522a1c8b4f92b5351931ad6219ad"}
Jul 21 16:32:19.691548 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:19.691471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2" event={"ID":"6c25bf65-c359-4bb4-8292-f67824013ee2","Type":"ContainerStarted","Data":"8d89c5d3430909667150d05452f3231508a7f6ebf49640b6603ad6ee0a2a71f6"}
Jul 21 16:32:19.691943 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:19.691609    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:19.712658 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:19.712615    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2" podStartSLOduration=1.226934445 podStartE2EDuration="2.712600312s" totalImagesPullingTime="1.485665867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:19.71070972 +0000 UTC m=+521.527389174" watchObservedRunningTime="2026-07-21 16:32:19.712600312 +0000 UTC m=+521.529279755"
Jul 21 16:32:25.981851 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:25.981818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:26.088064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.088031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:26.592490 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.592448    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:26.810629 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.810594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:26.915029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.914956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:26.977114 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.977089    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"]
Jul 21 16:32:26.980717 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.980701    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:26.984079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.984061    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 16:32:26.984391 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.984066    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 16:32:26.984391 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.984136    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 16:32:26.985157 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.985140    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jfczg\""
Jul 21 16:32:26.985297 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:26.985284    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 16:32:27.027658 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.027635    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"]
Jul 21 16:32:27.030667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.030647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dtdb\" (UniqueName: \"kubernetes.io/projected/43977ce1-ca4b-4806-9a06-a56b269cf3e7-kube-api-access-5dtdb\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.030805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.030675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43977ce1-ca4b-4806-9a06-a56b269cf3e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.030805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.030699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43977ce1-ca4b-4806-9a06-a56b269cf3e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.030938 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.030820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43977ce1-ca4b-4806-9a06-a56b269cf3e7-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.030938 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.030860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43977ce1-ca4b-4806-9a06-a56b269cf3e7-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.131544 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.131517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dtdb\" (UniqueName: \"kubernetes.io/projected/43977ce1-ca4b-4806-9a06-a56b269cf3e7-kube-api-access-5dtdb\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.131639 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.131550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43977ce1-ca4b-4806-9a06-a56b269cf3e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.131639 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.131570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43977ce1-ca4b-4806-9a06-a56b269cf3e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.131639 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.131619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43977ce1-ca4b-4806-9a06-a56b269cf3e7-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.131766 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.131649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43977ce1-ca4b-4806-9a06-a56b269cf3e7-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.132084 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.132057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43977ce1-ca4b-4806-9a06-a56b269cf3e7-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.134179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.134155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43977ce1-ca4b-4806-9a06-a56b269cf3e7-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.134370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.134349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43977ce1-ca4b-4806-9a06-a56b269cf3e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.134417 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.134352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43977ce1-ca4b-4806-9a06-a56b269cf3e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.144045 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.144024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dtdb\" (UniqueName: \"kubernetes.io/projected/43977ce1-ca4b-4806-9a06-a56b269cf3e7-kube-api-access-5dtdb\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-wd554\" (UID: \"43977ce1-ca4b-4806-9a06-a56b269cf3e7\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.188919 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.188862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.290393 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.290372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:27.294208 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.294189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.390188 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.390160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.423270 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.423249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"]
Jul 21 16:32:27.425076 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:32:27.425052    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43977ce1_ca4b_4806_9a06_a56b269cf3e7.slice/crio-49f3c59f2af24d93f95b11d641aacb72564abbb082fefd75f29e7af363000195 WatchSource:0}: Error finding container 49f3c59f2af24d93f95b11d641aacb72564abbb082fefd75f29e7af363000195: Status 404 returned error can't find the container with id 49f3c59f2af24d93f95b11d641aacb72564abbb082fefd75f29e7af363000195
Jul 21 16:32:27.486918 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.486837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.556201 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.556179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.656603 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.656576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.729548 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.729515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554" event={"ID":"43977ce1-ca4b-4806-9a06-a56b269cf3e7","Type":"ContainerStarted","Data":"49f3c59f2af24d93f95b11d641aacb72564abbb082fefd75f29e7af363000195"}
Jul 21 16:32:27.755979 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:27.755922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:30.700566 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:30.700494    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-nd8p2"
Jul 21 16:32:30.747753 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:30.747721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554" event={"ID":"43977ce1-ca4b-4806-9a06-a56b269cf3e7","Type":"ContainerStarted","Data":"8650ab0140902d7121c730beb7e264a3d6a6b202423e4f91bad3587dd2a2c002"}
Jul 21 16:32:31.327804 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:31.327770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:31.428412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:31.428379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:31.754409 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:31.754337    2573 generic.go:356] "Generic (PLEG): container finished" podID="43977ce1-ca4b-4806-9a06-a56b269cf3e7" containerID="8650ab0140902d7121c730beb7e264a3d6a6b202423e4f91bad3587dd2a2c002" exitCode=0
Jul 21 16:32:31.754409 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:31.754397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554" event={"ID":"43977ce1-ca4b-4806-9a06-a56b269cf3e7","Type":"ContainerDied","Data":"8650ab0140902d7121c730beb7e264a3d6a6b202423e4f91bad3587dd2a2c002"}
Jul 21 16:32:32.762072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:32.762038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554" event={"ID":"43977ce1-ca4b-4806-9a06-a56b269cf3e7","Type":"ContainerStarted","Data":"79475b949eb7567172a484a1724910890578a0b9853f39a35f0ac3d1420782ae"}
Jul 21 16:32:32.762436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:32.762156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:32.786232 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:32.786183    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554" podStartSLOduration=2.481721325 podStartE2EDuration="6.786168649s" totalImagesPullingTime="3.275487909s" totalInitContainerRuntime="1.028959415s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:32.783802141 +0000 UTC m=+534.600481586" watchObservedRunningTime="2026-07-21 16:32:32.786168649 +0000 UTC m=+534.602848091"
Jul 21 16:32:43.768698 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:43.768665    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-wd554"
Jul 21 16:32:46.116470 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:46.116434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:46.249034 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:46.248997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.031707 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:47.031660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.157426 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:47.157385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.260011 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:47.259965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.419306 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:47.419277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.706445 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:47.706360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.999873 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:47.999787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:56.069588 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:56.069552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:56.168821 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:56.168773    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:56.318031 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:56.318003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:56.456484 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:56.456377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:56.554823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:56.554766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:57.120978 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:57.120948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:57.349683 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:57.349646    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:59.183431 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:59.183378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:59.293963 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:32:59.293931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:00.503412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:00.503379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:03.909852 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:03.909818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:04.015661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.015630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:04.208323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.208247    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"]
Jul 21 16:33:04.215443 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.215422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.218582 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.218567    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-j5j9q\""
Jul 21 16:33:04.218662 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.218570    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 16:33:04.226046 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.226025    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"]
Jul 21 16:33:04.232609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.232585    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:04.332799 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.332765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:04.349614 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349736 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01298b2d-d29f-46b4-921f-ebd4732cb228-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349736 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349827 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349827 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349776    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349827 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfgf\" (UniqueName: \"kubernetes.io/projected/01298b2d-d29f-46b4-921f-ebd4732cb228-kube-api-access-ktfgf\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349972 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.349972 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.350044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.349987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.450818 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.450786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.450818 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.450817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451033 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.450842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfgf\" (UniqueName: \"kubernetes.io/projected/01298b2d-d29f-46b4-921f-ebd4732cb228-kube-api-access-ktfgf\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451033 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.450867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451139 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451292 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01298b2d-d29f-46b4-921f-ebd4732cb228-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451292 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451435 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451415    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451507 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451488    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451566 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451516    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.451677 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.452008 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.451985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01298b2d-d29f-46b4-921f-ebd4732cb228-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.453215 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.453197    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.453285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.453268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.455142 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.455118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:04.459020 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.458973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01298b2d-d29f-46b4-921f-ebd4732cb228-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.459280 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.459263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfgf\" (UniqueName: \"kubernetes.io/projected/01298b2d-d29f-46b4-921f-ebd4732cb228-kube-api-access-ktfgf\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678jd96m\" (UID: \"01298b2d-d29f-46b4-921f-ebd4732cb228\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.528428 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.528404    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:04.674481 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.674456    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"]
Jul 21 16:33:04.676194 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:33:04.676167    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01298b2d_d29f_46b4_921f_ebd4732cb228.slice/crio-19ed15289e77c1197e1fef22f63ca9d3755a34d527a4fe440415856f7854a0bc WatchSource:0}: Error finding container 19ed15289e77c1197e1fef22f63ca9d3755a34d527a4fe440415856f7854a0bc: Status 404 returned error can't find the container with id 19ed15289e77c1197e1fef22f63ca9d3755a34d527a4fe440415856f7854a0bc
Jul 21 16:33:04.916687 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:04.916657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m" event={"ID":"01298b2d-d29f-46b4-921f-ebd4732cb228","Type":"ContainerStarted","Data":"19ed15289e77c1197e1fef22f63ca9d3755a34d527a4fe440415856f7854a0bc"}
Jul 21 16:33:08.820164 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:08.820118    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:33:08.820455 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:08.820198    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:33:08.820455 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:08.820231    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:33:08.940625 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:08.940586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m" event={"ID":"01298b2d-d29f-46b4-921f-ebd4732cb228","Type":"ContainerStarted","Data":"c6949215a1ed8f5652909f38689b7e696b670c9a0ebc9733afe8c0fdebdfe5db"}
Jul 21 16:33:08.968641 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:08.968588    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m" podStartSLOduration=0.827035943 podStartE2EDuration="4.96857386s" totalImagesPullingTime="4.141537917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:08.967205186 +0000 UTC m=+570.783884628" watchObservedRunningTime="2026-07-21 16:33:08.96857386 +0000 UTC m=+570.785253303"
Jul 21 16:33:09.529094 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:09.529055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:09.533586 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:09.533562    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:09.945623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:09.945596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:09.946505 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:09.946485    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678jd96m"
Jul 21 16:33:18.922532 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:18.922502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:38.633941 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:38.633910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:33:38.635537 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:38.635517    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:33:47.550049 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.549999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:47.726914 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.726869    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tlt2k"]
Jul 21 16:33:47.730649 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.730623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:47.733687 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.733663    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:33:47.733798 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.733714    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:33:47.735066 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.735046    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-f9glg\""
Jul 21 16:33:47.740254 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.740231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tlt2k"]
Jul 21 16:33:47.799378 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.799353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56bk7\" (UniqueName: \"kubernetes.io/projected/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40-kube-api-access-56bk7\") pod \"kuadrant-operator-catalog-tlt2k\" (UID: \"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40\") " pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:47.899923 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.899850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56bk7\" (UniqueName: \"kubernetes.io/projected/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40-kube-api-access-56bk7\") pod \"kuadrant-operator-catalog-tlt2k\" (UID: \"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40\") " pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:47.908694 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:47.908667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56bk7\" (UniqueName: \"kubernetes.io/projected/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40-kube-api-access-56bk7\") pod \"kuadrant-operator-catalog-tlt2k\" (UID: \"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40\") " pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:48.043688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.043660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:48.174106 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.174084    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tlt2k"]
Jul 21 16:33:48.176391 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:33:48.176364    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde4d939_66fb_4c7b_a42c_cfeac5ba3b40.slice/crio-c83e3b963c17fd9a3d1c0e26bd274a31c750030e4d110f480ac88c58b2f0b7d2 WatchSource:0}: Error finding container c83e3b963c17fd9a3d1c0e26bd274a31c750030e4d110f480ac88c58b2f0b7d2: Status 404 returned error can't find the container with id c83e3b963c17fd9a3d1c0e26bd274a31c750030e4d110f480ac88c58b2f0b7d2
Jul 21 16:33:48.177655 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.177634    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:33:48.369984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.369957    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tlt2k"]
Jul 21 16:33:48.399261 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.399240    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ns92n"]
Jul 21 16:33:48.404157 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.404143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:48.413629 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.413609    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ns92n"]
Jul 21 16:33:48.505276 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.505218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25wb9\" (UniqueName: \"kubernetes.io/projected/eedaae06-fe13-4d7f-b74d-b741c798ab8c-kube-api-access-25wb9\") pod \"kuadrant-operator-catalog-ns92n\" (UID: \"eedaae06-fe13-4d7f-b74d-b741c798ab8c\") " pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:48.605669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.605645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25wb9\" (UniqueName: \"kubernetes.io/projected/eedaae06-fe13-4d7f-b74d-b741c798ab8c-kube-api-access-25wb9\") pod \"kuadrant-operator-catalog-ns92n\" (UID: \"eedaae06-fe13-4d7f-b74d-b741c798ab8c\") " pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:48.615110 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.615085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25wb9\" (UniqueName: \"kubernetes.io/projected/eedaae06-fe13-4d7f-b74d-b741c798ab8c-kube-api-access-25wb9\") pod \"kuadrant-operator-catalog-ns92n\" (UID: \"eedaae06-fe13-4d7f-b74d-b741c798ab8c\") " pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:48.713703 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.713686    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:48.852599 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.852544    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ns92n"]
Jul 21 16:33:48.886716 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:33:48.886689    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedaae06_fe13_4d7f_b74d_b741c798ab8c.slice/crio-4e5cb9dd9cbdc58d8fe7dc3a1971a647eb66afb476850b4523cc60d2e4bc6e2f WatchSource:0}: Error finding container 4e5cb9dd9cbdc58d8fe7dc3a1971a647eb66afb476850b4523cc60d2e4bc6e2f: Status 404 returned error can't find the container with id 4e5cb9dd9cbdc58d8fe7dc3a1971a647eb66afb476850b4523cc60d2e4bc6e2f
Jul 21 16:33:48.947427 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:48.947216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:49.134757 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:49.134721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ns92n" event={"ID":"eedaae06-fe13-4d7f-b74d-b741c798ab8c","Type":"ContainerStarted","Data":"4e5cb9dd9cbdc58d8fe7dc3a1971a647eb66afb476850b4523cc60d2e4bc6e2f"}
Jul 21 16:33:49.135999 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:49.135969    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k" event={"ID":"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40","Type":"ContainerStarted","Data":"c83e3b963c17fd9a3d1c0e26bd274a31c750030e4d110f480ac88c58b2f0b7d2"}
Jul 21 16:33:51.148938 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.148903    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k" podUID="dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" containerName="registry-server" containerID="cri-o://0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6" gracePeriod=2
Jul 21 16:33:51.149438 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.148911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k" event={"ID":"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40","Type":"ContainerStarted","Data":"0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6"}
Jul 21 16:33:51.150569 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.150541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ns92n" event={"ID":"eedaae06-fe13-4d7f-b74d-b741c798ab8c","Type":"ContainerStarted","Data":"1e278f9ac834fecad577bf4a7a2de0f6017662e10fd537b571e5d45bada9f874"}
Jul 21 16:33:51.163483 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.163428    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k" podStartSLOduration=1.8740131039999999 podStartE2EDuration="4.163414225s" totalImagesPullingTime="2.289401121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:51.16312702 +0000 UTC m=+612.979806465" watchObservedRunningTime="2026-07-21 16:33:51.163414225 +0000 UTC m=+612.980093669"
Jul 21 16:33:51.180419 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.180382    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ns92n" podStartSLOduration=1.605685975 podStartE2EDuration="3.180365549s" totalImagesPullingTime="1.574679574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:51.179457636 +0000 UTC m=+612.996137078" watchObservedRunningTime="2026-07-21 16:33:51.180365549 +0000 UTC m=+612.997044992"
Jul 21 16:33:51.387642 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.387618    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:51.534698 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.534676    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56bk7\" (UniqueName: \"kubernetes.io/projected/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40-kube-api-access-56bk7\") pod \"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40\" (UID: \"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40\") "
Jul 21 16:33:51.536750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.536726    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40-kube-api-access-56bk7" (OuterVolumeSpecName: "kube-api-access-56bk7") pod "dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" (UID: "dde4d939-66fb-4c7b-a42c-cfeac5ba3b40"). InnerVolumeSpecName "kube-api-access-56bk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:51.635938 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:51.635913    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56bk7\" (UniqueName: \"kubernetes.io/projected/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40-kube-api-access-56bk7\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:33:52.156555 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.156520    2573 generic.go:356] "Generic (PLEG): container finished" podID="dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" containerID="0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6" exitCode=0
Jul 21 16:33:52.156985 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.156568    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k"
Jul 21 16:33:52.156985 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.156612    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k" event={"ID":"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40","Type":"ContainerDied","Data":"0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6"}
Jul 21 16:33:52.156985 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.156663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tlt2k" event={"ID":"dde4d939-66fb-4c7b-a42c-cfeac5ba3b40","Type":"ContainerDied","Data":"c83e3b963c17fd9a3d1c0e26bd274a31c750030e4d110f480ac88c58b2f0b7d2"}
Jul 21 16:33:52.156985 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.156683    2573 scope.go:117] "RemoveContainer" containerID="0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6"
Jul 21 16:33:52.165972 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.165954    2573 scope.go:117] "RemoveContainer" containerID="0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6"
Jul 21 16:33:52.166239 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:33:52.166221    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6\": container with ID starting with 0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6 not found: ID does not exist" containerID="0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6"
Jul 21 16:33:52.166300 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.166247    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6"} err="failed to get container status \"0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6\": rpc error: code = NotFound desc = could not find container \"0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6\": container with ID starting with 0dc95ffc3beb2fdd93db141a143b29b71ed89f7f04714764a9586bc4b18fdbf6 not found: ID does not exist"
Jul 21 16:33:52.178844 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.178824    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tlt2k"]
Jul 21 16:33:52.180585 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.180567    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tlt2k"]
Jul 21 16:33:52.698560 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:52.698528    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" path="/var/lib/kubelet/pods/dde4d939-66fb-4c7b-a42c-cfeac5ba3b40/volumes"
Jul 21 16:33:58.714439 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:58.714413    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:58.714838 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:58.714496    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:58.736651 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:58.736628    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:33:59.221683 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:33:59.221654    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ns92n"
Jul 21 16:34:04.088500 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.088414    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"]
Jul 21 16:34:04.088947 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.088915    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" containerName="registry-server"
Jul 21 16:34:04.089020 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.088934    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" containerName="registry-server"
Jul 21 16:34:04.089105 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.089091    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde4d939-66fb-4c7b-a42c-cfeac5ba3b40" containerName="registry-server"
Jul 21 16:34:04.092222 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.092201    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.095077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.095058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6hx\""
Jul 21 16:34:04.099871 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.099850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"]
Jul 21 16:34:04.239738 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.239714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngg6\" (UniqueName: \"kubernetes.io/projected/4e714eb7-5d46-48cb-86a6-812d1821276a-kube-api-access-sngg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.239858 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.239748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.239858 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.239791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.341040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.340975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.341040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.341028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.341164 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.341090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sngg6\" (UniqueName: \"kubernetes.io/projected/4e714eb7-5d46-48cb-86a6-812d1821276a-kube-api-access-sngg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.341338 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.341322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.341393 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.341374    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.350423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.350398    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngg6\" (UniqueName: \"kubernetes.io/projected/4e714eb7-5d46-48cb-86a6-812d1821276a-kube-api-access-sngg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.402263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.402240    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:04.527926 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.527900    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"]
Jul 21 16:34:04.529433 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:04.529407    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e714eb7_5d46_48cb_86a6_812d1821276a.slice/crio-763ed6f0feb414a853adc1075272beca6c3b30f8b157f3e174a20ac302406c5d WatchSource:0}: Error finding container 763ed6f0feb414a853adc1075272beca6c3b30f8b157f3e174a20ac302406c5d: Status 404 returned error can't find the container with id 763ed6f0feb414a853adc1075272beca6c3b30f8b157f3e174a20ac302406c5d
Jul 21 16:34:04.686841 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.686817    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"]
Jul 21 16:34:04.690463 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.690445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.700130 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.700112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"]
Jul 21 16:34:04.846159 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.846132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.846254 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.846163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.846254 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.846187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbf49\" (UniqueName: \"kubernetes.io/projected/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-kube-api-access-tbf49\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.947072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.947005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.947072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.947035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.947072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.947056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbf49\" (UniqueName: \"kubernetes.io/projected/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-kube-api-access-tbf49\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.947372 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.947351    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.947438 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.947399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:04.956216 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:04.956195    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbf49\" (UniqueName: \"kubernetes.io/projected/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-kube-api-access-tbf49\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:05.000297 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.000270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:05.093127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.093091    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"]
Jul 21 16:34:05.097991 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.097968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.104323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.103347    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"]
Jul 21 16:34:05.135990 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.135863    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"]
Jul 21 16:34:05.229660 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.229627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94" event={"ID":"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e","Type":"ContainerStarted","Data":"80bb8e8e631bbb28b8f601dfd054f7877e417ff3ba7c22fea1588f49fba10a1f"}
Jul 21 16:34:05.229766 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.229690    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94" event={"ID":"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e","Type":"ContainerStarted","Data":"9e30a52ef22510ba6a64276abb8e04a65a395089f9bdb7b887dd424dca103f16"}
Jul 21 16:34:05.231505 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.231481    2573 generic.go:356] "Generic (PLEG): container finished" podID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerID="4e33fc2a17e145c0f821382c36c58ff802248e76e3141429fada9955d8f61453" exitCode=0
Jul 21 16:34:05.231628 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.231556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn" event={"ID":"4e714eb7-5d46-48cb-86a6-812d1821276a","Type":"ContainerDied","Data":"4e33fc2a17e145c0f821382c36c58ff802248e76e3141429fada9955d8f61453"}
Jul 21 16:34:05.231628 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.231591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn" event={"ID":"4e714eb7-5d46-48cb-86a6-812d1821276a","Type":"ContainerStarted","Data":"763ed6f0feb414a853adc1075272beca6c3b30f8b157f3e174a20ac302406c5d"}
Jul 21 16:34:05.248900 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.248865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.248987 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.248936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm7rh\" (UniqueName: \"kubernetes.io/projected/5601bf2b-0aa2-4c3f-ae46-c34477363f20-kube-api-access-cm7rh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.248987 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.248981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.350245 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.350223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.350366 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.350295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm7rh\" (UniqueName: \"kubernetes.io/projected/5601bf2b-0aa2-4c3f-ae46-c34477363f20-kube-api-access-cm7rh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.350431 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.350383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.350597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.350576    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.350680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.350660    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.359904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.359863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm7rh\" (UniqueName: \"kubernetes.io/projected/5601bf2b-0aa2-4c3f-ae46-c34477363f20-kube-api-access-cm7rh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.410655 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.410634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:05.490625 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.490564    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"]
Jul 21 16:34:05.496039 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.496003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.507560 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.507533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"]
Jul 21 16:34:05.546514 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.546493    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"]
Jul 21 16:34:05.548375 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:05.548345    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5601bf2b_0aa2_4c3f_ae46_c34477363f20.slice/crio-be37ed0b798fe0ebf398af2442097bc647ce055968de34e61622e333149c98fb WatchSource:0}: Error finding container be37ed0b798fe0ebf398af2442097bc647ce055968de34e61622e333149c98fb: Status 404 returned error can't find the container with id be37ed0b798fe0ebf398af2442097bc647ce055968de34e61622e333149c98fb
Jul 21 16:34:05.653005 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.652977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq2xg\" (UniqueName: \"kubernetes.io/projected/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-kube-api-access-hq2xg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.653133 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.653059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.653133 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.653119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.754527 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.754464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.754527 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.754519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.754745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.754572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq2xg\" (UniqueName: \"kubernetes.io/projected/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-kube-api-access-hq2xg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.754872 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.754852    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.754872 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.754865    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.763932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.763913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq2xg\" (UniqueName: \"kubernetes.io/projected/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-kube-api-access-hq2xg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.808727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.808711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:05.944717 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:05.944693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"]
Jul 21 16:34:05.946076 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:05.946048    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac82232_1a8b_43d4_97e3_d8f74b522ce0.slice/crio-8c5a434560b873d2b89aeebe49e3da82ca816c366777b2ca882c709763c07e37 WatchSource:0}: Error finding container 8c5a434560b873d2b89aeebe49e3da82ca816c366777b2ca882c709763c07e37: Status 404 returned error can't find the container with id 8c5a434560b873d2b89aeebe49e3da82ca816c366777b2ca882c709763c07e37
Jul 21 16:34:06.238257 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.238229    2573 generic.go:356] "Generic (PLEG): container finished" podID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerID="80bb8e8e631bbb28b8f601dfd054f7877e417ff3ba7c22fea1588f49fba10a1f" exitCode=0
Jul 21 16:34:06.238629 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.238300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94" event={"ID":"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e","Type":"ContainerDied","Data":"80bb8e8e631bbb28b8f601dfd054f7877e417ff3ba7c22fea1588f49fba10a1f"}
Jul 21 16:34:06.239999 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.239979    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerID="e5dd719bf9856d03d4cb02fb48435a682319fe48ee67a6be668031e3484da648" exitCode=0
Jul 21 16:34:06.240362 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.240066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q" event={"ID":"5ac82232-1a8b-43d4-97e3-d8f74b522ce0","Type":"ContainerDied","Data":"e5dd719bf9856d03d4cb02fb48435a682319fe48ee67a6be668031e3484da648"}
Jul 21 16:34:06.240362 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.240108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q" event={"ID":"5ac82232-1a8b-43d4-97e3-d8f74b522ce0","Type":"ContainerStarted","Data":"8c5a434560b873d2b89aeebe49e3da82ca816c366777b2ca882c709763c07e37"}
Jul 21 16:34:06.242044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.242024    2573 generic.go:356] "Generic (PLEG): container finished" podID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerID="4e4b4045c155c11036e3389a0e63d3415c64ae0e17dfd3df4ee29cfaeb1fd9f8" exitCode=0
Jul 21 16:34:06.242148 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.242077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn" event={"ID":"4e714eb7-5d46-48cb-86a6-812d1821276a","Type":"ContainerDied","Data":"4e4b4045c155c11036e3389a0e63d3415c64ae0e17dfd3df4ee29cfaeb1fd9f8"}
Jul 21 16:34:06.243760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.243740    2573 generic.go:356] "Generic (PLEG): container finished" podID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerID="ad32d296bc38bcb9536f51d33b50954035c556178fd9febfd208629d0122f753" exitCode=0
Jul 21 16:34:06.243852 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.243770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv" event={"ID":"5601bf2b-0aa2-4c3f-ae46-c34477363f20","Type":"ContainerDied","Data":"ad32d296bc38bcb9536f51d33b50954035c556178fd9febfd208629d0122f753"}
Jul 21 16:34:06.243852 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:06.243799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv" event={"ID":"5601bf2b-0aa2-4c3f-ae46-c34477363f20","Type":"ContainerStarted","Data":"be37ed0b798fe0ebf398af2442097bc647ce055968de34e61622e333149c98fb"}
Jul 21 16:34:07.249921 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.249878    2573 generic.go:356] "Generic (PLEG): container finished" podID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerID="7328f5af356b834d1fd0575c29c7295e57d3f5209904fb5de7bb30ad8cc32d20" exitCode=0
Jul 21 16:34:07.250265 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.249919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94" event={"ID":"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e","Type":"ContainerDied","Data":"7328f5af356b834d1fd0575c29c7295e57d3f5209904fb5de7bb30ad8cc32d20"}
Jul 21 16:34:07.251976 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.251948    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerID="d1f7674cb2ce46d62e3ac8c984c340a8850d127a590588c92e5a05628b11419b" exitCode=0
Jul 21 16:34:07.252083 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.252060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q" event={"ID":"5ac82232-1a8b-43d4-97e3-d8f74b522ce0","Type":"ContainerDied","Data":"d1f7674cb2ce46d62e3ac8c984c340a8850d127a590588c92e5a05628b11419b"}
Jul 21 16:34:07.254226 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.254200    2573 generic.go:356] "Generic (PLEG): container finished" podID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerID="31275382c4bff716c9c7eff1c3acaddc8c67cb6b868f67ca8f9102dfade6eaad" exitCode=0
Jul 21 16:34:07.254325 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.254232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn" event={"ID":"4e714eb7-5d46-48cb-86a6-812d1821276a","Type":"ContainerDied","Data":"31275382c4bff716c9c7eff1c3acaddc8c67cb6b868f67ca8f9102dfade6eaad"}
Jul 21 16:34:07.263500 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.263474    2573 generic.go:356] "Generic (PLEG): container finished" podID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerID="64f78649b9212d6c4fdf8a19bc7b8ec83ca31ce31889b21bd31f5f0fe48e59ed" exitCode=0
Jul 21 16:34:07.263601 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:07.263513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv" event={"ID":"5601bf2b-0aa2-4c3f-ae46-c34477363f20","Type":"ContainerDied","Data":"64f78649b9212d6c4fdf8a19bc7b8ec83ca31ce31889b21bd31f5f0fe48e59ed"}
Jul 21 16:34:08.271250 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.271216    2573 generic.go:356] "Generic (PLEG): container finished" podID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerID="6203cd4dd407f833bf9e100d67a5599f38cad442f7b6b7725d5143ae6989fce6" exitCode=0
Jul 21 16:34:08.271652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.271298    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv" event={"ID":"5601bf2b-0aa2-4c3f-ae46-c34477363f20","Type":"ContainerDied","Data":"6203cd4dd407f833bf9e100d67a5599f38cad442f7b6b7725d5143ae6989fce6"}
Jul 21 16:34:08.273313 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.273292    2573 generic.go:356] "Generic (PLEG): container finished" podID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerID="110d2f53b7a97abd063a02909eef64717fb656881f69740cf40a03410eaf4bff" exitCode=0
Jul 21 16:34:08.273435 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.273321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94" event={"ID":"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e","Type":"ContainerDied","Data":"110d2f53b7a97abd063a02909eef64717fb656881f69740cf40a03410eaf4bff"}
Jul 21 16:34:08.275138 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.275119    2573 generic.go:356] "Generic (PLEG): container finished" podID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerID="43fa6248f97c4f451ad1757ba9dd9d02d5b608b363cb04564b6337de6f774fb3" exitCode=0
Jul 21 16:34:08.275230 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.275197    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q" event={"ID":"5ac82232-1a8b-43d4-97e3-d8f74b522ce0","Type":"ContainerDied","Data":"43fa6248f97c4f451ad1757ba9dd9d02d5b608b363cb04564b6337de6f774fb3"}
Jul 21 16:34:08.402127 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.402100    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:08.577591 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.577562    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-bundle\") pod \"4e714eb7-5d46-48cb-86a6-812d1821276a\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") "
Jul 21 16:34:08.577738 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.577632    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-util\") pod \"4e714eb7-5d46-48cb-86a6-812d1821276a\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") "
Jul 21 16:34:08.577738 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.577724    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sngg6\" (UniqueName: \"kubernetes.io/projected/4e714eb7-5d46-48cb-86a6-812d1821276a-kube-api-access-sngg6\") pod \"4e714eb7-5d46-48cb-86a6-812d1821276a\" (UID: \"4e714eb7-5d46-48cb-86a6-812d1821276a\") "
Jul 21 16:34:08.578040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.578017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-bundle" (OuterVolumeSpecName: "bundle") pod "4e714eb7-5d46-48cb-86a6-812d1821276a" (UID: "4e714eb7-5d46-48cb-86a6-812d1821276a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:08.579788 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.579766    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e714eb7-5d46-48cb-86a6-812d1821276a-kube-api-access-sngg6" (OuterVolumeSpecName: "kube-api-access-sngg6") pod "4e714eb7-5d46-48cb-86a6-812d1821276a" (UID: "4e714eb7-5d46-48cb-86a6-812d1821276a"). InnerVolumeSpecName "kube-api-access-sngg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:08.583256 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.583235    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-util" (OuterVolumeSpecName: "util") pod "4e714eb7-5d46-48cb-86a6-812d1821276a" (UID: "4e714eb7-5d46-48cb-86a6-812d1821276a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:08.679332 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.679306    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-util\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:08.679332 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.679331    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sngg6\" (UniqueName: \"kubernetes.io/projected/4e714eb7-5d46-48cb-86a6-812d1821276a-kube-api-access-sngg6\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:08.679473 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:08.679340    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e714eb7-5d46-48cb-86a6-812d1821276a-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.282072 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.282031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn" event={"ID":"4e714eb7-5d46-48cb-86a6-812d1821276a","Type":"ContainerDied","Data":"763ed6f0feb414a853adc1075272beca6c3b30f8b157f3e174a20ac302406c5d"}
Jul 21 16:34:09.282453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.282086    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="763ed6f0feb414a853adc1075272beca6c3b30f8b157f3e174a20ac302406c5d"
Jul 21 16:34:09.282453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.282051    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn"
Jul 21 16:34:09.448275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.448252    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:09.450581 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.450560    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:09.476824 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.476804    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:09.585342 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585315    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm7rh\" (UniqueName: \"kubernetes.io/projected/5601bf2b-0aa2-4c3f-ae46-c34477363f20-kube-api-access-cm7rh\") pod \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") "
Jul 21 16:34:09.585464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585382    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbf49\" (UniqueName: \"kubernetes.io/projected/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-kube-api-access-tbf49\") pod \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") "
Jul 21 16:34:09.585464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585406    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-util\") pod \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") "
Jul 21 16:34:09.585464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585435    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq2xg\" (UniqueName: \"kubernetes.io/projected/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-kube-api-access-hq2xg\") pod \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") "
Jul 21 16:34:09.585464 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585456    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-bundle\") pod \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") "
Jul 21 16:34:09.585667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-bundle\") pod \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\" (UID: \"5601bf2b-0aa2-4c3f-ae46-c34477363f20\") "
Jul 21 16:34:09.585667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585579    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-bundle\") pod \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") "
Jul 21 16:34:09.585667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585609    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-util\") pod \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\" (UID: \"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e\") "
Jul 21 16:34:09.585667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.585632    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-util\") pod \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\" (UID: \"5ac82232-1a8b-43d4-97e3-d8f74b522ce0\") "
Jul 21 16:34:09.586878 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.586072    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-bundle" (OuterVolumeSpecName: "bundle") pod "5ac82232-1a8b-43d4-97e3-d8f74b522ce0" (UID: "5ac82232-1a8b-43d4-97e3-d8f74b522ce0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:09.586878 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.586328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-bundle" (OuterVolumeSpecName: "bundle") pod "5601bf2b-0aa2-4c3f-ae46-c34477363f20" (UID: "5601bf2b-0aa2-4c3f-ae46-c34477363f20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:09.586878 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.586789    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-bundle" (OuterVolumeSpecName: "bundle") pod "763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" (UID: "763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:09.587815 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.587773    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5601bf2b-0aa2-4c3f-ae46-c34477363f20-kube-api-access-cm7rh" (OuterVolumeSpecName: "kube-api-access-cm7rh") pod "5601bf2b-0aa2-4c3f-ae46-c34477363f20" (UID: "5601bf2b-0aa2-4c3f-ae46-c34477363f20"). InnerVolumeSpecName "kube-api-access-cm7rh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:09.587932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.587858    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-kube-api-access-hq2xg" (OuterVolumeSpecName: "kube-api-access-hq2xg") pod "5ac82232-1a8b-43d4-97e3-d8f74b522ce0" (UID: "5ac82232-1a8b-43d4-97e3-d8f74b522ce0"). InnerVolumeSpecName "kube-api-access-hq2xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:09.589141 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.589120    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-kube-api-access-tbf49" (OuterVolumeSpecName: "kube-api-access-tbf49") pod "763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" (UID: "763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e"). InnerVolumeSpecName "kube-api-access-tbf49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:09.592249 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.592224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-util" (OuterVolumeSpecName: "util") pod "5ac82232-1a8b-43d4-97e3-d8f74b522ce0" (UID: "5ac82232-1a8b-43d4-97e3-d8f74b522ce0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:09.594379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.594353    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-util" (OuterVolumeSpecName: "util") pod "5601bf2b-0aa2-4c3f-ae46-c34477363f20" (UID: "5601bf2b-0aa2-4c3f-ae46-c34477363f20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:09.594508 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.594493    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-util" (OuterVolumeSpecName: "util") pod "763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" (UID: "763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:09.686448 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686426    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbf49\" (UniqueName: \"kubernetes.io/projected/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-kube-api-access-tbf49\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686448 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686447    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-util\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686455    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq2xg\" (UniqueName: \"kubernetes.io/projected/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-kube-api-access-hq2xg\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686465    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686474    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5601bf2b-0aa2-4c3f-ae46-c34477363f20-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686482    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686489    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e-util\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686496    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ac82232-1a8b-43d4-97e3-d8f74b522ce0-util\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:09.686570 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:09.686504    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm7rh\" (UniqueName: \"kubernetes.io/projected/5601bf2b-0aa2-4c3f-ae46-c34477363f20-kube-api-access-cm7rh\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:10.288858 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.288815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv" event={"ID":"5601bf2b-0aa2-4c3f-ae46-c34477363f20","Type":"ContainerDied","Data":"be37ed0b798fe0ebf398af2442097bc647ce055968de34e61622e333149c98fb"}
Jul 21 16:34:10.289303 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.289166    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be37ed0b798fe0ebf398af2442097bc647ce055968de34e61622e333149c98fb"
Jul 21 16:34:10.289303 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.289244    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv"
Jul 21 16:34:10.298555 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.298524    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94" event={"ID":"763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e","Type":"ContainerDied","Data":"9e30a52ef22510ba6a64276abb8e04a65a395089f9bdb7b887dd424dca103f16"}
Jul 21 16:34:10.298555 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.298545    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94"
Jul 21 16:34:10.298755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.298593    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e30a52ef22510ba6a64276abb8e04a65a395089f9bdb7b887dd424dca103f16"
Jul 21 16:34:10.300908 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.300862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q" event={"ID":"5ac82232-1a8b-43d4-97e3-d8f74b522ce0","Type":"ContainerDied","Data":"8c5a434560b873d2b89aeebe49e3da82ca816c366777b2ca882c709763c07e37"}
Jul 21 16:34:10.301017 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.300915    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c5a434560b873d2b89aeebe49e3da82ca816c366777b2ca882c709763c07e37"
Jul 21 16:34:10.301017 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:10.300958    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q"
Jul 21 16:34:12.172061 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:12.172033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:14.248489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.248451    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5dbb845-jvzk7"]
Jul 21 16:34:14.248968 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.248947    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="pull"
Jul 21 16:34:14.249019 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.248971    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="pull"
Jul 21 16:34:14.249019 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.248985    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="util"
Jul 21 16:34:14.249019 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.248993    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="util"
Jul 21 16:34:14.249019 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249012    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="pull"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249021    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="pull"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249030    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="extract"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249038    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="extract"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249058    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="util"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249066    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="util"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249075    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="util"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249082    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="util"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249091    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="util"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249098    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="util"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249107    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="extract"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249115    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="extract"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249137    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="extract"
Jul 21 16:34:14.249174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249169    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="extract"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249181    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="extract"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249190    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="extract"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="pull"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249218    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="pull"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249230    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="pull"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249238    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="pull"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249331    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e714eb7-5d46-48cb-86a6-812d1821276a" containerName="extract"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249341    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e" containerName="extract"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249348    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac82232-1a8b-43d4-97e3-d8f74b522ce0" containerName="extract"
Jul 21 16:34:14.249745 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.249358    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5601bf2b-0aa2-4c3f-ae46-c34477363f20" containerName="extract"
Jul 21 16:34:14.253679 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.253659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.263963 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.263942    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5dbb845-jvzk7"]
Jul 21 16:34:14.306245 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.306219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:14.361032 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.361001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:14.433176 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-trusted-ca-bundle\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.433323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-serving-cert\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.433323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-oauth-serving-cert\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.433323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-config\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.433323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-service-ca\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.433453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmmk\" (UniqueName: \"kubernetes.io/projected/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-kube-api-access-mgmmk\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.433453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.433398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-oauth-config\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.449940 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.449913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:14.534428 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-oauth-config\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.534541 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-trusted-ca-bundle\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.534541 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-serving-cert\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.534541 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-oauth-serving-cert\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.534687 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-config\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.534687 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-service-ca\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.534687 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.534611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmmk\" (UniqueName: \"kubernetes.io/projected/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-kube-api-access-mgmmk\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.535361 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.535338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-service-ca\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.535472 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.535384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-trusted-ca-bundle\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.535472 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.535385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-config\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.535472 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.535439    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-oauth-serving-cert\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.536994 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.536971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-oauth-config\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.537235 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.537219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-console-serving-cert\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.542979 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.542955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmmk\" (UniqueName: \"kubernetes.io/projected/5cf782b2-dbbd-4f6a-98a2-62fea719fe84-kube-api-access-mgmmk\") pod \"console-b5dbb845-jvzk7\" (UID: \"5cf782b2-dbbd-4f6a-98a2-62fea719fe84\") " pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.553436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.553413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:14.563641 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.563618    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:14.699406 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:14.699371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf782b2_dbbd_4f6a_98a2_62fea719fe84.slice/crio-5a3ff72c2063359ccd098fe138fcb1773ad900a6b6ae86adf4411da8ec0e6633 WatchSource:0}: Error finding container 5a3ff72c2063359ccd098fe138fcb1773ad900a6b6ae86adf4411da8ec0e6633: Status 404 returned error can't find the container with id 5a3ff72c2063359ccd098fe138fcb1773ad900a6b6ae86adf4411da8ec0e6633
Jul 21 16:34:14.699794 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.699774    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5dbb845-jvzk7"]
Jul 21 16:34:14.795212 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.795130    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"]
Jul 21 16:34:14.798840 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.798815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:14.801585 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.801563    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 16:34:14.801585 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.801584    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cbj8x\""
Jul 21 16:34:14.824644 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.824616    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"]
Jul 21 16:34:14.938900 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:14.938864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs9m2\" (UniqueName: \"kubernetes.io/projected/15fcff7d-72d5-4fde-83ba-1cf7508d3a44-kube-api-access-xs9m2\") pod \"dns-operator-controller-manager-864dd78c4c-gcskq\" (UID: \"15fcff7d-72d5-4fde-83ba-1cf7508d3a44\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:15.040047 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.040001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs9m2\" (UniqueName: \"kubernetes.io/projected/15fcff7d-72d5-4fde-83ba-1cf7508d3a44-kube-api-access-xs9m2\") pod \"dns-operator-controller-manager-864dd78c4c-gcskq\" (UID: \"15fcff7d-72d5-4fde-83ba-1cf7508d3a44\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:15.053705 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.053639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs9m2\" (UniqueName: \"kubernetes.io/projected/15fcff7d-72d5-4fde-83ba-1cf7508d3a44-kube-api-access-xs9m2\") pod \"dns-operator-controller-manager-864dd78c4c-gcskq\" (UID: \"15fcff7d-72d5-4fde-83ba-1cf7508d3a44\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:15.056765 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.056744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:15.111586 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.111566    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:15.158545 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.158514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:15.253575 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.253550    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"]
Jul 21 16:34:15.255520 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:15.255492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fcff7d_72d5_4fde_83ba_1cf7508d3a44.slice/crio-be42da943c90e3eb38a5fc41bf08f93ceefd8c060171a715a254a5960cf6627f WatchSource:0}: Error finding container be42da943c90e3eb38a5fc41bf08f93ceefd8c060171a715a254a5960cf6627f: Status 404 returned error can't find the container with id be42da943c90e3eb38a5fc41bf08f93ceefd8c060171a715a254a5960cf6627f
Jul 21 16:34:15.327547 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.327446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5dbb845-jvzk7" event={"ID":"5cf782b2-dbbd-4f6a-98a2-62fea719fe84","Type":"ContainerStarted","Data":"b8cbcd200ec5a9c355fbd4056e06d0ca1f69a38b3af1c14e6fa7c35ba72fedcd"}
Jul 21 16:34:15.327547 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.327495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5dbb845-jvzk7" event={"ID":"5cf782b2-dbbd-4f6a-98a2-62fea719fe84","Type":"ContainerStarted","Data":"5a3ff72c2063359ccd098fe138fcb1773ad900a6b6ae86adf4411da8ec0e6633"}
Jul 21 16:34:15.328756 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.328731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq" event={"ID":"15fcff7d-72d5-4fde-83ba-1cf7508d3a44","Type":"ContainerStarted","Data":"be42da943c90e3eb38a5fc41bf08f93ceefd8c060171a715a254a5960cf6627f"}
Jul 21 16:34:15.378777 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.378727    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5dbb845-jvzk7" podStartSLOduration=1.378712192 podStartE2EDuration="1.378712192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:15.376472672 +0000 UTC m=+637.193152119" watchObservedRunningTime="2026-07-21 16:34:15.378712192 +0000 UTC m=+637.195391634"
Jul 21 16:34:15.552458 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:15.552429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:16.354405 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:16.354367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:18.350279 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.350244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq" event={"ID":"15fcff7d-72d5-4fde-83ba-1cf7508d3a44","Type":"ContainerStarted","Data":"950d12b36980a88d12d08adb5a08e0ae3bae0eaced61147575551f11cd0313f0"}
Jul 21 16:34:18.350633 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.350316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:18.369148 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.369104    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq" podStartSLOduration=1.4958035330000001 podStartE2EDuration="4.369090006s" totalImagesPullingTime="2.873286473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:18.366291046 +0000 UTC m=+640.182970491" watchObservedRunningTime="2026-07-21 16:34:18.369090006 +0000 UTC m=+640.185769448"
Jul 21 16:34:18.841764 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.841731    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"]
Jul 21 16:34:18.846366 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.846348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:18.849212 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.849192    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8crpv\""
Jul 21 16:34:18.858997 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.858975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"]
Jul 21 16:34:18.876924 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.874578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntjw\" (UniqueName: \"kubernetes.io/projected/195c1016-a9e0-43be-9ac3-4c6adf62c104-kube-api-access-kntjw\") pod \"authorino-operator-75cc8d5cb7-7hb5j\" (UID: \"195c1016-a9e0-43be-9ac3-4c6adf62c104\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:18.975842 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.975813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntjw\" (UniqueName: \"kubernetes.io/projected/195c1016-a9e0-43be-9ac3-4c6adf62c104-kube-api-access-kntjw\") pod \"authorino-operator-75cc8d5cb7-7hb5j\" (UID: \"195c1016-a9e0-43be-9ac3-4c6adf62c104\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:18.984418 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:18.984394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntjw\" (UniqueName: \"kubernetes.io/projected/195c1016-a9e0-43be-9ac3-4c6adf62c104-kube-api-access-kntjw\") pod \"authorino-operator-75cc8d5cb7-7hb5j\" (UID: \"195c1016-a9e0-43be-9ac3-4c6adf62c104\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:19.155727 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:19.155647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:19.287687 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:19.287660    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"]
Jul 21 16:34:19.288938 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:19.288876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195c1016_a9e0_43be_9ac3_4c6adf62c104.slice/crio-7453968e1c836566b466e064ce2b99d67320862b79a35cfc3a1d5a4283066dde WatchSource:0}: Error finding container 7453968e1c836566b466e064ce2b99d67320862b79a35cfc3a1d5a4283066dde: Status 404 returned error can't find the container with id 7453968e1c836566b466e064ce2b99d67320862b79a35cfc3a1d5a4283066dde
Jul 21 16:34:19.356739 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:19.356710    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j" event={"ID":"195c1016-a9e0-43be-9ac3-4c6adf62c104","Type":"ContainerStarted","Data":"7453968e1c836566b466e064ce2b99d67320862b79a35cfc3a1d5a4283066dde"}
Jul 21 16:34:19.974807 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:19.974769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:20.258331 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:20.258251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:22.300274 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:22.300229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:22.374691 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:22.374656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j" event={"ID":"195c1016-a9e0-43be-9ac3-4c6adf62c104","Type":"ContainerStarted","Data":"4e5b4ebfc4abea695fcb1c945ec1cf4ea01f4aa59b89b96ff48fb72c74d107c0"}
Jul 21 16:34:22.374857 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:22.374722    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:22.409401 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:22.409361    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j" podStartSLOduration=2.301713392 podStartE2EDuration="4.409346802s" totalImagesPullingTime="2.10763341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:22.40716769 +0000 UTC m=+644.223847143" watchObservedRunningTime="2026-07-21 16:34:22.409346802 +0000 UTC m=+644.226026245"
Jul 21 16:34:22.759578 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:22.759490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:23.253609 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:23.253561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:24.563867 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:24.563841    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:24.564246 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:24.563896    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:24.568710 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:24.568690    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:25.204176 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:25.204146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:25.394390 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:25.394366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b5dbb845-jvzk7"
Jul 21 16:34:25.444856 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:25.444809    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7fd4d9cc-pxh52"]
Jul 21 16:34:25.578853 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:25.578817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:25.675318 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:25.675286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:28.177942 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:28.177912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:28.276782 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:28.276747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:29.358831 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:29.358805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gcskq"
Jul 21 16:34:33.382992 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:33.382963    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7hb5j"
Jul 21 16:34:33.567243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:33.567209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:33.665129 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:33.665052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:34.063048 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:34.063019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:34.150426 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:34.150402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:35.383152 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.383119    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"]
Jul 21 16:34:35.386729 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.386708    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.389598 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.389575    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 16:34:35.389598 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.389590    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6hx\""
Jul 21 16:34:35.389740 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.389614    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 16:34:35.394388 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.394238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:35.397122 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.397102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"]
Jul 21 16:34:35.453187 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.453157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:35.509413 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.509388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f24d633-6a10-43d0-ac28-216102a655ec-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.509504 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.509416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f24d633-6a10-43d0-ac28-216102a655ec-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.509504 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.509462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfm5l\" (UniqueName: \"kubernetes.io/projected/4f24d633-6a10-43d0-ac28-216102a655ec-kube-api-access-jfm5l\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.610216 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.610189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f24d633-6a10-43d0-ac28-216102a655ec-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.610216 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.610218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f24d633-6a10-43d0-ac28-216102a655ec-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.610375 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.610253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfm5l\" (UniqueName: \"kubernetes.io/projected/4f24d633-6a10-43d0-ac28-216102a655ec-kube-api-access-jfm5l\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.610944 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.610880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f24d633-6a10-43d0-ac28-216102a655ec-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.612599 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.612576    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f24d633-6a10-43d0-ac28-216102a655ec-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.619117 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.619095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfm5l\" (UniqueName: \"kubernetes.io/projected/4f24d633-6a10-43d0-ac28-216102a655ec-kube-api-access-jfm5l\") pod \"kuadrant-console-plugin-66b5774985-bprrj\" (UID: \"4f24d633-6a10-43d0-ac28-216102a655ec\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.697680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.697606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"
Jul 21 16:34:35.828407 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:35.828383    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj"]
Jul 21 16:34:35.831016 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:35.830985    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f24d633_6a10_43d0_ac28_216102a655ec.slice/crio-8b01a3f4bb876943c1b32908cd0a97899be8dfc8331b0346ffc0a8353861a6b1 WatchSource:0}: Error finding container 8b01a3f4bb876943c1b32908cd0a97899be8dfc8331b0346ffc0a8353861a6b1: Status 404 returned error can't find the container with id 8b01a3f4bb876943c1b32908cd0a97899be8dfc8331b0346ffc0a8353861a6b1
Jul 21 16:34:36.449377 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:36.449336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj" event={"ID":"4f24d633-6a10-43d0-ac28-216102a655ec","Type":"ContainerStarted","Data":"8b01a3f4bb876943c1b32908cd0a97899be8dfc8331b0346ffc0a8353861a6b1"}
Jul 21 16:34:37.398619 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:37.398590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:37.499910 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:37.499857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:39.981452 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:39.981418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:40.079016 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:40.078984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:40.845007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:40.844972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:46.504583 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.504549    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"]
Jul 21 16:34:46.517875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.517848    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:34:46.521653 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.521612    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hjgjh\""
Jul 21 16:34:46.524779 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.524580    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"]
Jul 21 16:34:46.618694 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.618662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmvnj\" (UniqueName: \"kubernetes.io/projected/2e266f3b-109c-4f4d-8268-4e8936a19b21-kube-api-access-cmvnj\") pod \"limitador-operator-controller-manager-859d7b78bd-h68fq\" (UID: \"2e266f3b-109c-4f4d-8268-4e8936a19b21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:34:46.641822 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.641793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:46.719601 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.719572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmvnj\" (UniqueName: \"kubernetes.io/projected/2e266f3b-109c-4f4d-8268-4e8936a19b21-kube-api-access-cmvnj\") pod \"limitador-operator-controller-manager-859d7b78bd-h68fq\" (UID: \"2e266f3b-109c-4f4d-8268-4e8936a19b21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:34:46.731620 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.731591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmvnj\" (UniqueName: \"kubernetes.io/projected/2e266f3b-109c-4f4d-8268-4e8936a19b21-kube-api-access-cmvnj\") pod \"limitador-operator-controller-manager-859d7b78bd-h68fq\" (UID: \"2e266f3b-109c-4f4d-8268-4e8936a19b21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:34:46.736865 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.736841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:46.835170 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:46.835143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:34:50.475841 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:50.475799    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d7fd4d9cc-pxh52" podUID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" containerName="console" containerID="cri-o://7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24" gracePeriod=15
Jul 21 16:34:51.953634 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:51.953590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:52.052906 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:52.052855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:52.567587 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:52.567556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:52.628837 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:52.628804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:53.117159 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:53.117123    2573 patch_prober.go:28] interesting pod/console-5d7fd4d9cc-pxh52 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body=
Jul 21 16:34:53.117567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:53.117189    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5d7fd4d9cc-pxh52" podUID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused"
Jul 21 16:34:58.156388 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:58.156350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:58.259748 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:58.259707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:58.870273 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:58.870251    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:34:58.883370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:58.883346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"]
Jul 21 16:34:58.883511 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:34:58.883489    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e266f3b_109c_4f4d_8268_4e8936a19b21.slice/crio-7395a435559729b11740cd160e94a08b3943a7352f4bf07dd806ebd32160e716 WatchSource:0}: Error finding container 7395a435559729b11740cd160e94a08b3943a7352f4bf07dd806ebd32160e716: Status 404 returned error can't find the container with id 7395a435559729b11740cd160e94a08b3943a7352f4bf07dd806ebd32160e716
Jul 21 16:34:59.037610 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037584    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-service-ca\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037633    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-oauth-config\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037653    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-trusted-ca-bundle\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037707    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-serving-cert\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037728    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc2wl\" (UniqueName: \"kubernetes.io/projected/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-kube-api-access-cc2wl\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037998 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-oauth-serving-cert\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037998 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037802    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-config\") pod \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\" (UID: \"5d4bccb7-709c-43e5-8f2e-c39896fbeae2\") "
Jul 21 16:34:59.037998 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.037974    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:34:59.038169 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.038099    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.038169 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.038132    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:34:59.038361 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.038321    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:34:59.038487 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.038368    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-config" (OuterVolumeSpecName: "console-config") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:34:59.039769 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.039747    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:34:59.039830 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.039762    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:34:59.039830 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.039798    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-kube-api-access-cc2wl" (OuterVolumeSpecName: "kube-api-access-cc2wl") pod "5d4bccb7-709c-43e5-8f2e-c39896fbeae2" (UID: "5d4bccb7-709c-43e5-8f2e-c39896fbeae2"). InnerVolumeSpecName "kube-api-access-cc2wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:59.139040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.139013    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-serving-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.139040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.139032    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2wl\" (UniqueName: \"kubernetes.io/projected/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-kube-api-access-cc2wl\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.139040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.139043    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-oauth-serving-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.139228 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.139052    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.139228 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.139060    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-console-oauth-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.139228 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.139068    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4bccb7-709c-43e5-8f2e-c39896fbeae2-trusted-ca-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:34:59.600244 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.600205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj" event={"ID":"4f24d633-6a10-43d0-ac28-216102a655ec","Type":"ContainerStarted","Data":"1c0c2071c1079e649ba59437bfc21b5d8f7dfb827895bb13093f8e141657743d"}
Jul 21 16:34:59.601591 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.601558    2573 generic.go:356] "Generic (PLEG): container finished" podID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" containerID="7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24" exitCode=0
Jul 21 16:34:59.601737 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.601611    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7fd4d9cc-pxh52"
Jul 21 16:34:59.601737 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.601635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7fd4d9cc-pxh52" event={"ID":"5d4bccb7-709c-43e5-8f2e-c39896fbeae2","Type":"ContainerDied","Data":"7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24"}
Jul 21 16:34:59.601737 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.601704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7fd4d9cc-pxh52" event={"ID":"5d4bccb7-709c-43e5-8f2e-c39896fbeae2","Type":"ContainerDied","Data":"da6a13d73bf4ab9212027066857183a0c9ab3abd466c3247ffc3fc7a5548e2bb"}
Jul 21 16:34:59.601737 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.601733    2573 scope.go:117] "RemoveContainer" containerID="7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24"
Jul 21 16:34:59.602929 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.602907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq" event={"ID":"2e266f3b-109c-4f4d-8268-4e8936a19b21","Type":"ContainerStarted","Data":"7395a435559729b11740cd160e94a08b3943a7352f4bf07dd806ebd32160e716"}
Jul 21 16:34:59.610568 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.610552    2573 scope.go:117] "RemoveContainer" containerID="7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24"
Jul 21 16:34:59.610816 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:34:59.610796    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24\": container with ID starting with 7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24 not found: ID does not exist" containerID="7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24"
Jul 21 16:34:59.610854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.610826    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24"} err="failed to get container status \"7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24\": rpc error: code = NotFound desc = could not find container \"7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24\": container with ID starting with 7a79b5f53d417a7e537043fc4939f442092462a2af45d94d8875df3defe5be24 not found: ID does not exist"
Jul 21 16:34:59.625028 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.624961    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bprrj" podStartSLOduration=1.643098498 podStartE2EDuration="24.624947447s" totalImagesPullingTime="22.981848949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:59.624669378 +0000 UTC m=+681.441348822" watchObservedRunningTime="2026-07-21 16:34:59.624947447 +0000 UTC m=+681.441626891"
Jul 21 16:34:59.646373 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.646347    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7fd4d9cc-pxh52"]
Jul 21 16:34:59.651992 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:34:59.651970    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7fd4d9cc-pxh52"]
Jul 21 16:35:00.610957 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:00.610918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq" event={"ID":"2e266f3b-109c-4f4d-8268-4e8936a19b21","Type":"ContainerStarted","Data":"63f868dbbf6ae54c2103f148d21196b9aa5d5324f71986bbb772685ad1fac599"}
Jul 21 16:35:00.611325 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:00.611159    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:35:00.630638 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:00.630597    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq" podStartSLOduration=13.388227616 podStartE2EDuration="14.630582153s" totalImagesPullingTime="1.242354537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:00.629762783 +0000 UTC m=+682.446442227" watchObservedRunningTime="2026-07-21 16:35:00.630582153 +0000 UTC m=+682.447261596"
Jul 21 16:35:00.698721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:00.698696    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" path="/var/lib/kubelet/pods/5d4bccb7-709c-43e5-8f2e-c39896fbeae2/volumes"
Jul 21 16:35:02.980997 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:02.980968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:03.070877 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:03.070845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:11.619068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:11.619035    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h68fq"
Jul 21 16:35:13.257725 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:13.257687    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:13.359635 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:13.359608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:15.198906 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:15.198858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:15.623447 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:15.623419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:29.466982 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:29.466947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:30.649569 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:30.649499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:30.712785 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:30.712753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:47.569054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:47.569003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:47.666277 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:47.666245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:48.021278 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:48.021208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:59.722103 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:59.722066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:59.975149 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:35:59.975071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:03.104513 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:03.104476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:07.183450 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.183418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:07.188931 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.188906    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f7f868495-jhd8w"]
Jul 21 16:36:07.189259 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.189247    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" containerName="console"
Jul 21 16:36:07.189259 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.189260    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" containerName="console"
Jul 21 16:36:07.189364 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.189355    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4bccb7-709c-43e5-8f2e-c39896fbeae2" containerName="console"
Jul 21 16:36:07.196037 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.196009    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.202996 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.202976    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:36:07.203108 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.203018    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pg569\""
Jul 21 16:36:07.203183 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.202992    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:36:07.204959 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.204937    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f7f868495-jhd8w"]
Jul 21 16:36:07.282457 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.282427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:07.296386 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.296361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrsg\" (UniqueName: \"kubernetes.io/projected/2fc2b692-b4aa-4909-af93-a49cd89a7798-kube-api-access-tnrsg\") pod \"maas-controller-6f7f868495-jhd8w\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") " pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.296485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.296410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fc2b692-b4aa-4909-af93-a49cd89a7798-webhook-cert\") pod \"maas-controller-6f7f868495-jhd8w\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") " pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.356064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.356042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:07.360937 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.360904    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-ktkvx"]
Jul 21 16:36:07.364490 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.364472    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.376031 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.376013    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-ktkvx"]
Jul 21 16:36:07.397665 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.397628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrsg\" (UniqueName: \"kubernetes.io/projected/2fc2b692-b4aa-4909-af93-a49cd89a7798-kube-api-access-tnrsg\") pod \"maas-controller-6f7f868495-jhd8w\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") " pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.397755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.397692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fc2b692-b4aa-4909-af93-a49cd89a7798-webhook-cert\") pod \"maas-controller-6f7f868495-jhd8w\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") " pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.400129 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.400105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fc2b692-b4aa-4909-af93-a49cd89a7798-webhook-cert\") pod \"maas-controller-6f7f868495-jhd8w\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") " pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.406661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.406638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrsg\" (UniqueName: \"kubernetes.io/projected/2fc2b692-b4aa-4909-af93-a49cd89a7798-kube-api-access-tnrsg\") pod \"maas-controller-6f7f868495-jhd8w\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") " pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.498773 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.498714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-webhook-cert\") pod \"maas-controller-7fd46cd8d7-ktkvx\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") " pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.498773 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.498745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mxnq\" (UniqueName: \"kubernetes.io/projected/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-kube-api-access-8mxnq\") pod \"maas-controller-7fd46cd8d7-ktkvx\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") " pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.509762 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.509747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:07.599475 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.599448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-webhook-cert\") pod \"maas-controller-7fd46cd8d7-ktkvx\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") " pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.599625 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.599485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mxnq\" (UniqueName: \"kubernetes.io/projected/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-kube-api-access-8mxnq\") pod \"maas-controller-7fd46cd8d7-ktkvx\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") " pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.602132 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.602096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-webhook-cert\") pod \"maas-controller-7fd46cd8d7-ktkvx\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") " pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.610003 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.609980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mxnq\" (UniqueName: \"kubernetes.io/projected/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-kube-api-access-8mxnq\") pod \"maas-controller-7fd46cd8d7-ktkvx\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") " pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.641519 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.641494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f7f868495-jhd8w"]
Jul 21 16:36:07.642829 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:36:07.642801    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc2b692_b4aa_4909_af93_a49cd89a7798.slice/crio-9923de82cbe928d2fe475ce24490783a49d5933351d2bed724142a07d47b16ef WatchSource:0}: Error finding container 9923de82cbe928d2fe475ce24490783a49d5933351d2bed724142a07d47b16ef: Status 404 returned error can't find the container with id 9923de82cbe928d2fe475ce24490783a49d5933351d2bed724142a07d47b16ef
Jul 21 16:36:07.674394 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.674374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:07.806923 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.806878    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-ktkvx"]
Jul 21 16:36:07.809785 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:36:07.809761    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f700d0_fb5e_45d2_aa2f_7f0a3dfc071b.slice/crio-f9aaa54057ecbcb38a45185c5948e832cb5878ea2e2f773dc0a4bb46af43c9a2 WatchSource:0}: Error finding container f9aaa54057ecbcb38a45185c5948e832cb5878ea2e2f773dc0a4bb46af43c9a2: Status 404 returned error can't find the container with id f9aaa54057ecbcb38a45185c5948e832cb5878ea2e2f773dc0a4bb46af43c9a2
Jul 21 16:36:07.961760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.961723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx" event={"ID":"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b","Type":"ContainerStarted","Data":"f9aaa54057ecbcb38a45185c5948e832cb5878ea2e2f773dc0a4bb46af43c9a2"}
Jul 21 16:36:07.963118 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:07.963092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7f868495-jhd8w" event={"ID":"2fc2b692-b4aa-4909-af93-a49cd89a7798","Type":"ContainerStarted","Data":"9923de82cbe928d2fe475ce24490783a49d5933351d2bed724142a07d47b16ef"}
Jul 21 16:36:10.511624 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:10.511593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:10.618865 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:10.618784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:10.983700 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:10.983611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx" event={"ID":"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b","Type":"ContainerStarted","Data":"d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401"}
Jul 21 16:36:10.983863 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:10.983741    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:10.985266 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:10.985245    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7f868495-jhd8w" event={"ID":"2fc2b692-b4aa-4909-af93-a49cd89a7798","Type":"ContainerStarted","Data":"5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580"}
Jul 21 16:36:10.985382 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:10.985365    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:11.005427 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:11.005383    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx" podStartSLOduration=1.48464554 podStartE2EDuration="4.005371304s" totalImagesPullingTime="2.520725764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:11.003266146 +0000 UTC m=+752.819945590" watchObservedRunningTime="2026-07-21 16:36:11.005371304 +0000 UTC m=+752.822050747"
Jul 21 16:36:11.025847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:11.025795    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f7f868495-jhd8w" podStartSLOduration=1.331223785 podStartE2EDuration="4.025782244s" totalImagesPullingTime="2.694558459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:11.023041431 +0000 UTC m=+752.839720874" watchObservedRunningTime="2026-07-21 16:36:11.025782244 +0000 UTC m=+752.842461685"
Jul 21 16:36:21.993174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:21.993145    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:36:21.993608 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:21.993208    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:22.065201 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.065173    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f7f868495-jhd8w"]
Jul 21 16:36:22.068348 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.065772    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f7f868495-jhd8w" podUID="2fc2b692-b4aa-4909-af93-a49cd89a7798" containerName="manager" containerID="cri-o://5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580" gracePeriod=30
Jul 21 16:36:22.322988 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.322963    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:22.423819 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.423791    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fc2b692-b4aa-4909-af93-a49cd89a7798-webhook-cert\") pod \"2fc2b692-b4aa-4909-af93-a49cd89a7798\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") "
Jul 21 16:36:22.424002 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.423880    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnrsg\" (UniqueName: \"kubernetes.io/projected/2fc2b692-b4aa-4909-af93-a49cd89a7798-kube-api-access-tnrsg\") pod \"2fc2b692-b4aa-4909-af93-a49cd89a7798\" (UID: \"2fc2b692-b4aa-4909-af93-a49cd89a7798\") "
Jul 21 16:36:22.426053 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.426030    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc2b692-b4aa-4909-af93-a49cd89a7798-kube-api-access-tnrsg" (OuterVolumeSpecName: "kube-api-access-tnrsg") pod "2fc2b692-b4aa-4909-af93-a49cd89a7798" (UID: "2fc2b692-b4aa-4909-af93-a49cd89a7798"). InnerVolumeSpecName "kube-api-access-tnrsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:22.426137 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.426030    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fc2b692-b4aa-4909-af93-a49cd89a7798-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2fc2b692-b4aa-4909-af93-a49cd89a7798" (UID: "2fc2b692-b4aa-4909-af93-a49cd89a7798"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:36:22.524622 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.524595    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnrsg\" (UniqueName: \"kubernetes.io/projected/2fc2b692-b4aa-4909-af93-a49cd89a7798-kube-api-access-tnrsg\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:36:22.524622 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:22.524619    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fc2b692-b4aa-4909-af93-a49cd89a7798-webhook-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:36:23.054344 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.054314    2573 generic.go:356] "Generic (PLEG): container finished" podID="2fc2b692-b4aa-4909-af93-a49cd89a7798" containerID="5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580" exitCode=0
Jul 21 16:36:23.054344 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.054349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7f868495-jhd8w" event={"ID":"2fc2b692-b4aa-4909-af93-a49cd89a7798","Type":"ContainerDied","Data":"5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580"}
Jul 21 16:36:23.054874 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.054367    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7f868495-jhd8w"
Jul 21 16:36:23.054874 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.054386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7f868495-jhd8w" event={"ID":"2fc2b692-b4aa-4909-af93-a49cd89a7798","Type":"ContainerDied","Data":"9923de82cbe928d2fe475ce24490783a49d5933351d2bed724142a07d47b16ef"}
Jul 21 16:36:23.054874 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.054406    2573 scope.go:117] "RemoveContainer" containerID="5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580"
Jul 21 16:36:23.063338 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.063321    2573 scope.go:117] "RemoveContainer" containerID="5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580"
Jul 21 16:36:23.063694 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:36:23.063635    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580\": container with ID starting with 5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580 not found: ID does not exist" containerID="5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580"
Jul 21 16:36:23.063694 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.063671    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580"} err="failed to get container status \"5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580\": rpc error: code = NotFound desc = could not find container \"5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580\": container with ID starting with 5f19f01040e73d651944d3006a8ab451284352b6e8c3be8c9ceb3e4eb5064580 not found: ID does not exist"
Jul 21 16:36:23.075314 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.075285    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f7f868495-jhd8w"]
Jul 21 16:36:23.080855 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:23.080833    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f7f868495-jhd8w"]
Jul 21 16:36:24.698978 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:24.698946    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fc2b692-b4aa-4909-af93-a49cd89a7798" path="/var/lib/kubelet/pods/2fc2b692-b4aa-4909-af93-a49cd89a7798/volumes"
Jul 21 16:36:42.212863 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:42.212824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:42.301165 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:42.301138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:42.636861 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:42.636819    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:42.913140 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:42.913056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:43.287661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.287626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:43.388752 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.388721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:43.415161 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.415135    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-6657d"]
Jul 21 16:36:43.415569 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.415556    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc2b692-b4aa-4909-af93-a49cd89a7798" containerName="manager"
Jul 21 16:36:43.415617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.415571    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc2b692-b4aa-4909-af93-a49cd89a7798" containerName="manager"
Jul 21 16:36:43.415671 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.415659    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc2b692-b4aa-4909-af93-a49cd89a7798" containerName="manager"
Jul 21 16:36:43.424064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.424044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.427125 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.427107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ts927\""
Jul 21 16:36:43.427234 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.427141    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 16:36:43.434205 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.434186    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-6657d"]
Jul 21 16:36:43.499860 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.499832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d89ae9f-b93a-4b85-88ed-91571aafd463-plugins-config-volume\") pod \"payload-processing-5bf47cd988-6657d\" (UID: \"2d89ae9f-b93a-4b85-88ed-91571aafd463\") " pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.499860 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.499864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwkwb\" (UniqueName: \"kubernetes.io/projected/2d89ae9f-b93a-4b85-88ed-91571aafd463-kube-api-access-xwkwb\") pod \"payload-processing-5bf47cd988-6657d\" (UID: \"2d89ae9f-b93a-4b85-88ed-91571aafd463\") " pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.601112 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.601039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d89ae9f-b93a-4b85-88ed-91571aafd463-plugins-config-volume\") pod \"payload-processing-5bf47cd988-6657d\" (UID: \"2d89ae9f-b93a-4b85-88ed-91571aafd463\") " pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.601112 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.601075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwkwb\" (UniqueName: \"kubernetes.io/projected/2d89ae9f-b93a-4b85-88ed-91571aafd463-kube-api-access-xwkwb\") pod \"payload-processing-5bf47cd988-6657d\" (UID: \"2d89ae9f-b93a-4b85-88ed-91571aafd463\") " pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.601703 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.601685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d89ae9f-b93a-4b85-88ed-91571aafd463-plugins-config-volume\") pod \"payload-processing-5bf47cd988-6657d\" (UID: \"2d89ae9f-b93a-4b85-88ed-91571aafd463\") " pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.610952 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.610926    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwkwb\" (UniqueName: \"kubernetes.io/projected/2d89ae9f-b93a-4b85-88ed-91571aafd463-kube-api-access-xwkwb\") pod \"payload-processing-5bf47cd988-6657d\" (UID: \"2d89ae9f-b93a-4b85-88ed-91571aafd463\") " pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.735427 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.735401    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:43.886986 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:43.886952    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-6657d"]
Jul 21 16:36:43.888391 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:36:43.888364    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d89ae9f_b93a_4b85_88ed_91571aafd463.slice/crio-9a99447fec4c30a8cf718118e762f035c8fdc1d55f28b39cda67e63b80d1f4b9 WatchSource:0}: Error finding container 9a99447fec4c30a8cf718118e762f035c8fdc1d55f28b39cda67e63b80d1f4b9: Status 404 returned error can't find the container with id 9a99447fec4c30a8cf718118e762f035c8fdc1d55f28b39cda67e63b80d1f4b9
Jul 21 16:36:44.167554 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:44.167469    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-6657d" event={"ID":"2d89ae9f-b93a-4b85-88ed-91571aafd463","Type":"ContainerStarted","Data":"9a99447fec4c30a8cf718118e762f035c8fdc1d55f28b39cda67e63b80d1f4b9"}
Jul 21 16:36:46.181571 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:46.181537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-6657d" event={"ID":"2d89ae9f-b93a-4b85-88ed-91571aafd463","Type":"ContainerStarted","Data":"685a0c569daacab16dd3cb671167801da19f2a13c4222342379e45e989726593"}
Jul 21 16:36:46.181971 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:46.181614    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:36:46.199135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:46.199090    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-6657d" podStartSLOduration=1.7582882579999999 podStartE2EDuration="3.199075797s" totalImagesPullingTime="1.440787539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:46.197653597 +0000 UTC m=+788.014333041" watchObservedRunningTime="2026-07-21 16:36:46.199075797 +0000 UTC m=+788.015755240"
Jul 21 16:36:54.688000 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:54.687971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:54.779173 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:54.779137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:57.194670 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:36:57.194643    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-6657d"
Jul 21 16:37:03.524089 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:03.524012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:07.118280 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:07.118247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:22.035861 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:22.035827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:22.137729 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:22.137698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:23.629807 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:23.629763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:36.009166 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:36.009134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:44.833252 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:44.833219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:52.886713 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.886680    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"]
Jul 21 16:37:52.890191 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.890171    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:52.895854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.895825    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 16:37:52.895984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.895845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkhrl\""
Jul 21 16:37:52.895984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.895879    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 16:37:52.895984 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.895915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 16:37:52.901185 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.901163    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"]
Jul 21 16:37:52.923299 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:52.923274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:53.076370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.076342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.076370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.076372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.076531 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.076398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.076531 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.076422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.076531 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.076512    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ssgl\" (UniqueName: \"kubernetes.io/projected/61688d0f-c950-4284-93a1-beb6ecdc59fd-kube-api-access-5ssgl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.076631 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.076556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61688d0f-c950-4284-93a1-beb6ecdc59fd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.176983 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.176924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61688d0f-c950-4284-93a1-beb6ecdc59fd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.176983 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.176965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.176983 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.176983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.177267 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.177106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.177267 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.177161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.177267 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.177244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ssgl\" (UniqueName: \"kubernetes.io/projected/61688d0f-c950-4284-93a1-beb6ecdc59fd-kube-api-access-5ssgl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.177443 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.177290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.177443 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.177411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.177543 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.177489    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.179095 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.179075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61688d0f-c950-4284-93a1-beb6ecdc59fd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.179366 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.179350    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61688d0f-c950-4284-93a1-beb6ecdc59fd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.186783 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.186760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ssgl\" (UniqueName: \"kubernetes.io/projected/61688d0f-c950-4284-93a1-beb6ecdc59fd-kube-api-access-5ssgl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q\" (UID: \"61688d0f-c950-4284-93a1-beb6ecdc59fd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.200650 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.200634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:37:53.334827 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.334795    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"]
Jul 21 16:37:53.337828 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:37:53.337794    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61688d0f_c950_4284_93a1_beb6ecdc59fd.slice/crio-cce09cb90710496da62df65a6cbec8b074dd5157be40fa6e5fa9bb067ceba996 WatchSource:0}: Error finding container cce09cb90710496da62df65a6cbec8b074dd5157be40fa6e5fa9bb067ceba996: Status 404 returned error can't find the container with id cce09cb90710496da62df65a6cbec8b074dd5157be40fa6e5fa9bb067ceba996
Jul 21 16:37:53.564455 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:53.564404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q" event={"ID":"61688d0f-c950-4284-93a1-beb6ecdc59fd","Type":"ContainerStarted","Data":"cce09cb90710496da62df65a6cbec8b074dd5157be40fa6e5fa9bb067ceba996"}
Jul 21 16:37:54.571031 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:54.570996    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q" event={"ID":"61688d0f-c950-4284-93a1-beb6ecdc59fd","Type":"ContainerStarted","Data":"f1f266d49b3ab1a32355eb0d426c768b0d7ce308234bba8caf0f732ef0b9b81d"}
Jul 21 16:37:54.595349 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:37:54.595304    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q" podStartSLOduration=1.585800044 podStartE2EDuration="2.595290835s" totalImagesPullingTime="1.009490791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:54.593614717 +0000 UTC m=+856.410294161" watchObservedRunningTime="2026-07-21 16:37:54.595290835 +0000 UTC m=+856.411970278"
Jul 21 16:38:03.201842 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:03.201805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:38:03.202329 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:03.201870    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:38:03.214101 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:03.214077    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:38:03.631560 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:03.631533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q"
Jul 21 16:38:38.675650 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:38.675618    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:38:38.678352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:38.678330    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:38:43.470573 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:43.470528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:51.102905 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:38:51.102866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:25.508732 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:39:25.508698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:37.179480 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:39:37.179430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:59.837970 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:39:59.837913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:59.931344 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:39:59.931313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:40:00.977424 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:00.977353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:40:01.104359 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:01.104332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:40:37.170606 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:37.170574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:40:37.271737 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:37.271701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:40:47.489378 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.489348    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-ktkvx"]
Jul 21 16:40:47.489950 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.489554    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx" podUID="64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" containerName="manager" containerID="cri-o://d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401" gracePeriod=30
Jul 21 16:40:47.744666 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.744606    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:40:47.920771 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.920736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mxnq\" (UniqueName: \"kubernetes.io/projected/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-kube-api-access-8mxnq\") pod \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") "
Jul 21 16:40:47.920771 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.920773    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-webhook-cert\") pod \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\" (UID: \"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b\") "
Jul 21 16:40:47.922920 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.922894    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" (UID: "64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:40:47.922998 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:47.922949    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-kube-api-access-8mxnq" (OuterVolumeSpecName: "kube-api-access-8mxnq") pod "64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" (UID: "64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b"). InnerVolumeSpecName "kube-api-access-8mxnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:40:48.022224 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.022134    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mxnq\" (UniqueName: \"kubernetes.io/projected/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-kube-api-access-8mxnq\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:40:48.022224 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.022163    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b-webhook-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:40:48.518713 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.518678    2573 generic.go:356] "Generic (PLEG): container finished" podID="64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" containerID="d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401" exitCode=0
Jul 21 16:40:48.519242 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.518723    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx"
Jul 21 16:40:48.519242 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.518766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx" event={"ID":"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b","Type":"ContainerDied","Data":"d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401"}
Jul 21 16:40:48.519242 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.518821    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-ktkvx" event={"ID":"64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b","Type":"ContainerDied","Data":"f9aaa54057ecbcb38a45185c5948e832cb5878ea2e2f773dc0a4bb46af43c9a2"}
Jul 21 16:40:48.519242 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.518843    2573 scope.go:117] "RemoveContainer" containerID="d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401"
Jul 21 16:40:48.528689 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.528669    2573 scope.go:117] "RemoveContainer" containerID="d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401"
Jul 21 16:40:48.528957 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:40:48.528939    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401\": container with ID starting with d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401 not found: ID does not exist" containerID="d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401"
Jul 21 16:40:48.529009 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.528964    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401"} err="failed to get container status \"d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401\": rpc error: code = NotFound desc = could not find container \"d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401\": container with ID starting with d3cebb53f5a9b1ab1a6e48f791bbaa37bde15eea733834c97a5a2ccc0bf72401 not found: ID does not exist"
Jul 21 16:40:48.542155 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.542133    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-ktkvx"]
Jul 21 16:40:48.547979 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.547959    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-ktkvx"]
Jul 21 16:40:48.699717 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:40:48.699688    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" path="/var/lib/kubelet/pods/64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b/volumes"
Jul 21 16:41:49.428537 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.428504    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-sltmk"]
Jul 21 16:41:49.429012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.428916    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" containerName="manager"
Jul 21 16:41:49.429012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.428928    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" containerName="manager"
Jul 21 16:41:49.429012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.429013    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f700d0-fb5e-45d2-aa2f-7f0a3dfc071b" containerName="manager"
Jul 21 16:41:49.433220 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.433203    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.437591 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.437567    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:41:49.437721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.437567    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pg569\""
Jul 21 16:41:49.437721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.437568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:41:49.441125 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.441105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kf5z\" (UniqueName: \"kubernetes.io/projected/410269f9-f1ab-49f3-8b25-c8b498a52056-kube-api-access-9kf5z\") pod \"maas-controller-7fd46cd8d7-sltmk\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") " pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.441249 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.441199    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/410269f9-f1ab-49f3-8b25-c8b498a52056-webhook-cert\") pod \"maas-controller-7fd46cd8d7-sltmk\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") " pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.442864 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.442842    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-sltmk"]
Jul 21 16:41:49.541718 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.541689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kf5z\" (UniqueName: \"kubernetes.io/projected/410269f9-f1ab-49f3-8b25-c8b498a52056-kube-api-access-9kf5z\") pod \"maas-controller-7fd46cd8d7-sltmk\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") " pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.541932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.541753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/410269f9-f1ab-49f3-8b25-c8b498a52056-webhook-cert\") pod \"maas-controller-7fd46cd8d7-sltmk\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") " pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.544159 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.544136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/410269f9-f1ab-49f3-8b25-c8b498a52056-webhook-cert\") pod \"maas-controller-7fd46cd8d7-sltmk\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") " pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.551574 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.551551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kf5z\" (UniqueName: \"kubernetes.io/projected/410269f9-f1ab-49f3-8b25-c8b498a52056-kube-api-access-9kf5z\") pod \"maas-controller-7fd46cd8d7-sltmk\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") " pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:49.744394 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:49.744322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:50.092528 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:50.092502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-sltmk"]
Jul 21 16:41:50.093817 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:41:50.093784    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410269f9_f1ab_49f3_8b25_c8b498a52056.slice/crio-3da46c3f78c3721515de4856b7ab7dea93fd519922a1a3514d4fed557a047edd WatchSource:0}: Error finding container 3da46c3f78c3721515de4856b7ab7dea93fd519922a1a3514d4fed557a047edd: Status 404 returned error can't find the container with id 3da46c3f78c3721515de4856b7ab7dea93fd519922a1a3514d4fed557a047edd
Jul 21 16:41:50.095108 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:50.095091    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:41:50.866205 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:50.866102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk" event={"ID":"410269f9-f1ab-49f3-8b25-c8b498a52056","Type":"ContainerStarted","Data":"a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733"}
Jul 21 16:41:50.866205 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:50.866164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk" event={"ID":"410269f9-f1ab-49f3-8b25-c8b498a52056","Type":"ContainerStarted","Data":"3da46c3f78c3721515de4856b7ab7dea93fd519922a1a3514d4fed557a047edd"}
Jul 21 16:41:50.866205 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:50.866194    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:41:50.936205 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:41:50.936157    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk" podStartSLOduration=1.476935723 podStartE2EDuration="1.936141381s" totalImagesPullingTime="459.205658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:41:50.918047838 +0000 UTC m=+1092.734727282" watchObservedRunningTime="2026-07-21 16:41:50.936141381 +0000 UTC m=+1092.752820857"
Jul 21 16:42:01.874725 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:01.874690    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:42:06.413197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.413158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:06.494598 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.494565    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-sltmk"]
Jul 21 16:42:06.494810 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.494774    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk" podUID="410269f9-f1ab-49f3-8b25-c8b498a52056" containerName="manager" containerID="cri-o://a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733" gracePeriod=30
Jul 21 16:42:06.741382 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.741360    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:42:06.774895 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.774856    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kf5z\" (UniqueName: \"kubernetes.io/projected/410269f9-f1ab-49f3-8b25-c8b498a52056-kube-api-access-9kf5z\") pod \"410269f9-f1ab-49f3-8b25-c8b498a52056\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") "
Jul 21 16:42:06.775040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.774929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/410269f9-f1ab-49f3-8b25-c8b498a52056-webhook-cert\") pod \"410269f9-f1ab-49f3-8b25-c8b498a52056\" (UID: \"410269f9-f1ab-49f3-8b25-c8b498a52056\") "
Jul 21 16:42:06.777219 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.777193    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410269f9-f1ab-49f3-8b25-c8b498a52056-kube-api-access-9kf5z" (OuterVolumeSpecName: "kube-api-access-9kf5z") pod "410269f9-f1ab-49f3-8b25-c8b498a52056" (UID: "410269f9-f1ab-49f3-8b25-c8b498a52056"). InnerVolumeSpecName "kube-api-access-9kf5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:42:06.777390 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.777367    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410269f9-f1ab-49f3-8b25-c8b498a52056-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "410269f9-f1ab-49f3-8b25-c8b498a52056" (UID: "410269f9-f1ab-49f3-8b25-c8b498a52056"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:42:06.875669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.875641    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kf5z\" (UniqueName: \"kubernetes.io/projected/410269f9-f1ab-49f3-8b25-c8b498a52056-kube-api-access-9kf5z\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:42:06.875669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.875668    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/410269f9-f1ab-49f3-8b25-c8b498a52056-webhook-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:42:06.952101 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.952075    2573 generic.go:356] "Generic (PLEG): container finished" podID="410269f9-f1ab-49f3-8b25-c8b498a52056" containerID="a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733" exitCode=0
Jul 21 16:42:06.952227 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.952117    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk"
Jul 21 16:42:06.952227 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.952152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk" event={"ID":"410269f9-f1ab-49f3-8b25-c8b498a52056","Type":"ContainerDied","Data":"a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733"}
Jul 21 16:42:06.952227 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.952208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-sltmk" event={"ID":"410269f9-f1ab-49f3-8b25-c8b498a52056","Type":"ContainerDied","Data":"3da46c3f78c3721515de4856b7ab7dea93fd519922a1a3514d4fed557a047edd"}
Jul 21 16:42:06.952329 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.952236    2573 scope.go:117] "RemoveContainer" containerID="a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733"
Jul 21 16:42:06.962096 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.962078    2573 scope.go:117] "RemoveContainer" containerID="a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733"
Jul 21 16:42:06.962351 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:42:06.962331    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733\": container with ID starting with a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733 not found: ID does not exist" containerID="a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733"
Jul 21 16:42:06.962407 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.962360    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733"} err="failed to get container status \"a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733\": rpc error: code = NotFound desc = could not find container \"a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733\": container with ID starting with a393c099e776f47614aa39a4dbf40ee23ee25bb55337b909a2a367e15bfc7733 not found: ID does not exist"
Jul 21 16:42:06.979866 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.979816    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-sltmk"]
Jul 21 16:42:06.984875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:06.984852    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-sltmk"]
Jul 21 16:42:07.640905 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.640851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:07.752699 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.752668    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-l8fzj"]
Jul 21 16:42:07.753062 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.753048    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410269f9-f1ab-49f3-8b25-c8b498a52056" containerName="manager"
Jul 21 16:42:07.753115 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.753063    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="410269f9-f1ab-49f3-8b25-c8b498a52056" containerName="manager"
Jul 21 16:42:07.753151 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.753141    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="410269f9-f1ab-49f3-8b25-c8b498a52056" containerName="manager"
Jul 21 16:42:07.757328 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.757308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:07.761401 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.761377    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:42:07.761526 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.761412    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:42:07.761526 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.761440    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pg569\""
Jul 21 16:42:07.768854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.768832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-l8fzj"]
Jul 21 16:42:07.882458 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.882436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/260230f6-bd1d-426f-b0db-fed5db014e75-webhook-cert\") pod \"maas-controller-7fd46cd8d7-l8fzj\" (UID: \"260230f6-bd1d-426f-b0db-fed5db014e75\") " pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:07.882584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.882484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6j66\" (UniqueName: \"kubernetes.io/projected/260230f6-bd1d-426f-b0db-fed5db014e75-kube-api-access-t6j66\") pod \"maas-controller-7fd46cd8d7-l8fzj\" (UID: \"260230f6-bd1d-426f-b0db-fed5db014e75\") " pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:07.983053 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.982984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6j66\" (UniqueName: \"kubernetes.io/projected/260230f6-bd1d-426f-b0db-fed5db014e75-kube-api-access-t6j66\") pod \"maas-controller-7fd46cd8d7-l8fzj\" (UID: \"260230f6-bd1d-426f-b0db-fed5db014e75\") " pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:07.983192 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.983063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/260230f6-bd1d-426f-b0db-fed5db014e75-webhook-cert\") pod \"maas-controller-7fd46cd8d7-l8fzj\" (UID: \"260230f6-bd1d-426f-b0db-fed5db014e75\") " pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:07.985139 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.985117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/260230f6-bd1d-426f-b0db-fed5db014e75-webhook-cert\") pod \"maas-controller-7fd46cd8d7-l8fzj\" (UID: \"260230f6-bd1d-426f-b0db-fed5db014e75\") " pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:07.992313 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:07.992290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6j66\" (UniqueName: \"kubernetes.io/projected/260230f6-bd1d-426f-b0db-fed5db014e75-kube-api-access-t6j66\") pod \"maas-controller-7fd46cd8d7-l8fzj\" (UID: \"260230f6-bd1d-426f-b0db-fed5db014e75\") " pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:08.067574 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.067551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:08.205792 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.205768    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fd46cd8d7-l8fzj"]
Jul 21 16:42:08.207563 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:42:08.207539    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260230f6_bd1d_426f_b0db_fed5db014e75.slice/crio-081b8274c2171e0e75113881188940e1152659d9fb2e68eaacb3134702673465 WatchSource:0}: Error finding container 081b8274c2171e0e75113881188940e1152659d9fb2e68eaacb3134702673465: Status 404 returned error can't find the container with id 081b8274c2171e0e75113881188940e1152659d9fb2e68eaacb3134702673465
Jul 21 16:42:08.701569 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.701545    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410269f9-f1ab-49f3-8b25-c8b498a52056" path="/var/lib/kubelet/pods/410269f9-f1ab-49f3-8b25-c8b498a52056/volumes"
Jul 21 16:42:08.966068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.965975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj" event={"ID":"260230f6-bd1d-426f-b0db-fed5db014e75","Type":"ContainerStarted","Data":"d23a9c56122c6c24b67fc27e92452eed16a7fbec9e74ce5ece78fc1fcaaefaf0"}
Jul 21 16:42:08.966068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.966037    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj" event={"ID":"260230f6-bd1d-426f-b0db-fed5db014e75","Type":"ContainerStarted","Data":"081b8274c2171e0e75113881188940e1152659d9fb2e68eaacb3134702673465"}
Jul 21 16:42:08.966068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.966066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:08.988661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:08.988608    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj" podStartSLOduration=1.532679683 podStartE2EDuration="1.98859247s" totalImagesPullingTime="455.912787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:42:08.987989006 +0000 UTC m=+1110.804668448" watchObservedRunningTime="2026-07-21 16:42:08.98859247 +0000 UTC m=+1110.805271912"
Jul 21 16:42:19.973124 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:19.973092    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fd46cd8d7-l8fzj"
Jul 21 16:42:37.851868 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:37.851831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:37.953879 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:37.953833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:50.134117 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:50.134065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:50.234443 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:50.234413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:50.381010 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:50.380983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:56.063379 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:56.063344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:56.163191 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:56.163160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:56.263370 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:56.263339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:56.396755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:42:56.396673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:43:02.283243 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:43:02.283159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:43:02.386055 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:43:02.386002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:43:38.711615 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:43:38.711590    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:43:38.715739 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:43:38.715715    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:44:41.947099 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:44:41.947000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:44:51.705449 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:44:51.705400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:45:00.147032 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.147001    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"]
Jul 21 16:45:00.150500 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.150483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"
Jul 21 16:45:00.153437 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.153413    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 16:45:00.160114 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.160095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"
Jul 21 16:45:00.166520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.166494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"]
Jul 21 16:45:00.291875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.291847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"]
Jul 21 16:45:00.293455 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:45:00.293429    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb93208_8b5e_4a4a_a308_7dd9fc1900b9.slice/crio-c37f021f2d63388e26ae89edbb794d1fbd8c68e32eeeaa1614a28190f02e474e WatchSource:0}: Error finding container c37f021f2d63388e26ae89edbb794d1fbd8c68e32eeeaa1614a28190f02e474e: Status 404 returned error can't find the container with id c37f021f2d63388e26ae89edbb794d1fbd8c68e32eeeaa1614a28190f02e474e
Jul 21 16:45:00.909809 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:00.909775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk" event={"ID":"ebb93208-8b5e-4a4a-a308-7dd9fc1900b9","Type":"ContainerStarted","Data":"c37f021f2d63388e26ae89edbb794d1fbd8c68e32eeeaa1614a28190f02e474e"}
Jul 21 16:45:09.966386 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:09.966353    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk" event={"ID":"ebb93208-8b5e-4a4a-a308-7dd9fc1900b9","Type":"ContainerStarted","Data":"8ac9090799063d67bbcdef83b115f44eefb3834707a85ba5d990b4c708433530"}
Jul 21 16:45:09.982091 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:09.982052    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk" podStartSLOduration=1.153427252 podStartE2EDuration="9.982039113s" totalImagesPullingTime="8.828611861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:45:09.98152782 +0000 UTC m=+1291.798207264" watchObservedRunningTime="2026-07-21 16:45:09.982039113 +0000 UTC m=+1291.798718555"
Jul 21 16:45:10.973713 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:10.973677    2573 generic.go:356] "Generic (PLEG): container finished" podID="ebb93208-8b5e-4a4a-a308-7dd9fc1900b9" containerID="8ac9090799063d67bbcdef83b115f44eefb3834707a85ba5d990b4c708433530" exitCode=0
Jul 21 16:45:10.974135 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:10.973728    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk" event={"ID":"ebb93208-8b5e-4a4a-a308-7dd9fc1900b9","Type":"ContainerDied","Data":"8ac9090799063d67bbcdef83b115f44eefb3834707a85ba5d990b4c708433530"}
Jul 21 16:45:12.113114 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:12.113090    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"
Jul 21 16:45:12.986095 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:12.986017    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk"
Jul 21 16:45:12.986095 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:12.986016    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744205-2lpwk" event={"ID":"ebb93208-8b5e-4a4a-a308-7dd9fc1900b9","Type":"ContainerDied","Data":"c37f021f2d63388e26ae89edbb794d1fbd8c68e32eeeaa1614a28190f02e474e"}
Jul 21 16:45:12.986095 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:45:12.986068    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c37f021f2d63388e26ae89edbb794d1fbd8c68e32eeeaa1614a28190f02e474e"
Jul 21 16:48:38.748746 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:48:38.748716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:48:38.754668 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:48:38.754645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:49:50.018007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:49:50.017971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:49:51.109680 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:49:51.109639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:15.875371 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:50:15.875321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:58.397781 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:50:58.397706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:23.429086 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:51:23.429039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:40.925990 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:51:40.925955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:41.989182 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:51:41.989149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:50.190835 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:51:50.190800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:38.788249 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:53:38.788225    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:53:38.792721 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:53:38.792700    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:54:01.113423 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:54:01.113369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:01.185520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:54:01.185494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:52.531428 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:54:52.531393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:57.861897 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:54:57.861849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:06.122024 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:06.121937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:11.345247 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:11.345206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:14.353106 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:14.353065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:14.456666 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:14.456635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:14.876930 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:14.876897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:21.043661 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.043597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:21.150467 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.150433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:21.285209 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.285173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:21.752844 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.752806    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"]
Jul 21 16:55:21.753225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.753212    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb93208-8b5e-4a4a-a308-7dd9fc1900b9" containerName="cleanup"
Jul 21 16:55:21.753225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.753226    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb93208-8b5e-4a4a-a308-7dd9fc1900b9" containerName="cleanup"
Jul 21 16:55:21.753344 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.753285    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb93208-8b5e-4a4a-a308-7dd9fc1900b9" containerName="cleanup"
Jul 21 16:55:21.756285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.756268    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.760875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.760859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-843df0de-openshift-default-dockercfg-nkdcf\""
Jul 21 16:55:21.788875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.788849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:21.798855 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.798832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"]
Jul 21 16:55:21.914284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31660601-4a9c-4e76-afe4-d5ac7f18694a-istiod-ca-cert\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914284 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljjs\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-kube-api-access-pljjs\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914551 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-credential-socket\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914551 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-certs\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914551 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-data\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914551 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-token\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914787 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-envoy\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914787 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-podinfo\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:21.914787 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:21.914612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-socket\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31660601-4a9c-4e76-afe4-d5ac7f18694a-istiod-ca-cert\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pljjs\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-kube-api-access-pljjs\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-credential-socket\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-certs\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-data\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-token\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-envoy\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-podinfo\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.015823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-socket\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.016166 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.015973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-credential-socket\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.016166 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.016026    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-data\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.016277 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.016232    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-certs\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.016277 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.016247    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31660601-4a9c-4e76-afe4-d5ac7f18694a-istiod-ca-cert\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.016363 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.016295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-socket\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.018285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.018258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-envoy\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.018285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.018262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-podinfo\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.025235 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.025208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljjs\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-kube-api-access-pljjs\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.025914 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.025880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-token\") pod \"e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") " pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.066175 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.066144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:22.108711 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.108673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:22.213521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.213495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"]
Jul 21 16:55:22.214614 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:55:22.214588    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31660601_4a9c_4e76_afe4_d5ac7f18694a.slice/crio-5465794916c57c3a3a745bccddc93f077b7a83218546ea4d523d68bd13e0594d WatchSource:0}: Error finding container 5465794916c57c3a3a745bccddc93f077b7a83218546ea4d523d68bd13e0594d: Status 404 returned error can't find the container with id 5465794916c57c3a3a745bccddc93f077b7a83218546ea4d523d68bd13e0594d
Jul 21 16:55:22.216833 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.216802    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:55:22.224623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.217324    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:55:22.224623 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.217458    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:55:22.340493 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.340457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" event={"ID":"31660601-4a9c-4e76-afe4-d5ac7f18694a","Type":"ContainerStarted","Data":"d8718406ef7b58b42b7aa13b3964dcf2471222bc71381ea1ff4a9a4c4fa85a69"}
Jul 21 16:55:22.340667 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.340559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" event={"ID":"31660601-4a9c-4e76-afe4-d5ac7f18694a","Type":"ContainerStarted","Data":"5465794916c57c3a3a745bccddc93f077b7a83218546ea4d523d68bd13e0594d"}
Jul 21 16:55:22.368860 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:22.368804    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podStartSLOduration=1.368783356 podStartE2EDuration="1.368783356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:55:22.365185496 +0000 UTC m=+1904.181864952" watchObservedRunningTime="2026-07-21 16:55:22.368783356 +0000 UTC m=+1904.185462807"
Jul 21 16:55:23.066647 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.066614    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:23.071730 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.071706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:23.345733 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.345636    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:23.346735 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.346713    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:23.741323 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.741214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:23.864326 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.864278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:23.968192 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:23.968156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:24.258481 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:24.258428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:24.487007 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:24.486952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:24.664965 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:24.664932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:31.032960 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:31.032920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:31.103929 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:31.103874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:39.099789 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.098424    2573 patch_prober.go:28] interesting pod/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:37974->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Jul 21 16:55:39.099789 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.098487    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:37974->10.132.0.53:15021: read: connection reset by peer"
Jul 21 16:55:39.436964 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.436856    2573 generic.go:356] "Generic (PLEG): container finished" podID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerID="d8718406ef7b58b42b7aa13b3964dcf2471222bc71381ea1ff4a9a4c4fa85a69" exitCode=0
Jul 21 16:55:39.436964 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.436939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" event={"ID":"31660601-4a9c-4e76-afe4-d5ac7f18694a","Type":"ContainerDied","Data":"d8718406ef7b58b42b7aa13b3964dcf2471222bc71381ea1ff4a9a4c4fa85a69"}
Jul 21 16:55:39.437341 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.437325    2573 scope.go:117] "RemoveContainer" containerID="d8718406ef7b58b42b7aa13b3964dcf2471222bc71381ea1ff4a9a4c4fa85a69"
Jul 21 16:55:39.438290 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.438264    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:55:39.438347 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.438328    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:55:39.438387 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:39.438359    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:55:40.447735 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:40.447701    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" event={"ID":"31660601-4a9c-4e76-afe4-d5ac7f18694a","Type":"ContainerStarted","Data":"c7868c79adfb2643bbc06e942f3648af7135ccd00923ebb4a59302d56938fb9e"}
Jul 21 16:55:41.066968 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:41.066928    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:41.067185 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:41.067164    2573 patch_prober.go:28] interesting pod/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:55:41.067234 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:41.067210    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 16:55:42.066712 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:42.066674    2573 patch_prober.go:28] interesting pod/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:55:42.067154 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:42.066746    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 16:55:43.066549 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:43.066515    2573 patch_prober.go:28] interesting pod/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:55:43.066792 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:43.066769    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 16:55:44.066893 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:44.066856    2573 patch_prober.go:28] interesting pod/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:55:44.067286 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:44.066944    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 16:55:45.070854 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:45.070822    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:45.071269 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:45.071218    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:45.071874 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:45.071859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:55:49.264572 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.264539    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"]
Jul 21 16:55:49.268179 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.268162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:49.274968 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.274602    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 16:55:49.275855 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.275835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:55:49.280555 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.280534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"]
Jul 21 16:55:49.372079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.372037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cb0124-1195-4e8d-a1e7-26f87a201c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-843df0de-nvfwh\" (UID: \"24cb0124-1195-4e8d-a1e7-26f87a201c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:49.472865 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.472825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cb0124-1195-4e8d-a1e7-26f87a201c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-843df0de-nvfwh\" (UID: \"24cb0124-1195-4e8d-a1e7-26f87a201c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:49.473478 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.473456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cb0124-1195-4e8d-a1e7-26f87a201c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-843df0de-nvfwh\" (UID: \"24cb0124-1195-4e8d-a1e7-26f87a201c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:49.579733 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.579700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:49.727385 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:49.727356    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"]
Jul 21 16:55:49.729023 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:55:49.728996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cb0124_1195_4e8d_a1e7_26f87a201c94.slice/crio-ae0ca0903c554a72b87f55478244dd6399a134cfeb51b885ba659d4f60301633 WatchSource:0}: Error finding container ae0ca0903c554a72b87f55478244dd6399a134cfeb51b885ba659d4f60301633: Status 404 returned error can't find the container with id ae0ca0903c554a72b87f55478244dd6399a134cfeb51b885ba659d4f60301633
Jul 21 16:55:50.505914 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:50.505865    2573 generic.go:356] "Generic (PLEG): container finished" podID="24cb0124-1195-4e8d-a1e7-26f87a201c94" containerID="77448aa1a080728ce0524ff48b11d26f69c06224c7c3764e960ff931748004bf" exitCode=0
Jul 21 16:55:50.506286 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:50.505917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh" event={"ID":"24cb0124-1195-4e8d-a1e7-26f87a201c94","Type":"ContainerDied","Data":"77448aa1a080728ce0524ff48b11d26f69c06224c7c3764e960ff931748004bf"}
Jul 21 16:55:50.506286 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:50.505975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh" event={"ID":"24cb0124-1195-4e8d-a1e7-26f87a201c94","Type":"ContainerStarted","Data":"ae0ca0903c554a72b87f55478244dd6399a134cfeb51b885ba659d4f60301633"}
Jul 21 16:55:51.650433 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:51.650407    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:51.696518 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:51.696486    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cb0124-1195-4e8d-a1e7-26f87a201c94-maas-api-service-ca\") pod \"24cb0124-1195-4e8d-a1e7-26f87a201c94\" (UID: \"24cb0124-1195-4e8d-a1e7-26f87a201c94\") "
Jul 21 16:55:51.696856 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:51.696833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24cb0124-1195-4e8d-a1e7-26f87a201c94-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24cb0124-1195-4e8d-a1e7-26f87a201c94" (UID: "24cb0124-1195-4e8d-a1e7-26f87a201c94"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:55:51.798160 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:51.798135    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cb0124-1195-4e8d-a1e7-26f87a201c94-maas-api-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:55:52.524103 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:52.524073    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"
Jul 21 16:55:52.524412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:52.524114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh" event={"ID":"24cb0124-1195-4e8d-a1e7-26f87a201c94","Type":"ContainerDied","Data":"ae0ca0903c554a72b87f55478244dd6399a134cfeb51b885ba659d4f60301633"}
Jul 21 16:55:52.524412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:52.524180    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae0ca0903c554a72b87f55478244dd6399a134cfeb51b885ba659d4f60301633"
Jul 21 16:55:59.720162 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:55:59.720129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:04.339112 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.339076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:04.339660 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.339638    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"]
Jul 21 16:56:04.342682 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.342656    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-843df0de-nvfwh"]
Jul 21 16:56:04.476868 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.476839    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"]
Jul 21 16:56:04.477071 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.477048    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy" containerID="cri-o://c7868c79adfb2643bbc06e942f3648af7135ccd00923ebb4a59302d56938fb9e" gracePeriod=30
Jul 21 16:56:04.498557 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.498528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:04.699264 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.699192    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24cb0124-1195-4e8d-a1e7-26f87a201c94" path="/var/lib/kubelet/pods/24cb0124-1195-4e8d-a1e7-26f87a201c94/volumes"
Jul 21 16:56:04.713324 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.713300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:04.975033 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:04.974954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.073761 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.073725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.174393 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.174365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.476515 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.476478    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"]
Jul 21 16:56:05.477249 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.477230    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24cb0124-1195-4e8d-a1e7-26f87a201c94" containerName="revoke-keys"
Jul 21 16:56:05.477249 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.477250    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24cb0124-1195-4e8d-a1e7-26f87a201c94" containerName="revoke-keys"
Jul 21 16:56:05.477424 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.477345    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24cb0124-1195-4e8d-a1e7-26f87a201c94" containerName="revoke-keys"
Jul 21 16:56:05.480853 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.480833    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.485430 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.485412    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bbd93f74-gw-openshift-default-dockercfg-bj2qm\""
Jul 21 16:56:05.498860 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.498839    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"]
Jul 21 16:56:05.507295 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.507273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.635128 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f471bc-cccc-433c-bd79-b559e45ad3df-istiod-ca-cert\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635128 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-certs\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635333 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-envoy\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635333 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-socket\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635333 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7qdp\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-kube-api-access-z7qdp\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635333 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-credential-socket\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635480 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-token\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635480 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-podinfo\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.635480 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.635400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-data\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-envoy\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-socket\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7qdp\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-kube-api-access-z7qdp\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-credential-socket\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-token\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-podinfo\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-data\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f471bc-cccc-433c-bd79-b559e45ad3df-istiod-ca-cert\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736567 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-certs\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-socket\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736771    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-credential-socket\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736854    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-certs\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.736875 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.736875    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-data\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.737279 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.737254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f471bc-cccc-433c-bd79-b559e45ad3df-istiod-ca-cert\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.738693 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.738671    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-envoy\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.738820 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.738801    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-podinfo\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.748669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.748649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-token\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.749195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.749176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7qdp\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-kube-api-access-z7qdp\") pod \"e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") " pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.767005 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.766985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.791054 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.791030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:05.935077 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.935046    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"]
Jul 21 16:56:05.938020 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:56:05.937996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f471bc_cccc_433c_bd79_b559e45ad3df.slice/crio-030221c24bffee9fda98a06dc16a34b02adaa0cc450809f5f650e6058e44b855 WatchSource:0}: Error finding container 030221c24bffee9fda98a06dc16a34b02adaa0cc450809f5f650e6058e44b855: Status 404 returned error can't find the container with id 030221c24bffee9fda98a06dc16a34b02adaa0cc450809f5f650e6058e44b855
Jul 21 16:56:05.940239 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.940208    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:05.940317 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.940275    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:05.940317 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:05.940302    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:06.606588 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:06.606553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" event={"ID":"92f471bc-cccc-433c-bd79-b559e45ad3df","Type":"ContainerStarted","Data":"1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"}
Jul 21 16:56:06.607102 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:06.606608    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" event={"ID":"92f471bc-cccc-433c-bd79-b559e45ad3df","Type":"ContainerStarted","Data":"030221c24bffee9fda98a06dc16a34b02adaa0cc450809f5f650e6058e44b855"}
Jul 21 16:56:06.628246 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:06.628203    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podStartSLOduration=1.628188492 podStartE2EDuration="1.628188492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:06.625604961 +0000 UTC m=+1948.442284415" watchObservedRunningTime="2026-07-21 16:56:06.628188492 +0000 UTC m=+1948.444867934"
Jul 21 16:56:06.791977 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:06.791945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:06.796486 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:06.796464    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:07.612422 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:07.612394    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:07.613285 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:07.613268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:08.113133 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:08.113098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:08.377142 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:08.377067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:08.527202 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:08.527172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:08.897173 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:08.897137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:09.005163 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.005136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:09.628082 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.628049    2573 generic.go:356] "Generic (PLEG): container finished" podID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerID="c7868c79adfb2643bbc06e942f3648af7135ccd00923ebb4a59302d56938fb9e" exitCode=0
Jul 21 16:56:09.628228 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.628124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" event={"ID":"31660601-4a9c-4e76-afe4-d5ac7f18694a","Type":"ContainerDied","Data":"c7868c79adfb2643bbc06e942f3648af7135ccd00923ebb4a59302d56938fb9e"}
Jul 21 16:56:09.628282 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.628214    2573 scope.go:117] "RemoveContainer" containerID="d8718406ef7b58b42b7aa13b3964dcf2471222bc71381ea1ff4a9a4c4fa85a69"
Jul 21 16:56:09.729314 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.729291    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:56:09.876644 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-data\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.876795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876662    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-podinfo\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.876795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876705    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31660601-4a9c-4e76-afe4-d5ac7f18694a-istiod-ca-cert\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.876795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-socket\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.876795 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876775    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-certs\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.877036 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876824    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-token\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.877036 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pljjs\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-kube-api-access-pljjs\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.877036 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876915    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-envoy\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.877036 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.876984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-credential-socket\") pod \"31660601-4a9c-4e76-afe4-d5ac7f18694a\" (UID: \"31660601-4a9c-4e76-afe4-d5ac7f18694a\") "
Jul 21 16:56:09.877246 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877067    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:09.877246 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877073    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31660601-4a9c-4e76-afe4-d5ac7f18694a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:09.877246 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:09.877446 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877384    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31660601-4a9c-4e76-afe4-d5ac7f18694a-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.877446 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877429    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.877640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877449    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.877640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877446    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:09.877640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.877539    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-data" (OuterVolumeSpecName: "istio-data") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:09.879240 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.879217    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-token" (OuterVolumeSpecName: "istio-token") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:09.879333 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.879245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-kube-api-access-pljjs" (OuterVolumeSpecName: "kube-api-access-pljjs") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "kube-api-access-pljjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:09.879333 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.879315    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:56:09.879400 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.879320    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31660601-4a9c-4e76-afe4-d5ac7f18694a" (UID: "31660601-4a9c-4e76-afe4-d5ac7f18694a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:09.978821 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.978798    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pljjs\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-kube-api-access-pljjs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.978821 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.978822    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.979193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.978831    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.979193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.978839    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.979193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.978848    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:09.979193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:09.978856    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31660601-4a9c-4e76-afe4-d5ac7f18694a-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:10.635327 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:10.635298    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"
Jul 21 16:56:10.635502 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:10.635335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6" event={"ID":"31660601-4a9c-4e76-afe4-d5ac7f18694a","Type":"ContainerDied","Data":"5465794916c57c3a3a745bccddc93f077b7a83218546ea4d523d68bd13e0594d"}
Jul 21 16:56:10.635502 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:10.635390    2573 scope.go:117] "RemoveContainer" containerID="c7868c79adfb2643bbc06e942f3648af7135ccd00923ebb4a59302d56938fb9e"
Jul 21 16:56:10.661961 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:10.661929    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"]
Jul 21 16:56:10.666453 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:10.666432    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-843df0de-openshift-default-7d4f4f9d6c-xb4z6"]
Jul 21 16:56:10.700383 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:10.700359    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" path="/var/lib/kubelet/pods/31660601-4a9c-4e76-afe4-d5ac7f18694a/volumes"
Jul 21 16:56:22.701482 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:22.700263    2573 patch_prober.go:28] interesting pod/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:36882->10.132.0.55:15021: read: connection reset by peer" start-of-body=
Jul 21 16:56:22.701482 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:22.700335    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:36882->10.132.0.55:15021: read: connection reset by peer"
Jul 21 16:56:23.713193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:23.713160    2573 generic.go:356] "Generic (PLEG): container finished" podID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerID="1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663" exitCode=0
Jul 21 16:56:23.713677 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:23.713231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" event={"ID":"92f471bc-cccc-433c-bd79-b559e45ad3df","Type":"ContainerDied","Data":"1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"}
Jul 21 16:56:23.713677 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:23.713612    2573 scope.go:117] "RemoveContainer" containerID="1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"
Jul 21 16:56:23.714640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:23.714610    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:23.714760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:23.714696    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:23.714834 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:23.714756    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:24.720105 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:24.720066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" event={"ID":"92f471bc-cccc-433c-bd79-b559e45ad3df","Type":"ContainerStarted","Data":"d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4"}
Jul 21 16:56:24.791584 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:24.791552    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:24.791786 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:24.791765    2573 patch_prober.go:28] interesting pod/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:56:24.791838 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:24.791812    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 16:56:25.791772 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:25.791740    2573 patch_prober.go:28] interesting pod/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:56:25.792176 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:25.791798    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 16:56:26.791581 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:26.791548    2573 patch_prober.go:28] interesting pod/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:56:26.791767 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:26.791606    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 16:56:27.791842 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:27.791805    2573 patch_prober.go:28] interesting pod/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:56:27.792238 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:27.791860    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 16:56:28.795102 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:28.795071    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:28.795503 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:28.795411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:28.796274 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:28.796254    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:33.111664 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.111633    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"]
Jul 21 16:56:33.112064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.112048    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy"
Jul 21 16:56:33.112064 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.112060    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy"
Jul 21 16:56:33.112140 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.112076    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy"
Jul 21 16:56:33.112140 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.112082    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy"
Jul 21 16:56:33.112206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.112149    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy"
Jul 21 16:56:33.112206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.112157    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="31660601-4a9c-4e76-afe4-d5ac7f18694a" containerName="istio-proxy"
Jul 21 16:56:33.115641 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.115625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:33.119932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.119910    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:56:33.120079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.119960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 16:56:33.129787 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.129764    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"]
Jul 21 16:56:33.185589 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.185565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0769587f-8ade-49c2-8055-e47758e8ce16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4\" (UID: \"0769587f-8ade-49c2-8055-e47758e8ce16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:33.286923 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.286867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0769587f-8ade-49c2-8055-e47758e8ce16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4\" (UID: \"0769587f-8ade-49c2-8055-e47758e8ce16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:33.287495 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.287470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0769587f-8ade-49c2-8055-e47758e8ce16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4\" (UID: \"0769587f-8ade-49c2-8055-e47758e8ce16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:33.428360 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.428288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:33.567611 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.567583    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"]
Jul 21 16:56:33.571613 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:56:33.571586    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0769587f_8ade_49c2_8055_e47758e8ce16.slice/crio-120788734aef10978242818fbcde695c587382642c78c504d8786e85aba9646a WatchSource:0}: Error finding container 120788734aef10978242818fbcde695c587382642c78c504d8786e85aba9646a: Status 404 returned error can't find the container with id 120788734aef10978242818fbcde695c587382642c78c504d8786e85aba9646a
Jul 21 16:56:33.779825 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:33.779792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4" event={"ID":"0769587f-8ade-49c2-8055-e47758e8ce16","Type":"ContainerStarted","Data":"120788734aef10978242818fbcde695c587382642c78c504d8786e85aba9646a"}
Jul 21 16:56:34.787834 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:34.787794    2573 generic.go:356] "Generic (PLEG): container finished" podID="0769587f-8ade-49c2-8055-e47758e8ce16" containerID="c548d3f0d6a0afaac108cdece903e217f33c4a241a27886526fcbcc25c0ab58b" exitCode=0
Jul 21 16:56:34.788359 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:34.787842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4" event={"ID":"0769587f-8ade-49c2-8055-e47758e8ce16","Type":"ContainerDied","Data":"c548d3f0d6a0afaac108cdece903e217f33c4a241a27886526fcbcc25c0ab58b"}
Jul 21 16:56:35.928617 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:35.928594    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:36.015785 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:36.015759    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0769587f-8ade-49c2-8055-e47758e8ce16-maas-api-service-ca\") pod \"0769587f-8ade-49c2-8055-e47758e8ce16\" (UID: \"0769587f-8ade-49c2-8055-e47758e8ce16\") "
Jul 21 16:56:36.016151 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:36.016131    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0769587f-8ade-49c2-8055-e47758e8ce16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0769587f-8ade-49c2-8055-e47758e8ce16" (UID: "0769587f-8ade-49c2-8055-e47758e8ce16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:36.117188 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:36.117119    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0769587f-8ade-49c2-8055-e47758e8ce16-maas-api-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:36.803506 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:36.803481    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"
Jul 21 16:56:36.803684 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:36.803508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4" event={"ID":"0769587f-8ade-49c2-8055-e47758e8ce16","Type":"ContainerDied","Data":"120788734aef10978242818fbcde695c587382642c78c504d8786e85aba9646a"}
Jul 21 16:56:36.803684 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:36.803550    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="120788734aef10978242818fbcde695c587382642c78c504d8786e85aba9646a"
Jul 21 16:56:43.553724 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:43.553691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.214253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.214197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.214819 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.214797    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"]
Jul 21 16:56:48.219210 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.219190    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bbd93f74-z97j4"]
Jul 21 16:56:48.364094 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.364059    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"]
Jul 21 16:56:48.364399 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.364369    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy" containerID="cri-o://d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4" gracePeriod=30
Jul 21 16:56:48.384201 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.384176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.697101 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.697062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.700505 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.700483    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0769587f-8ade-49c2-8055-e47758e8ce16" path="/var/lib/kubelet/pods/0769587f-8ade-49c2-8055-e47758e8ce16/volumes"
Jul 21 16:56:48.877575 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:48.877542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:49.177406 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.177378    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"]
Jul 21 16:56:49.177796 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.177784    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0769587f-8ade-49c2-8055-e47758e8ce16" containerName="revoke-keys"
Jul 21 16:56:49.177847 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.177798    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0769587f-8ade-49c2-8055-e47758e8ce16" containerName="revoke-keys"
Jul 21 16:56:49.177904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.177873    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0769587f-8ade-49c2-8055-e47758e8ce16" containerName="revoke-keys"
Jul 21 16:56:49.180861 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.180845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.184012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.183993    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-03fff7e1-openshift-default-dockercfg-7rhw7\""
Jul 21 16:56:49.195033 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.195012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"]
Jul 21 16:56:49.196521 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.196500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:49.336140 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-credential-socket\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-data\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-certs\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-token\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istiod-ca-cert\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-envoy\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-socket\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdl9s\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-kube-api-access-rdl9s\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.336597 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.336583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-podinfo\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.391688 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.391651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:49.438019 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.437949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-podinfo\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438019 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.437984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-credential-socket\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438199 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-data\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438199 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-certs\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438199 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-token\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438199 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istiod-ca-cert\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438408 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-envoy\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438408 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-socket\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438408 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdl9s\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-kube-api-access-rdl9s\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438712 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-certs\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.438833 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.438778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-socket\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.439089 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.439065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-data\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.439165 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.439087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istiod-ca-cert\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.439222 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.439171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-credential-socket\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.440719 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.440693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-podinfo\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.440828 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.440755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-envoy\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.447641 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.447615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-token\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.447862 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.447844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdl9s\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-kube-api-access-rdl9s\") pod \"e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") " pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.492275 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.492256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:49.635422 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.635398    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"]
Jul 21 16:56:49.636384 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:56:49.636357    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491e6bb8_0c1d_4faa_90f8_094a9a9cf7db.slice/crio-631c54c73a8d7dc8f5a089aef34b582a94d17c3a191cddaf1cfc43e1b43a4c60 WatchSource:0}: Error finding container 631c54c73a8d7dc8f5a089aef34b582a94d17c3a191cddaf1cfc43e1b43a4c60: Status 404 returned error can't find the container with id 631c54c73a8d7dc8f5a089aef34b582a94d17c3a191cddaf1cfc43e1b43a4c60
Jul 21 16:56:49.638509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.638476    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:49.638606 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.638539    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:49.638606 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.638589    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:56:49.878419 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.878389    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" event={"ID":"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db","Type":"ContainerStarted","Data":"5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"}
Jul 21 16:56:49.878605 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.878438    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" event={"ID":"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db","Type":"ContainerStarted","Data":"631c54c73a8d7dc8f5a089aef34b582a94d17c3a191cddaf1cfc43e1b43a4c60"}
Jul 21 16:56:49.902328 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:49.902271    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podStartSLOduration=0.902250381 podStartE2EDuration="902.250381ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:49.900274383 +0000 UTC m=+1991.716953827" watchObservedRunningTime="2026-07-21 16:56:49.902250381 +0000 UTC m=+1991.718929825"
Jul 21 16:56:50.492526 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:50.492491    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:50.497247 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:50.497225    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:50.883963 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:50.883929    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:50.885001 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:50.884980    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:56:51.296510 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:51.296472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.408364 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:51.408327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.611832 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:51.611750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.795541 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:51.795511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:52.193967 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:52.193930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:52.299837 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:52.299806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:53.627177 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.627123    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:53.777626 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777595    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7qdp\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-kube-api-access-z7qdp\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.777805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777646    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-data\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.777805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777687    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-envoy\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.777805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777720    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-socket\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.777805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777747    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-podinfo\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.777805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-token\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.777805 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777785    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-certs\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.778286 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777907    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f471bc-cccc-433c-bd79-b559e45ad3df-istiod-ca-cert\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.778286 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.777942    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-credential-socket\") pod \"92f471bc-cccc-433c-bd79-b559e45ad3df\" (UID: \"92f471bc-cccc-433c-bd79-b559e45ad3df\") "
Jul 21 16:56:53.778286 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.778139    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:53.778497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.778338    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:53.778497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.778354    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.778596 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.778494    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:53.778681 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.778654    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92f471bc-cccc-433c-bd79-b559e45ad3df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:53.778818 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.778692    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-data" (OuterVolumeSpecName: "istio-data") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:53.780034 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.780008    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-kube-api-access-z7qdp" (OuterVolumeSpecName: "kube-api-access-z7qdp") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "kube-api-access-z7qdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:53.780304 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.780283    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:56:53.780367 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.780349    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:53.780523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.780507    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-token" (OuterVolumeSpecName: "istio-token") pod "92f471bc-cccc-433c-bd79-b559e45ad3df" (UID: "92f471bc-cccc-433c-bd79-b559e45ad3df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879310    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879347    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879362    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879374    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f471bc-cccc-433c-bd79-b559e45ad3df-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879386    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879398    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7qdp\" (UniqueName: \"kubernetes.io/projected/92f471bc-cccc-433c-bd79-b559e45ad3df-kube-api-access-z7qdp\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879410 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879411    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.879747 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.879423    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f471bc-cccc-433c-bd79-b559e45ad3df-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.902747 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.902715    2573 generic.go:356] "Generic (PLEG): container finished" podID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerID="d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4" exitCode=0
Jul 21 16:56:53.902904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.902760    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"
Jul 21 16:56:53.902904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.902811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" event={"ID":"92f471bc-cccc-433c-bd79-b559e45ad3df","Type":"ContainerDied","Data":"d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4"}
Jul 21 16:56:53.902904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.902864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj" event={"ID":"92f471bc-cccc-433c-bd79-b559e45ad3df","Type":"ContainerDied","Data":"030221c24bffee9fda98a06dc16a34b02adaa0cc450809f5f650e6058e44b855"}
Jul 21 16:56:53.902904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.902900    2573 scope.go:117] "RemoveContainer" containerID="d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4"
Jul 21 16:56:53.914993 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.914977    2573 scope.go:117] "RemoveContainer" containerID="1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"
Jul 21 16:56:53.923255 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.923235    2573 scope.go:117] "RemoveContainer" containerID="d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4"
Jul 21 16:56:53.923480 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:56:53.923464    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4\": container with ID starting with d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4 not found: ID does not exist" containerID="d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4"
Jul 21 16:56:53.923525 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.923489    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4"} err="failed to get container status \"d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4\": rpc error: code = NotFound desc = could not find container \"d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4\": container with ID starting with d4fb4248e5a716acc4956214807743f8d70bb8edd5ab97d24aa967a4dc9286c4 not found: ID does not exist"
Jul 21 16:56:53.923525 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.923505    2573 scope.go:117] "RemoveContainer" containerID="1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"
Jul 21 16:56:53.923763 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:56:53.923744    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663\": container with ID starting with 1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663 not found: ID does not exist" containerID="1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"
Jul 21 16:56:53.923807 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.923769    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663"} err="failed to get container status \"1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663\": rpc error: code = NotFound desc = could not find container \"1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663\": container with ID starting with 1beaf8c86ae2d37a0e4dd13b1e972941837d87b6148bb52a12d7bed383487663 not found: ID does not exist"
Jul 21 16:56:53.928833 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.928802    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"]
Jul 21 16:56:53.932026 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:53.932007    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bbd93f74-gw-openshift-default-7548fb694c-59vmj"]
Jul 21 16:56:54.699728 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:56:54.699701    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" path="/var/lib/kubelet/pods/92f471bc-cccc-433c-bd79-b559e45ad3df/volumes"
Jul 21 16:57:05.885600 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.885565    2573 patch_prober.go:28] interesting pod/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 16:57:05.886113 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.885626    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 16:57:05.982181 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.982147    2573 generic.go:356] "Generic (PLEG): container finished" podID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerID="5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d" exitCode=0
Jul 21 16:57:05.982345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.982220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" event={"ID":"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db","Type":"ContainerDied","Data":"5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"}
Jul 21 16:57:05.982692 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.982676    2573 scope.go:117] "RemoveContainer" containerID="5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"
Jul 21 16:57:05.983684 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.983654    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:05.983760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.983736    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:05.983832 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:05.983818    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:06.990247 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:06.990216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" event={"ID":"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db","Type":"ContainerStarted","Data":"3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11"}
Jul 21 16:57:07.492755 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:07.492714    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:57:07.492979 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:07.492953    2573 patch_prober.go:28] interesting pod/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 16:57:07.493063 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:07.493013    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 16:57:08.493574 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:08.493538    2573 patch_prober.go:28] interesting pod/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 16:57:08.493986 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:08.493607    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 16:57:09.493557 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:09.493522    2573 patch_prober.go:28] interesting pod/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 16:57:09.493731 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:09.493572    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 16:57:10.493532 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:10.493497    2573 patch_prober.go:28] interesting pod/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 16:57:10.493709 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:10.493549    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 16:57:11.496982 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:11.496955    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:57:11.497382 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:11.497185    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:57:11.497798 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:11.497780    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:57:17.004932 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.004898    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"]
Jul 21 16:57:17.005345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.005331    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy"
Jul 21 16:57:17.005389 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.005347    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy"
Jul 21 16:57:17.005389 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.005361    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy"
Jul 21 16:57:17.005389 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.005367    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy"
Jul 21 16:57:17.005485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.005440    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy"
Jul 21 16:57:17.005485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.005448    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f471bc-cccc-433c-bd79-b559e45ad3df" containerName="istio-proxy"
Jul 21 16:57:17.008523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.008507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:17.011722 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.011687    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:57:17.011941 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.011925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 16:57:17.016956 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.016778    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"]
Jul 21 16:57:17.094203 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.094180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/506a5ded-1243-4026-81da-d7dd1a3969a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-03fff7e1-69npm\" (UID: \"506a5ded-1243-4026-81da-d7dd1a3969a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:17.194694 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.194670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/506a5ded-1243-4026-81da-d7dd1a3969a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-03fff7e1-69npm\" (UID: \"506a5ded-1243-4026-81da-d7dd1a3969a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:17.195266 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.195248    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/506a5ded-1243-4026-81da-d7dd1a3969a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-03fff7e1-69npm\" (UID: \"506a5ded-1243-4026-81da-d7dd1a3969a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:17.321225 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.321203    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:17.667318 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:17.665381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"]
Jul 21 16:57:17.669397 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:57:17.669369    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506a5ded_1243_4026_81da_d7dd1a3969a0.slice/crio-831af97b5811a0be89dab977987a39fdc1f7e8a5527c31ce6cc747b0c37c8b04 WatchSource:0}: Error finding container 831af97b5811a0be89dab977987a39fdc1f7e8a5527c31ce6cc747b0c37c8b04: Status 404 returned error can't find the container with id 831af97b5811a0be89dab977987a39fdc1f7e8a5527c31ce6cc747b0c37c8b04
Jul 21 16:57:18.052732 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:18.052700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm" event={"ID":"506a5ded-1243-4026-81da-d7dd1a3969a0","Type":"ContainerStarted","Data":"1dd30d49b9f3996923c519982c39efb7e6eb32e99067e296efcca534cdb75b79"}
Jul 21 16:57:18.053150 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:18.052787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm" event={"ID":"506a5ded-1243-4026-81da-d7dd1a3969a0","Type":"ContainerStarted","Data":"831af97b5811a0be89dab977987a39fdc1f7e8a5527c31ce6cc747b0c37c8b04"}
Jul 21 16:57:18.071415 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:18.071371    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm" podStartSLOduration=2.071357962 podStartE2EDuration="2.071357962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:57:18.070626727 +0000 UTC m=+2019.887306192" watchObservedRunningTime="2026-07-21 16:57:18.071357962 +0000 UTC m=+2019.888037404"
Jul 21 16:57:19.059332 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:19.059293    2573 generic.go:356] "Generic (PLEG): container finished" podID="506a5ded-1243-4026-81da-d7dd1a3969a0" containerID="1dd30d49b9f3996923c519982c39efb7e6eb32e99067e296efcca534cdb75b79" exitCode=0
Jul 21 16:57:19.059696 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:19.059353    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm" event={"ID":"506a5ded-1243-4026-81da-d7dd1a3969a0","Type":"ContainerDied","Data":"1dd30d49b9f3996923c519982c39efb7e6eb32e99067e296efcca534cdb75b79"}
Jul 21 16:57:20.204523 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:20.204498    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:20.326463 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:20.326380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/506a5ded-1243-4026-81da-d7dd1a3969a0-maas-api-service-ca\") pod \"506a5ded-1243-4026-81da-d7dd1a3969a0\" (UID: \"506a5ded-1243-4026-81da-d7dd1a3969a0\") "
Jul 21 16:57:20.326703 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:20.326682    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/506a5ded-1243-4026-81da-d7dd1a3969a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "506a5ded-1243-4026-81da-d7dd1a3969a0" (UID: "506a5ded-1243-4026-81da-d7dd1a3969a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:57:20.427022 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:20.426990    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/506a5ded-1243-4026-81da-d7dd1a3969a0-maas-api-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:21.071085 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:21.071057    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"
Jul 21 16:57:21.071085 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:21.071058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm" event={"ID":"506a5ded-1243-4026-81da-d7dd1a3969a0","Type":"ContainerDied","Data":"831af97b5811a0be89dab977987a39fdc1f7e8a5527c31ce6cc747b0c37c8b04"}
Jul 21 16:57:21.071332 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:21.071120    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="831af97b5811a0be89dab977987a39fdc1f7e8a5527c31ce6cc747b0c37c8b04"
Jul 21 16:57:27.425513 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:27.425482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:30.246344 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:30.246309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:30.346632 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:30.346606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:32.081025 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:32.080982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:32.082441 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:32.082416    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"]
Jul 21 16:57:32.087111 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:32.087087    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-03fff7e1-69npm"]
Jul 21 16:57:32.700031 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:32.699991    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="506a5ded-1243-4026-81da-d7dd1a3969a0" path="/var/lib/kubelet/pods/506a5ded-1243-4026-81da-d7dd1a3969a0/volumes"
Jul 21 16:57:33.216476 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.216447    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"]
Jul 21 16:57:33.216972 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.216693    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy" containerID="cri-o://3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11" gracePeriod=30
Jul 21 16:57:33.241737 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.241706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:33.451863 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.451831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:33.681198 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.681167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:33.984829 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.984744    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"]
Jul 21 16:57:33.985352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.985337    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506a5ded-1243-4026-81da-d7dd1a3969a0" containerName="revoke-keys"
Jul 21 16:57:33.985401 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.985355    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="506a5ded-1243-4026-81da-d7dd1a3969a0" containerName="revoke-keys"
Jul 21 16:57:33.985470 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.985460    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="506a5ded-1243-4026-81da-d7dd1a3969a0" containerName="revoke-keys"
Jul 21 16:57:33.988951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.988931    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:33.992206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:33.992187    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f9a50ebb-openshift-default-dockercfg-rh2qz\""
Jul 21 16:57:34.003552 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.003529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"]
Jul 21 16:57:34.021559 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.021532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:34.141904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.141864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-credential-socket\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142088 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.141914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-token\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142088 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.141948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-podinfo\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142088 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.141975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-socket\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142088 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.142034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-certs\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.142153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-envoy\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.142208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2df3f32-4d74-4457-8374-7b1a649f37c2-istiod-ca-cert\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.142252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-data\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.142345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.142316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dfb\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-kube-api-access-j7dfb\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.243524 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-envoy\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.243524 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2df3f32-4d74-4457-8374-7b1a649f37c2-istiod-ca-cert\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.243524 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-data\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244142 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dfb\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-kube-api-access-j7dfb\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244142 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-credential-socket\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244142 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-token\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244142 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244123    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-podinfo\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.243993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-data\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-socket\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244234    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-certs\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244419    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2df3f32-4d74-4457-8374-7b1a649f37c2-istiod-ca-cert\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-socket\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-credential-socket\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.244520 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.244518    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-certs\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.245870 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.245850    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-envoy\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.246468 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.246446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-podinfo\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.252916 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.252873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-token\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.253021 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.252956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dfb\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-kube-api-access-j7dfb\") pod \"e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") " pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.300154 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.300121    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:34.441945 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.441914    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"]
Jul 21 16:57:34.443323 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:57:34.443296    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2df3f32_4d74_4457_8374_7b1a649f37c2.slice/crio-0ea7f940e266c652bc615e1e987f47e8f60667db839ca0f441a03749def17586 WatchSource:0}: Error finding container 0ea7f940e266c652bc615e1e987f47e8f60667db839ca0f441a03749def17586: Status 404 returned error can't find the container with id 0ea7f940e266c652bc615e1e987f47e8f60667db839ca0f441a03749def17586
Jul 21 16:57:34.445974 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.445929    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:34.446079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.446011    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:34.446079 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:34.446050    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:35.017360 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:35.017327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:35.149808 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:35.149775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" event={"ID":"d2df3f32-4d74-4457-8374-7b1a649f37c2","Type":"ContainerStarted","Data":"b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"}
Jul 21 16:57:35.150021 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:35.149827    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" event={"ID":"d2df3f32-4d74-4457-8374-7b1a649f37c2","Type":"ContainerStarted","Data":"0ea7f940e266c652bc615e1e987f47e8f60667db839ca0f441a03749def17586"}
Jul 21 16:57:35.173197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:35.173150    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" podStartSLOduration=2.173135668 podStartE2EDuration="2.173135668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:57:35.172690268 +0000 UTC m=+2036.989369711" watchObservedRunningTime="2026-07-21 16:57:35.173135668 +0000 UTC m=+2036.989815110"
Jul 21 16:57:35.300679 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:35.300651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:35.305337 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:35.305313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:36.156038 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:36.156005    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:36.157097 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:36.157078    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:36.515137 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:36.515035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:36.664548 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:36.664516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:36.762746 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:36.762678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:36.892961 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:36.892913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:37.179110 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:37.179023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:37.284227 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:37.284198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:38.475419 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.475367    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:57:38.580382 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdl9s\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-kube-api-access-rdl9s\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580407    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-envoy\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580440    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-credential-socket\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580460    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istiod-ca-cert\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580509 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580485    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-socket\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580561    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-data\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-token\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580609    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-podinfo\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580720 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-certs\") pod \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\" (UID: \"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db\") "
Jul 21 16:57:38.580971 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580753    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:38.580971 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580844    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:38.580971 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.580929    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:57:38.581126 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.581095    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:38.581183 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.581170    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.581754 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.581190    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.581754 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.581205    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.581754 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.581512    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-data" (OuterVolumeSpecName: "istio-data") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:38.582640 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.582617    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-kube-api-access-rdl9s" (OuterVolumeSpecName: "kube-api-access-rdl9s") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "kube-api-access-rdl9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:57:38.582804 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.582788    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-token" (OuterVolumeSpecName: "istio-token") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:57:38.583112 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.583089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:38.583232 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.583153    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" (UID: "491e6bb8-0c1d-4faa-90f8-094a9a9cf7db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:57:38.682195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.682171    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.682195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.682193    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.682353 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.682202    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.682353 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.682211    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdl9s\" (UniqueName: \"kubernetes.io/projected/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-kube-api-access-rdl9s\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.682353 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.682222    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:38.682353 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:38.682229    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:57:39.173266 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.173187    2573 generic.go:356] "Generic (PLEG): container finished" podID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerID="3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11" exitCode=0
Jul 21 16:57:39.173266 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.173234    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"
Jul 21 16:57:39.173441 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.173264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" event={"ID":"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db","Type":"ContainerDied","Data":"3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11"}
Jul 21 16:57:39.173441 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.173315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr" event={"ID":"491e6bb8-0c1d-4faa-90f8-094a9a9cf7db","Type":"ContainerDied","Data":"631c54c73a8d7dc8f5a089aef34b582a94d17c3a191cddaf1cfc43e1b43a4c60"}
Jul 21 16:57:39.173441 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.173342    2573 scope.go:117] "RemoveContainer" containerID="3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11"
Jul 21 16:57:39.182161 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.182139    2573 scope.go:117] "RemoveContainer" containerID="5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"
Jul 21 16:57:39.190012 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.189989    2573 scope.go:117] "RemoveContainer" containerID="3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11"
Jul 21 16:57:39.190429 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:57:39.190407    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11\": container with ID starting with 3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11 not found: ID does not exist" containerID="3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11"
Jul 21 16:57:39.190529 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.190440    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11"} err="failed to get container status \"3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11\": rpc error: code = NotFound desc = could not find container \"3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11\": container with ID starting with 3b53acb490a364aff87a9c6402d6d9bf1f6dca2bc1d9491e4a8d82d6b4fc2c11 not found: ID does not exist"
Jul 21 16:57:39.190529 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.190463    2573 scope.go:117] "RemoveContainer" containerID="5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"
Jul 21 16:57:39.190834 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:57:39.190809    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d\": container with ID starting with 5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d not found: ID does not exist" containerID="5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"
Jul 21 16:57:39.191000 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.190842    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d"} err="failed to get container status \"5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d\": rpc error: code = NotFound desc = could not find container \"5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d\": container with ID starting with 5e038f491efc06aca20293f5fcf13ef70a3635633b1de217e48df0117b113e3d not found: ID does not exist"
Jul 21 16:57:39.193711 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.193693    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"]
Jul 21 16:57:39.200459 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:39.200440    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-03fff7e1-openshift-default-554488f65f-bm4vr"]
Jul 21 16:57:40.700218 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:40.700178    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" path="/var/lib/kubelet/pods/491e6bb8-0c1d-4faa-90f8-094a9a9cf7db/volumes"
Jul 21 16:57:50.251904 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:50.251859    2573 generic.go:356] "Generic (PLEG): container finished" podID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerID="b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5" exitCode=0
Jul 21 16:57:50.252345 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:50.251935    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" event={"ID":"d2df3f32-4d74-4457-8374-7b1a649f37c2","Type":"ContainerDied","Data":"b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"}
Jul 21 16:57:50.252393 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:50.252364    2573 scope.go:117] "RemoveContainer" containerID="b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"
Jul 21 16:57:50.253395 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:50.253365    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:50.253450 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:50.253438    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:50.253486 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:50.253473    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:57:51.156229 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:51.156185    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:51.259579 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:51.259545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" event={"ID":"d2df3f32-4d74-4457-8374-7b1a649f37c2","Type":"ContainerStarted","Data":"f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6"}
Jul 21 16:57:51.301186 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:51.301164    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:51.302073 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:51.302054    2573 patch_prober.go:28] interesting pod/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 16:57:51.302125 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:51.302098    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 16:57:52.301276 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:52.301242    2573 patch_prober.go:28] interesting pod/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 16:57:52.301652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:52.301294    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 16:57:53.300455 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:53.300425    2573 patch_prober.go:28] interesting pod/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 16:57:53.300631 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:53.300484    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 16:57:54.300621 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:54.300590    2573 patch_prober.go:28] interesting pod/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 16:57:54.301030 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:54.300650    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 16:57:55.304697 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:55.304667    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:55.305120 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:55.304933    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:57:55.305580 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:57:55.305565    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:58:01.422992 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.422916    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"]
Jul 21 16:58:01.423489 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.423473    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy"
Jul 21 16:58:01.423542 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.423493    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy"
Jul 21 16:58:01.423621 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.423610    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy"
Jul 21 16:58:01.423656 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.423625    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy"
Jul 21 16:58:01.427626 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.427608    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:01.430897 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.430860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 16:58:01.431557 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.431536    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:58:01.438760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.436318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"]
Jul 21 16:58:01.480553 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.480525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e04d1184-8e0d-42b5-9750-41f8e46c6d81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h\" (UID: \"e04d1184-8e0d-42b5-9750-41f8e46c6d81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:01.581412 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.581379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e04d1184-8e0d-42b5-9750-41f8e46c6d81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h\" (UID: \"e04d1184-8e0d-42b5-9750-41f8e46c6d81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:01.582001 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.581983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e04d1184-8e0d-42b5-9750-41f8e46c6d81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h\" (UID: \"e04d1184-8e0d-42b5-9750-41f8e46c6d81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:01.740834 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.740751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:01.881152 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:01.881120    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"]
Jul 21 16:58:01.882313 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:58:01.882282    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04d1184_8e0d_42b5_9750_41f8e46c6d81.slice/crio-53b581beb01704e32231c2ec2b4948cfc9ae6051721c59194ed11b25079e8c6c WatchSource:0}: Error finding container 53b581beb01704e32231c2ec2b4948cfc9ae6051721c59194ed11b25079e8c6c: Status 404 returned error can't find the container with id 53b581beb01704e32231c2ec2b4948cfc9ae6051721c59194ed11b25079e8c6c
Jul 21 16:58:02.333154 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:02.333112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h" event={"ID":"e04d1184-8e0d-42b5-9750-41f8e46c6d81","Type":"ContainerStarted","Data":"998d06df07c12485f5a0f6590c6e470ad53a1cf31e4e152614b10fb82fef20a0"}
Jul 21 16:58:02.333352 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:02.333175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h" event={"ID":"e04d1184-8e0d-42b5-9750-41f8e46c6d81","Type":"ContainerStarted","Data":"53b581beb01704e32231c2ec2b4948cfc9ae6051721c59194ed11b25079e8c6c"}
Jul 21 16:58:02.352387 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:02.352335    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h" podStartSLOduration=1.352319902 podStartE2EDuration="1.352319902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:58:02.350753325 +0000 UTC m=+2064.167432769" watchObservedRunningTime="2026-07-21 16:58:02.352319902 +0000 UTC m=+2064.168999345"
Jul 21 16:58:03.340530 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:03.340494    2573 generic.go:356] "Generic (PLEG): container finished" podID="e04d1184-8e0d-42b5-9750-41f8e46c6d81" containerID="998d06df07c12485f5a0f6590c6e470ad53a1cf31e4e152614b10fb82fef20a0" exitCode=0
Jul 21 16:58:03.340990 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:03.340587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h" event={"ID":"e04d1184-8e0d-42b5-9750-41f8e46c6d81","Type":"ContainerDied","Data":"998d06df07c12485f5a0f6590c6e470ad53a1cf31e4e152614b10fb82fef20a0"}
Jul 21 16:58:04.482253 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:04.482219    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:04.505068 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:04.505039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e04d1184-8e0d-42b5-9750-41f8e46c6d81-maas-api-service-ca\") pod \"e04d1184-8e0d-42b5-9750-41f8e46c6d81\" (UID: \"e04d1184-8e0d-42b5-9750-41f8e46c6d81\") "
Jul 21 16:58:04.505400 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:04.505377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04d1184-8e0d-42b5-9750-41f8e46c6d81-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e04d1184-8e0d-42b5-9750-41f8e46c6d81" (UID: "e04d1184-8e0d-42b5-9750-41f8e46c6d81"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:58:04.606202 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:04.606144    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e04d1184-8e0d-42b5-9750-41f8e46c6d81-maas-api-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:05.354652 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:05.354619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h" event={"ID":"e04d1184-8e0d-42b5-9750-41f8e46c6d81","Type":"ContainerDied","Data":"53b581beb01704e32231c2ec2b4948cfc9ae6051721c59194ed11b25079e8c6c"}
Jul 21 16:58:05.354809 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:05.354669    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53b581beb01704e32231c2ec2b4948cfc9ae6051721c59194ed11b25079e8c6c"
Jul 21 16:58:05.354809 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:05.354631    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"
Jul 21 16:58:11.871093 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:11.871060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.501967 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.501928    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"]
Jul 21 16:58:16.505193 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.505152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.509395 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.509361    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9a50ebb-2gn6h"]
Jul 21 16:58:16.636263 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.636228    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"]
Jul 21 16:58:16.636579 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.636524    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy" containerID="cri-o://f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6" gracePeriod=30
Jul 21 16:58:16.678044 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.678009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.699326 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.699296    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e04d1184-8e0d-42b5-9750-41f8e46c6d81" path="/var/lib/kubelet/pods/e04d1184-8e0d-42b5-9750-41f8e46c6d81/volumes"
Jul 21 16:58:16.886208 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:16.886175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:17.351195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:17.351154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:17.450709 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:17.450656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:17.551200 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:17.551164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:19.091454 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:19.091430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:21.889935 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.889912    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:58:21.963245 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963174    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7dfb\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-kube-api-access-j7dfb\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963245 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963241    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-podinfo\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-data\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963290    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-credential-socket\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-certs\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963343    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-envoy\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963382    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-token\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.963436 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963417    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2df3f32-4d74-4457-8374-7b1a649f37c2-istiod-ca-cert\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-socket\") pod \"d2df3f32-4d74-4457-8374-7b1a649f37c2\" (UID: \"d2df3f32-4d74-4457-8374-7b1a649f37c2\") "
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963621    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963635    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963827    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963842    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.963858    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:21.964158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.964001    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2df3f32-4d74-4457-8374-7b1a649f37c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:58:21.964479 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.964404    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:21.965478 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.965446    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:21.965718 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.965694    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-kube-api-access-j7dfb" (OuterVolumeSpecName: "kube-api-access-j7dfb") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "kube-api-access-j7dfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:58:21.965823 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.965803    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:58:21.966033 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:21.966004    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2df3f32-4d74-4457-8374-7b1a649f37c2" (UID: "d2df3f32-4d74-4457-8374-7b1a649f37c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:58:22.064750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064722    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7dfb\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-kube-api-access-j7dfb\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.064750 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064746    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.064933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064760    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.064933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064772    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.064933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064782    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2df3f32-4d74-4457-8374-7b1a649f37c2-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.064933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064793    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2df3f32-4d74-4457-8374-7b1a649f37c2-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.064933 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.064805    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2df3f32-4d74-4457-8374-7b1a649f37c2-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 16:58:22.454804 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.454754    2573 generic.go:356] "Generic (PLEG): container finished" podID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerID="f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6" exitCode=0
Jul 21 16:58:22.455029 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.454968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" event={"ID":"d2df3f32-4d74-4457-8374-7b1a649f37c2","Type":"ContainerDied","Data":"f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6"}
Jul 21 16:58:22.455096 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.455063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd" event={"ID":"d2df3f32-4d74-4457-8374-7b1a649f37c2","Type":"ContainerDied","Data":"0ea7f940e266c652bc615e1e987f47e8f60667db839ca0f441a03749def17586"}
Jul 21 16:58:22.455158 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.455103    2573 scope.go:117] "RemoveContainer" containerID="f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6"
Jul 21 16:58:22.457480 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.455318    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"
Jul 21 16:58:22.469571 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.469548    2573 scope.go:117] "RemoveContainer" containerID="b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"
Jul 21 16:58:22.478408 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.478394    2573 scope.go:117] "RemoveContainer" containerID="f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6"
Jul 21 16:58:22.478668 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:58:22.478639    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6\": container with ID starting with f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6 not found: ID does not exist" containerID="f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6"
Jul 21 16:58:22.478824 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.478666    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6"} err="failed to get container status \"f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6\": rpc error: code = NotFound desc = could not find container \"f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6\": container with ID starting with f80e660b4ab36bb823b111b8059f849c3dc53a53862ee975ac34010a0df744d6 not found: ID does not exist"
Jul 21 16:58:22.478824 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.478682    2573 scope.go:117] "RemoveContainer" containerID="b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"
Jul 21 16:58:22.479025 ip-10-0-136-117 kubenswrapper[2573]: E0721 16:58:22.478995    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5\": container with ID starting with b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5 not found: ID does not exist" containerID="b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"
Jul 21 16:58:22.479125 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.479032    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5"} err="failed to get container status \"b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5\": rpc error: code = NotFound desc = could not find container \"b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5\": container with ID starting with b4355f77640d559852f570bdf5d862659c7f7201089ff3df1ae4530e897b56a5 not found: ID does not exist"
Jul 21 16:58:22.481996 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.481975    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"]
Jul 21 16:58:22.486365 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.486346    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f9a50ebb-openshift-default-76c588cc99-k22wd"]
Jul 21 16:58:22.700025 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:22.699997    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" path="/var/lib/kubelet/pods/d2df3f32-4d74-4457-8374-7b1a649f37c2/volumes"
Jul 21 16:58:24.973339 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:24.973307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:25.041197 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:25.041157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:25.132300 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:25.132268    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:25.231514 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:25.231441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:25.332294 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:25.332267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:25.690813 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:25.690786    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:38.825252 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:38.825223    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:58:38.830450 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:38.830427    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 16:58:51.620022 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:51.619987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:58.335800 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:58.335765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:58.443880 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:58.443842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:58.541938 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:58:58.541908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:14.432391 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:14.432359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:20.324318 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:20.324288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:20.391329 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:20.391301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:20.486951 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:20.486916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:20.585485 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:20.585407    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:31.167105 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:31.167031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:32.100828 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:32.100796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:38.993031 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:38.992996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:39.094717 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:39.094687    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:39.201206 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:39.201176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:39.295911 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:39.295862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:40.205265 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:40.205234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:40.297646 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:40.297612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:40.417936 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:40.417907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:42.200575 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:42.200543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:48.432371 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:48.432333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:48.540067 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:48.540031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:49.219947 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:49.219901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.337708 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:54.337674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:55.728038 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:55.728007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:55.906417 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:55.906387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:56.230981 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.230942    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"]
Jul 21 16:59:56.231358 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231342    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy"
Jul 21 16:59:56.231402 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231360    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy"
Jul 21 16:59:56.231402 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231375    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04d1184-8e0d-42b5-9750-41f8e46c6d81" containerName="revoke-keys"
Jul 21 16:59:56.231402 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231381    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04d1184-8e0d-42b5-9750-41f8e46c6d81" containerName="revoke-keys"
Jul 21 16:59:56.231402 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231401    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy"
Jul 21 16:59:56.231528 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231407    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="491e6bb8-0c1d-4faa-90f8-094a9a9cf7db" containerName="istio-proxy"
Jul 21 16:59:56.231528 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231472    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e04d1184-8e0d-42b5-9750-41f8e46c6d81" containerName="revoke-keys"
Jul 21 16:59:56.231528 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.231482    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy"
Jul 21 16:59:56.234568 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.234548    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.237297 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.237273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-374c7b92-openshift-default-dockercfg-lvgfp\""
Jul 21 16:59:56.257808 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.257780    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"]
Jul 21 16:59:56.261110 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.261090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:56.282497 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.282468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-socket\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.282760 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.282609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istiod-ca-cert\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.282828 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.282811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-envoy\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.282913 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.282864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-certs\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.282963 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.282921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-credential-socket\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.283153 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.283137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-data\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.283208 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.283174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-token\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.283301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.283202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-podinfo\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.283301 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.283289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trkkl\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-kube-api-access-trkkl\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384531 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-certs\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-credential-socket\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-data\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384669 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-token\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384849 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-podinfo\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384849 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trkkl\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-kube-api-access-trkkl\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.384981 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-socket\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istiod-ca-cert\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.385010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-certs\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385040 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.385027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-envoy\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.384945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-credential-socket\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385195 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.385062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-data\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385272 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.385194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-socket\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.385592 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.385571    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istiod-ca-cert\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.387061 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.387036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-envoy\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.387502 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.387478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-podinfo\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.393373 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.393347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-token\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.393663 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.393642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trkkl\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-kube-api-access-trkkl\") pod \"e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") " pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.479396 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.479367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:56.544838 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.544815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:56.682435 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.682409    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"]
Jul 21 16:59:56.684092 ip-10-0-136-117 kubenswrapper[2573]: W0721 16:59:56.684065    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f4337f_8e3e_49fe_970f_5cabb2e5122e.slice/crio-fff648330c7576d4844174a053a28a148f76c37cf27fdbbe8045ac468a240ae7 WatchSource:0}: Error finding container fff648330c7576d4844174a053a28a148f76c37cf27fdbbe8045ac468a240ae7: Status 404 returned error can't find the container with id fff648330c7576d4844174a053a28a148f76c37cf27fdbbe8045ac468a240ae7
Jul 21 16:59:56.686325 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.686295    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:59:56.686396 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.686362    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:59:56.686396 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.686388    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 16:59:56.992708 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.992618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" event={"ID":"b5f4337f-8e3e-49fe-970f-5cabb2e5122e","Type":"ContainerStarted","Data":"d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"}
Jul 21 16:59:56.992708 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:56.992681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" event={"ID":"b5f4337f-8e3e-49fe-970f-5cabb2e5122e","Type":"ContainerStarted","Data":"fff648330c7576d4844174a053a28a148f76c37cf27fdbbe8045ac468a240ae7"}
Jul 21 16:59:57.019374 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:57.019330    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podStartSLOduration=1.019316947 podStartE2EDuration="1.019316947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:59:57.018439206 +0000 UTC m=+2178.835118718" watchObservedRunningTime="2026-07-21 16:59:57.019316947 +0000 UTC m=+2178.835996392"
Jul 21 16:59:57.545783 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:57.545753    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:57.550685 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:57.550659    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:57.998537 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:57.998464    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:57.999330 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:57.999311    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 16:59:59.116461 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:59.116428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:59.201300 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:59.201264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:59.266174 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:59.266141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:59.410368 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:59.410287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:59.881650 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:59.881622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:59.981746 ip-10-0-136-117 kubenswrapper[2573]: I0721 16:59:59.981719    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:00.135673 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.135595    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"]
Jul 21 17:00:00.136066 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.136051    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy"
Jul 21 17:00:00.136066 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.136067    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy"
Jul 21 17:00:00.136145 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.136141    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2df3f32-4d74-4457-8374-7b1a649f37c2" containerName="istio-proxy"
Jul 21 17:00:00.139293 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.139276    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"
Jul 21 17:00:00.145404 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.145374    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:00:00.150835 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.150811    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"]
Jul 21 17:00:00.151477 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.151458    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"
Jul 21 17:00:00.296821 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:00.296788    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"]
Jul 21 17:00:00.296992 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:00:00.296868    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba70fb0d_ba59_40ce_afd0_81b76cfe27e3.slice/crio-71913e3bb319fc8d43ecd2c24c7532e3ad4e2c01a4a149070590c71d7683c2ac WatchSource:0}: Error finding container 71913e3bb319fc8d43ecd2c24c7532e3ad4e2c01a4a149070590c71d7683c2ac: Status 404 returned error can't find the container with id 71913e3bb319fc8d43ecd2c24c7532e3ad4e2c01a4a149070590c71d7683c2ac
Jul 21 17:00:01.016370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:01.016335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerStarted","Data":"a5f93117ae61c02b3bfef86a7a38a238a816a5dd8760771378bd17cd24e404c3"}
Jul 21 17:00:01.016540 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:01.016393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerStarted","Data":"71913e3bb319fc8d43ecd2c24c7532e3ad4e2c01a4a149070590c71d7683c2ac"}
Jul 21 17:00:01.034665 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:01.034620    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" podStartSLOduration=1.034605473 podStartE2EDuration="1.034605473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:01.032340157 +0000 UTC m=+2182.849019601" watchObservedRunningTime="2026-07-21 17:00:01.034605473 +0000 UTC m=+2182.851284916"
Jul 21 17:00:02.023556 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:02.023522    2573 generic.go:356] "Generic (PLEG): container finished" podID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerID="a5f93117ae61c02b3bfef86a7a38a238a816a5dd8760771378bd17cd24e404c3" exitCode=7
Jul 21 17:00:02.023978 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:02.023614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerDied","Data":"a5f93117ae61c02b3bfef86a7a38a238a816a5dd8760771378bd17cd24e404c3"}
Jul 21 17:00:02.023978 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:02.023730    2573 scope.go:117] "RemoveContainer" containerID="a5f93117ae61c02b3bfef86a7a38a238a816a5dd8760771378bd17cd24e404c3"
Jul 21 17:00:03.031810 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:03.031725    2573 generic.go:356] "Generic (PLEG): container finished" podID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8" exitCode=7
Jul 21 17:00:03.032226 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:03.031805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerDied","Data":"1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"}
Jul 21 17:00:03.032226 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:03.031870    2573 scope.go:117] "RemoveContainer" containerID="a5f93117ae61c02b3bfef86a7a38a238a816a5dd8760771378bd17cd24e404c3"
Jul 21 17:00:03.032226 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:03.032031    2573 scope.go:117] "RemoveContainer" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"
Jul 21 17:00:03.032349 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:00:03.032302    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql_odh-ai-gateway-infra(ba70fb0d-ba59-40ce-afd0-81b76cfe27e3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3"
Jul 21 17:00:03.626048 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:03.626017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:04.039413 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:04.039389    2573 scope.go:117] "RemoveContainer" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"
Jul 21 17:00:04.039852 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:00:04.039636    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql_odh-ai-gateway-infra(ba70fb0d-ba59-40ce-afd0-81b76cfe27e3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3"
Jul 21 17:00:04.487402 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:04.487303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:04.583542 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:04.583477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:04.979329 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:04.979300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:10.736833 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:10.736798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:10.818270 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:10.818232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:12.999774 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:12.999748    2573 patch_prober.go:28] interesting pod/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 21 17:00:13.000163 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:12.999810    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 21 17:00:13.091634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.091606    2573 generic.go:356] "Generic (PLEG): container finished" podID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerID="d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165" exitCode=0
Jul 21 17:00:13.091792 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.091682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" event={"ID":"b5f4337f-8e3e-49fe-970f-5cabb2e5122e","Type":"ContainerDied","Data":"d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"}
Jul 21 17:00:13.092162 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.092148    2573 scope.go:117] "RemoveContainer" containerID="d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"
Jul 21 17:00:13.093236 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.093205    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:00:13.093309 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.093293    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:00:13.093351 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.093330    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:00:13.555027 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.554993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:13.610678 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:13.610651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:14.100046 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:14.100016    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" event={"ID":"b5f4337f-8e3e-49fe-970f-5cabb2e5122e","Type":"ContainerStarted","Data":"56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8"}
Jul 21 17:00:14.545384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:14.545344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 17:00:14.545602 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:14.545577    2573 patch_prober.go:28] interesting pod/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 21 17:00:14.545654 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:14.545628    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 21 17:00:15.546169 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:15.546129    2573 patch_prober.go:28] interesting pod/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 21 17:00:15.546658 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:15.546182    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 21 17:00:15.693445 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:15.693418    2573 scope.go:117] "RemoveContainer" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"
Jul 21 17:00:16.114682 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:16.114651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerStarted","Data":"8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023"}
Jul 21 17:00:16.545470 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:16.545430    2573 patch_prober.go:28] interesting pod/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 21 17:00:16.545680 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:16.545495    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 21 17:00:17.144161 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:17.144125    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"]
Jul 21 17:00:17.144537 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:17.144341    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup" containerID="cri-o://8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023" gracePeriod=30
Jul 21 17:00:17.307823 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:17.307799    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"
Jul 21 17:00:17.545419 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:17.545375    2573 patch_prober.go:28] interesting pod/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 21 17:00:17.545634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:17.545430    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 21 17:00:18.132750 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.132713    2573 generic.go:356] "Generic (PLEG): container finished" podID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerID="8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023" exitCode=0
Jul 21 17:00:18.133086 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.132783    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"
Jul 21 17:00:18.133330 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.132803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerDied","Data":"8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023"}
Jul 21 17:00:18.133427 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.133380    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql" event={"ID":"ba70fb0d-ba59-40ce-afd0-81b76cfe27e3","Type":"ContainerDied","Data":"71913e3bb319fc8d43ecd2c24c7532e3ad4e2c01a4a149070590c71d7683c2ac"}
Jul 21 17:00:18.133427 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.133419    2573 scope.go:117] "RemoveContainer" containerID="8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023"
Jul 21 17:00:18.152275 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.152134    2573 scope.go:117] "RemoveContainer" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"
Jul 21 17:00:18.160453 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.160434    2573 scope.go:117] "RemoveContainer" containerID="8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023"
Jul 21 17:00:18.160696 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:00:18.160679    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023\": container with ID starting with 8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023 not found: ID does not exist" containerID="8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023"
Jul 21 17:00:18.160741 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.160704    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023"} err="failed to get container status \"8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023\": rpc error: code = NotFound desc = could not find container \"8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023\": container with ID starting with 8144b9150de0f29ea05c4859bc350191c0f0cfb038b57f58480536638b289023 not found: ID does not exist"
Jul 21 17:00:18.160741 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.160721    2573 scope.go:117] "RemoveContainer" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"
Jul 21 17:00:18.160971 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:00:18.160942    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8\": container with ID starting with 1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8 not found: ID does not exist" containerID="1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"
Jul 21 17:00:18.161034 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.160978    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8"} err="failed to get container status \"1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8\": rpc error: code = NotFound desc = could not find container \"1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8\": container with ID starting with 1d4c84fae11808a58debdec93762909981cd774c797d285ed9020265f6683be8 not found: ID does not exist"
Jul 21 17:00:18.167773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.167746    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"]
Jul 21 17:00:18.171746 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.171725    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-374c7b92-29744220-5v7ql"]
Jul 21 17:00:18.549536 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.549507    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 17:00:18.549973 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.549959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 17:00:18.550651 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.550633    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 17:00:18.706090 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:18.706056    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" path="/var/lib/kubelet/pods/ba70fb0d-ba59-40ce-afd0-81b76cfe27e3/volumes"
Jul 21 17:00:21.537461 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:21.537423    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:26.179358 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:26.179321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:26.556058 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:26.556028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:32.393726 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:32.393697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:32.462810 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:32.462782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:32.627703 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:32.627668    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"]
Jul 21 17:00:32.628001 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:32.627975    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" containerID="cri-o://56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8" gracePeriod=30
Jul 21 17:00:32.648716 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:32.648648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:32.874640 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:32.874610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:33.001493 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:33.001398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:33.101905 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:33.101842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:33.210753 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:33.210728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:33.552752 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:33.552713    2573 patch_prober.go:28] interesting pod/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 17:00:33.553209 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:33.552788    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:00:37.888586 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.888563    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 17:00:37.963507 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963417    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-certs\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963507 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963470    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-credential-socket\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963508    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-data\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963533    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trkkl\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-kube-api-access-trkkl\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-envoy\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963595    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istiod-ca-cert\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963614    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-socket\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.963705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963679    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-podinfo\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.964072 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-token\") pod \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\" (UID: \"b5f4337f-8e3e-49fe-970f-5cabb2e5122e\") "
Jul 21 17:00:37.964072 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963736    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:00:37.964072 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.963870    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:00:37.964242 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.964097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:00:37.964242 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.964103    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:37.964242 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.964140    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:37.965380 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.965351    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:00:37.965508 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.965422    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:00:37.966293 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.966270    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:00:37.966586 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.966562    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:00:37.966586 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.966572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-kube-api-access-trkkl" (OuterVolumeSpecName: "kube-api-access-trkkl") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "kube-api-access-trkkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:00:37.967583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:37.967558    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5f4337f-8e3e-49fe-970f-5cabb2e5122e" (UID: "b5f4337f-8e3e-49fe-970f-5cabb2e5122e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:00:38.065130 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065109    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.065130 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065129    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trkkl\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-kube-api-access-trkkl\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.065291 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065138    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.065291 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065146    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.065291 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065155    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.065291 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065164    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.065291 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.065173    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f4337f-8e3e-49fe-970f-5cabb2e5122e-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:00:38.255317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.255229    2573 generic.go:356] "Generic (PLEG): container finished" podID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerID="56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8" exitCode=0
Jul 21 17:00:38.255317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.255283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"
Jul 21 17:00:38.255522 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.255313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" event={"ID":"b5f4337f-8e3e-49fe-970f-5cabb2e5122e","Type":"ContainerDied","Data":"56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8"}
Jul 21 17:00:38.255522 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.255370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r" event={"ID":"b5f4337f-8e3e-49fe-970f-5cabb2e5122e","Type":"ContainerDied","Data":"fff648330c7576d4844174a053a28a148f76c37cf27fdbbe8045ac468a240ae7"}
Jul 21 17:00:38.255522 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.255393    2573 scope.go:117] "RemoveContainer" containerID="56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8"
Jul 21 17:00:38.265894 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.265864    2573 scope.go:117] "RemoveContainer" containerID="d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"
Jul 21 17:00:38.273935 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.273920    2573 scope.go:117] "RemoveContainer" containerID="56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8"
Jul 21 17:00:38.274183 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:00:38.274167    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8\": container with ID starting with 56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8 not found: ID does not exist" containerID="56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8"
Jul 21 17:00:38.274229 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.274190    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8"} err="failed to get container status \"56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8\": rpc error: code = NotFound desc = could not find container \"56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8\": container with ID starting with 56641b12f7a2de21ba05298233fdfd0dc8433706c4e428ffc7dd0b4822222ad8 not found: ID does not exist"
Jul 21 17:00:38.274229 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.274206    2573 scope.go:117] "RemoveContainer" containerID="d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"
Jul 21 17:00:38.274398 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:00:38.274380    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165\": container with ID starting with d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165 not found: ID does not exist" containerID="d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"
Jul 21 17:00:38.274437 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.274402    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165"} err="failed to get container status \"d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165\": rpc error: code = NotFound desc = could not find container \"d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165\": container with ID starting with d0d11a58ecce09f6665409626b333f238f2153ab9ee7773ac79fc9b42066a165 not found: ID does not exist"
Jul 21 17:00:38.278476 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.278455    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"]
Jul 21 17:00:38.282951 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.282930    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-374c7b92-openshift-default-5dfcdb5955-9449r"]
Jul 21 17:00:38.699861 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:38.699825    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" path="/var/lib/kubelet/pods/b5f4337f-8e3e-49fe-970f-5cabb2e5122e/volumes"
Jul 21 17:00:39.192758 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:39.192726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:39.294230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:39.294191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:45.047492 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:45.047458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:45.182226 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:45.182199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:51.882094 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:51.882062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:52.156298 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156206    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"]
Jul 21 17:00:52.156710 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156687    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy"
Jul 21 17:00:52.156710 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156709    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156719    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156725    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156738    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156743    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156759    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156764    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156843    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156852    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:00:52.156903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.156859    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy"
Jul 21 17:00:52.160051 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.160033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.163072 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.163050    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-650aed9b-openshift-default-dockercfg-dpsnw\""
Jul 21 17:00:52.173496 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.173471    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"]
Jul 21 17:00:52.185856 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.185814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:52.284703 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmj6\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-kube-api-access-6bmj6\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.284703 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-socket\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-data\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-certs\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-envoy\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-token\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.284955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istiod-ca-cert\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285216 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.285006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-credential-socket\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.285216 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.285080    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-podinfo\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.298484 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.298459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:52.386008 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.385971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istiod-ca-cert\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386177 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-credential-socket\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386177 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-podinfo\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386177 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmj6\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-kube-api-access-6bmj6\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386177 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-socket\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386177 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-data\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386177 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-certs\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386505 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386193    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-envoy\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386505 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-token\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386624 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-socket\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386675 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-certs\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386675 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-credential-socket\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386772 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-data\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.386772 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.386746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istiod-ca-cert\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.388495 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.388474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-envoy\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.388629 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.388611    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-podinfo\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.398418 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.398399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-token\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.406089 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.406067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmj6\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-kube-api-access-6bmj6\") pod \"e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") " pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.472029 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.471961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:52.614171 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.614148    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"]
Jul 21 17:00:52.615935 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:00:52.615908    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9d94cc_2a2f_4dce_b2f6_e688261b8fc1.slice/crio-164d7778b848778d72bc4d10181197214ac6aa84f2cf771c280ff25ddfa0c3d9 WatchSource:0}: Error finding container 164d7778b848778d72bc4d10181197214ac6aa84f2cf771c280ff25ddfa0c3d9: Status 404 returned error can't find the container with id 164d7778b848778d72bc4d10181197214ac6aa84f2cf771c280ff25ddfa0c3d9
Jul 21 17:00:52.618151 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.618118    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:00:52.618209 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.618190    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:00:52.618256 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:52.618222    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:00:53.348162 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:53.348122    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" event={"ID":"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1","Type":"ContainerStarted","Data":"69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"}
Jul 21 17:00:53.348561 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:53.348186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" event={"ID":"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1","Type":"ContainerStarted","Data":"164d7778b848778d72bc4d10181197214ac6aa84f2cf771c280ff25ddfa0c3d9"}
Jul 21 17:00:53.372091 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:53.372039    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podStartSLOduration=1.372023655 podStartE2EDuration="1.372023655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:53.369406866 +0000 UTC m=+2235.186086323" watchObservedRunningTime="2026-07-21 17:00:53.372023655 +0000 UTC m=+2235.188703097"
Jul 21 17:00:53.472581 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:53.472546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:53.477731 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:53.477704    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:54.353781 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:54.353750    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:54.354757 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:54.354739    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:00:55.287083 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:55.287050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:55.389132 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:55.389098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:55.455760 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:55.455728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:55.640121 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:55.640042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:56.384826 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:56.384791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:56.485370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:56.485338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:59.746198 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:00:59.746161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:08.436772 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:08.436739    2573 generic.go:356] "Generic (PLEG): container finished" podID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerID="69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad" exitCode=0
Jul 21 17:01:08.437204 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:08.436811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" event={"ID":"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1","Type":"ContainerDied","Data":"69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"}
Jul 21 17:01:08.437249 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:08.437234    2573 scope.go:117] "RemoveContainer" containerID="69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"
Jul 21 17:01:08.438187 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:08.438160    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:01:08.438247 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:08.438234    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:01:08.438282 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:08.438266    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:01:09.353949 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:09.353922    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:01:09.450466 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:09.449245    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" event={"ID":"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1","Type":"ContainerStarted","Data":"dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca"}
Jul 21 17:01:09.472248 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:09.472212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:01:09.473523 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:09.473496    2573 patch_prober.go:28] interesting pod/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 21 17:01:09.473662 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:09.473557    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 21 17:01:10.473277 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:10.473245    2573 patch_prober.go:28] interesting pod/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 21 17:01:10.473677 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:10.473296    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 21 17:01:11.472825 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:11.472790    2573 patch_prober.go:28] interesting pod/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 21 17:01:11.473024 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:11.472843    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 21 17:01:12.472465 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.472427    2573 patch_prober.go:28] interesting pod/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 21 17:01:12.472844 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.472484    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 21 17:01:12.578683 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.578651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"]
Jul 21 17:01:12.579132 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.579118    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:01:12.579195 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.579134    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:01:12.579236 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.579221    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba70fb0d-ba59-40ce-afd0-81b76cfe27e3" containerName="cleanup"
Jul 21 17:01:12.579236 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.579229    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5f4337f-8e3e-49fe-970f-5cabb2e5122e" containerName="istio-proxy"
Jul 21 17:01:12.583065 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.583041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.587704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.587681    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-650aed9b\"/\"kube-root-ca.crt\""
Jul 21 17:01:12.588085 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.588068    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-650aed9b\"/\"openshift-service-ca.crt\""
Jul 21 17:01:12.588398 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.587940    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-650aed9b\"/\"e2e-lifecycle-model-650aed9b-kserve-self-signed-certs\""
Jul 21 17:01:12.588628 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.588609    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-650aed9b\"/\"default-dockercfg-vt867\""
Jul 21 17:01:12.592896 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.592858    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"]
Jul 21 17:01:12.603621 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.603601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:12.685429 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.685397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-dshm\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.685600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.685436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-model-cache\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.685600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.685501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxlfn\" (UniqueName: \"kubernetes.io/projected/0ef3ce07-5f50-4734-9194-7bc26e5ef137-kube-api-access-lxlfn\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.685600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.685531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tls-certs\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.685600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.685565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-home\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.685743 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.685611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tmp-dir\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.786685 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.786656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-model-cache\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.786875 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.786726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxlfn\" (UniqueName: \"kubernetes.io/projected/0ef3ce07-5f50-4734-9194-7bc26e5ef137-kube-api-access-lxlfn\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.786875 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.786762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tls-certs\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.786875 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.786812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-home\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.786875 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.786869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tmp-dir\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.787142 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.786987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-dshm\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.787142 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.787094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-model-cache\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.787253 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.787215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-home\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.787335 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.787311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tmp-dir\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.789221 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.789198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-dshm\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.789466 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.789450    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tls-certs\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.795564 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.795530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxlfn\" (UniqueName: \"kubernetes.io/projected/0ef3ce07-5f50-4734-9194-7bc26e5ef137-kube-api-access-lxlfn\") pod \"e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") " pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:12.895403 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:12.895365    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:13.083589 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:13.083555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"]
Jul 21 17:01:13.084544 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:01:13.084512    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ef3ce07_5f50_4734_9194_7bc26e5ef137.slice/crio-41fafd4ecd0b3b5a52b9948f57f4600b15eb41dd07c759812c61433bbf99b390 WatchSource:0}: Error finding container 41fafd4ecd0b3b5a52b9948f57f4600b15eb41dd07c759812c61433bbf99b390: Status 404 returned error can't find the container with id 41fafd4ecd0b3b5a52b9948f57f4600b15eb41dd07c759812c61433bbf99b390
Jul 21 17:01:13.472345 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:13.472255    2573 patch_prober.go:28] interesting pod/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 21 17:01:13.472345 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:13.472307    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 21 17:01:13.473609 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:13.473583    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c" event={"ID":"0ef3ce07-5f50-4734-9194-7bc26e5ef137","Type":"ContainerStarted","Data":"f5c04e447209f2e9c45e203b62e6176c2214f3931ad28baf0c402f8ddcc026d7"}
Jul 21 17:01:13.473609 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:13.473620    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c" event={"ID":"0ef3ce07-5f50-4734-9194-7bc26e5ef137","Type":"ContainerStarted","Data":"41fafd4ecd0b3b5a52b9948f57f4600b15eb41dd07c759812c61433bbf99b390"}
Jul 21 17:01:13.490211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:13.490150    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c" podStartSLOduration=1.490133417 podStartE2EDuration="1.490133417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:01:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:01:13.489985192 +0000 UTC m=+2255.306664636" watchObservedRunningTime="2026-07-21 17:01:13.490133417 +0000 UTC m=+2255.306812861"
Jul 21 17:01:14.477038 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:14.477009    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:01:14.477428 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:14.477411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:01:14.478268 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:14.478247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:01:22.896480 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:22.896445    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:22.896910 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:22.896523    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:22.908595 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:22.908571    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:23.541863 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:23.541835    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:01:43.336648 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:43.336618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:49.125231 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:49.125193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:53.399631 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:53.399580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:55.756520 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:01:55.756484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:00.660481 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:00.660447    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"]
Jul 21 17:02:00.728794 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:00.728762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:15.681230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.681168    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c" podUID="0ef3ce07-5f50-4734-9194-7bc26e5ef137" containerName="main" containerID="cri-o://f5c04e447209f2e9c45e203b62e6176c2214f3931ad28baf0c402f8ddcc026d7" gracePeriod=45
Jul 21 17:02:15.838986 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.838952    2573 generic.go:356] "Generic (PLEG): container finished" podID="0ef3ce07-5f50-4734-9194-7bc26e5ef137" containerID="f5c04e447209f2e9c45e203b62e6176c2214f3931ad28baf0c402f8ddcc026d7" exitCode=0
Jul 21 17:02:15.839143 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.839020    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c" event={"ID":"0ef3ce07-5f50-4734-9194-7bc26e5ef137","Type":"ContainerDied","Data":"f5c04e447209f2e9c45e203b62e6176c2214f3931ad28baf0c402f8ddcc026d7"}
Jul 21 17:02:15.937232 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.937162    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:02:15.952349 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-model-cache\") pod \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") "
Jul 21 17:02:15.952492 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tls-certs\") pod \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") "
Jul 21 17:02:15.952492 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952385    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tmp-dir\") pod \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") "
Jul 21 17:02:15.952617 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-dshm\") pod \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") "
Jul 21 17:02:15.952617 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952563    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxlfn\" (UniqueName: \"kubernetes.io/projected/0ef3ce07-5f50-4734-9194-7bc26e5ef137-kube-api-access-lxlfn\") pod \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") "
Jul 21 17:02:15.952723 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952627    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-home\") pod \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\" (UID: \"0ef3ce07-5f50-4734-9194-7bc26e5ef137\") "
Jul 21 17:02:15.952723 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952626    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ef3ce07-5f50-4734-9194-7bc26e5ef137" (UID: "0ef3ce07-5f50-4734-9194-7bc26e5ef137"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:15.952723 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952638    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ef3ce07-5f50-4734-9194-7bc26e5ef137" (UID: "0ef3ce07-5f50-4734-9194-7bc26e5ef137"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:15.952936 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.952916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-home" (OuterVolumeSpecName: "home") pod "0ef3ce07-5f50-4734-9194-7bc26e5ef137" (UID: "0ef3ce07-5f50-4734-9194-7bc26e5ef137"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:15.953055 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.953040    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-home\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:15.953120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.953059    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-model-cache\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:15.953120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.953073    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tmp-dir\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:15.954704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.954680    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ef3ce07-5f50-4734-9194-7bc26e5ef137" (UID: "0ef3ce07-5f50-4734-9194-7bc26e5ef137"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:02:15.954704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.954692    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-dshm" (OuterVolumeSpecName: "dshm") pod "0ef3ce07-5f50-4734-9194-7bc26e5ef137" (UID: "0ef3ce07-5f50-4734-9194-7bc26e5ef137"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:15.954853 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:15.954713    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef3ce07-5f50-4734-9194-7bc26e5ef137-kube-api-access-lxlfn" (OuterVolumeSpecName: "kube-api-access-lxlfn") pod "0ef3ce07-5f50-4734-9194-7bc26e5ef137" (UID: "0ef3ce07-5f50-4734-9194-7bc26e5ef137"). InnerVolumeSpecName "kube-api-access-lxlfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:16.053671 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.053640    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ef3ce07-5f50-4734-9194-7bc26e5ef137-tls-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:16.053671 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.053666    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ef3ce07-5f50-4734-9194-7bc26e5ef137-dshm\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:16.053671 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.053675    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxlfn\" (UniqueName: \"kubernetes.io/projected/0ef3ce07-5f50-4734-9194-7bc26e5ef137-kube-api-access-lxlfn\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:16.847004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.846967    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c" event={"ID":"0ef3ce07-5f50-4734-9194-7bc26e5ef137","Type":"ContainerDied","Data":"41fafd4ecd0b3b5a52b9948f57f4600b15eb41dd07c759812c61433bbf99b390"}
Jul 21 17:02:16.847412 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.847006    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"
Jul 21 17:02:16.847412 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.847026    2573 scope.go:117] "RemoveContainer" containerID="f5c04e447209f2e9c45e203b62e6176c2214f3931ad28baf0c402f8ddcc026d7"
Jul 21 17:02:16.866598 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.866574    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"]
Jul 21 17:02:16.871171 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:16.871148    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-650aed9b/e2e-lifecycle-model-650aed9b-kserve-6b5f87bb75-2pd4c"]
Jul 21 17:02:18.700329 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:18.700294    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ef3ce07-5f50-4734-9194-7bc26e5ef137" path="/var/lib/kubelet/pods/0ef3ce07-5f50-4734-9194-7bc26e5ef137/volumes"
Jul 21 17:02:31.107773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:31.107687    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:31.208221 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:31.208192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.034554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:38.034517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.700799 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:38.700761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.927674 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:38.927640    2573 scope.go:117] "RemoveContainer" containerID="77448aa1a080728ce0524ff48b11d26f69c06224c7c3764e960ff931748004bf"
Jul 21 17:02:38.936600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:38.936578    2573 scope.go:117] "RemoveContainer" containerID="c548d3f0d6a0afaac108cdece903e217f33c4a241a27886526fcbcc25c0ab58b"
Jul 21 17:02:44.321958 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:44.321923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:44.421996 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:44.421960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:44.639419 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:44.639338    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"]
Jul 21 17:02:44.639606 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:44.639579    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy" containerID="cri-o://dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca" gracePeriod=30
Jul 21 17:02:44.693331 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:44.693295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:44.898505 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:44.898426    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.015709 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:46.015659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.113671 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:46.113642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.213841 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:46.213807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:47.023277 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:47.023238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:47.120638 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:47.120601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:47.225663 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:47.225632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:48.758934 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:48.758902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:49.898223 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.898200    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:02:49.969872 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.969795    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-podinfo\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.969872 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.969860    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-certs\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970097 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.969925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-envoy\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970097 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.969965    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-data\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970097 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.969990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bmj6\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-kube-api-access-6bmj6\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970097 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970040    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-token\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970097 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istiod-ca-cert\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970097 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970085    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:49.970420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-credential-socket\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-socket\") pod \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\" (UID: \"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1\") "
Jul 21 17:02:49.970562 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970535    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:02:49.970694 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970665    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:49.970694 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970685    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:49.970806 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970760    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:49.970926 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.970877    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:49.971052 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.971027    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:49.972394 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.972360    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-kube-api-access-6bmj6" (OuterVolumeSpecName: "kube-api-access-6bmj6") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "kube-api-access-6bmj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:49.972394 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.972385    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:49.972530 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.972386    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:49.972530 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:49.972430    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" (UID: "fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:02:50.041800 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.041771    2573 generic.go:356] "Generic (PLEG): container finished" podID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerID="dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca" exitCode=0
Jul 21 17:02:50.041959 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.041814    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"
Jul 21 17:02:50.041959 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.041856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" event={"ID":"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1","Type":"ContainerDied","Data":"dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca"}
Jul 21 17:02:50.041959 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.041923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99" event={"ID":"fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1","Type":"ContainerDied","Data":"164d7778b848778d72bc4d10181197214ac6aa84f2cf771c280ff25ddfa0c3d9"}
Jul 21 17:02:50.041959 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.041947    2573 scope.go:117] "RemoveContainer" containerID="dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca"
Jul 21 17:02:50.051425 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.051408    2573 scope.go:117] "RemoveContainer" containerID="69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"
Jul 21 17:02:50.062360 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.062341    2573 scope.go:117] "RemoveContainer" containerID="dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca"
Jul 21 17:02:50.062608 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:02:50.062585    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca\": container with ID starting with dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca not found: ID does not exist" containerID="dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca"
Jul 21 17:02:50.062680 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.062620    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca"} err="failed to get container status \"dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca\": rpc error: code = NotFound desc = could not find container \"dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca\": container with ID starting with dace199d58007b1e267fa508e6e7c5d1d0bec04cf5e163e748c4ae5db83e9eca not found: ID does not exist"
Jul 21 17:02:50.062680 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.062640    2573 scope.go:117] "RemoveContainer" containerID="69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"
Jul 21 17:02:50.062863 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:02:50.062846    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad\": container with ID starting with 69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad not found: ID does not exist" containerID="69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"
Jul 21 17:02:50.062922 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.062868    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad"} err="failed to get container status \"69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad\": rpc error: code = NotFound desc = could not find container \"69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad\": container with ID starting with 69983657e48b365001054ee061d212ad064decb6555ddb7f20f39948c476b3ad not found: ID does not exist"
Jul 21 17:02:50.067481 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.067461    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"]
Jul 21 17:02:50.072107 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072090    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.072107 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072108    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.072230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072117    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.072230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072125    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bmj6\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-kube-api-access-6bmj6\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.072230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072134    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.072230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072143    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.072230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.072153    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:02:50.082864 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.082844    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-650aed9b-openshift-default-5cdc6754f9-n6n99"]
Jul 21 17:02:50.699730 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:50.699697    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" path="/var/lib/kubelet/pods/fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1/volumes"
Jul 21 17:02:55.173414 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:55.173383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:55.251249 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:55.251216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:55.865649 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:02:55.865618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:02.209613 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:02.209569    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:02.564951 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:02.564917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:02.705607 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:02.705575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:13.124854 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:13.124819    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:13.388801 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:13.388723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:34.427491 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:34.427453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:38.864006 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:38.863975    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:03:38.869214 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:38.869193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:03:38.965322 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:38.965292    2573 scope.go:117] "RemoveContainer" containerID="1dd30d49b9f3996923c519982c39efb7e6eb32e99067e296efcca534cdb75b79"
Jul 21 17:03:40.563183 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:40.563147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:40.663863 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:40.663830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:40.982463 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:40.982372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:41.282944 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.282858    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"]
Jul 21 17:03:41.283329 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283311    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy"
Jul 21 17:03:41.283373 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283332    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy"
Jul 21 17:03:41.283373 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283345    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ef3ce07-5f50-4734-9194-7bc26e5ef137" containerName="main"
Jul 21 17:03:41.283373 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283351    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef3ce07-5f50-4734-9194-7bc26e5ef137" containerName="main"
Jul 21 17:03:41.283465 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283431    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy"
Jul 21 17:03:41.283465 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283439    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy"
Jul 21 17:03:41.283465 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.283446    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ef3ce07-5f50-4734-9194-7bc26e5ef137" containerName="main"
Jul 21 17:03:41.287919 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.287903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.290815 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.290798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2c9f37-openshift-default-dockercfg-lhljv\""
Jul 21 17:03:41.302205 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.302184    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"]
Jul 21 17:03:41.314960 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.314937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:41.330344 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330320    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-podinfo\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330449 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-token\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330492 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-envoy\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330579 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-data\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330616 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-certs\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330650 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-socket\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330695 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a4219f6-32b9-4148-855e-a4cba81c71d0-istiod-ca-cert\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330769 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-credential-socket\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.330807 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.330797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtc6\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-kube-api-access-qqtc6\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.431649 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-credential-socket\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtc6\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-kube-api-access-qqtc6\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-podinfo\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-token\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-envoy\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-data\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-certs\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-socket\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.431976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a4219f6-32b9-4148-855e-a4cba81c71d0-istiod-ca-cert\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432570 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.432104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-credential-socket\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432570 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.432286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-socket\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432570 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.432364    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-data\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432570 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.432372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-certs\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.432983 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.432964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a4219f6-32b9-4148-855e-a4cba81c71d0-istiod-ca-cert\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.434537 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.434511    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-envoy\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.434822 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.434803    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-podinfo\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.442232 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.442211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-token\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.442521 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.442500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtc6\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-kube-api-access-qqtc6\") pod \"e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") " pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.534245 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.534145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:41.601359 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.601333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:41.744503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.744465    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"]
Jul 21 17:03:41.745479 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:03:41.745454    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4219f6_32b9_4148_855e_a4cba81c71d0.slice/crio-68f82d4bcc28f6ed5242e97c09c13fcaf85d19ccbe50e641e7671877b2b2e82d WatchSource:0}: Error finding container 68f82d4bcc28f6ed5242e97c09c13fcaf85d19ccbe50e641e7671877b2b2e82d: Status 404 returned error can't find the container with id 68f82d4bcc28f6ed5242e97c09c13fcaf85d19ccbe50e641e7671877b2b2e82d
Jul 21 17:03:41.750705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.750667    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:41.750823 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.750752    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:41.750823 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:41.750793    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:42.337516 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:42.337491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" event={"ID":"8a4219f6-32b9-4148-855e-a4cba81c71d0","Type":"ContainerStarted","Data":"8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"}
Jul 21 17:03:42.337678 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:42.337538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" event={"ID":"8a4219f6-32b9-4148-855e-a4cba81c71d0","Type":"ContainerStarted","Data":"68f82d4bcc28f6ed5242e97c09c13fcaf85d19ccbe50e641e7671877b2b2e82d"}
Jul 21 17:03:42.362690 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:42.362639    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podStartSLOduration=1.362622837 podStartE2EDuration="1.362622837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:42.360331683 +0000 UTC m=+2404.177011127" watchObservedRunningTime="2026-07-21 17:03:42.362622837 +0000 UTC m=+2404.179302279"
Jul 21 17:03:42.601626 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:42.601543    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:42.606217 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:42.606193    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:43.343247 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:43.343216    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:43.344155 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:43.344134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:44.369281 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:44.369244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:44.466103 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:44.466072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:44.542936 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:44.542877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:44.650547 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:44.650437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:45.117049 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:45.117009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:45.220004 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:45.219973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:48.981803 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:48.981769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:49.349615 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.349570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:49.667005 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.666915    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"]
Jul 21 17:03:49.667552 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.667535    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy"
Jul 21 17:03:49.667601 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.667554    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9d94cc-2a2f-4dce-b2f6-e688261b8fc1" containerName="istio-proxy"
Jul 21 17:03:49.671308 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.671289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.674324 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.674296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8756ef-openshift-default-dockercfg-w2lbs\""
Jul 21 17:03:49.687492 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.687467    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"]
Jul 21 17:03:49.709745 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed42d27-272e-4973-8f23-71a37d824130-istio-podinfo\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.709862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-istio-token\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.709862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-credential-socket\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.709862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-certs\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.709862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed42d27-272e-4973-8f23-71a37d824130-istiod-ca-cert\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.710096 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p857v\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-kube-api-access-p857v\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.710096 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.709940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-envoy\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.710096 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.710011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-socket\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.710096 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.710046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-data\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.714125 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.714103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:49.810862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.810831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p857v\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-kube-api-access-p857v\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.810862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.810861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-envoy\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811122 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.810972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-socket\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811122 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-data\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811122 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed42d27-272e-4973-8f23-71a37d824130-istio-podinfo\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811122 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811105    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-istio-token\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811336 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-credential-socket\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811336 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-certs\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811336 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811279    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed42d27-272e-4973-8f23-71a37d824130-istiod-ca-cert\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811506 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-socket\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811506 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811434    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-data\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811717 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-credential-socket\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.811914 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.811873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-certs\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.812169 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.812149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed42d27-272e-4973-8f23-71a37d824130-istiod-ca-cert\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.813385 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.813359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-envoy\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.813661 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.813642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed42d27-272e-4973-8f23-71a37d824130-istio-podinfo\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.820133 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.820106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-istio-token\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.820231 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.820153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p857v\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-kube-api-access-p857v\") pod \"e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") " pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:49.982442 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:49.982366    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:50.054346 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.054318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:50.123294 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.123267    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"]
Jul 21 17:03:50.124274 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:03:50.124248    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed42d27_272e_4973_8f23_71a37d824130.slice/crio-0ef9e6fbb1e96aabca8ab67be8bd601fa454afaf10cdc55122e51cc35fa84603 WatchSource:0}: Error finding container 0ef9e6fbb1e96aabca8ab67be8bd601fa454afaf10cdc55122e51cc35fa84603: Status 404 returned error can't find the container with id 0ef9e6fbb1e96aabca8ab67be8bd601fa454afaf10cdc55122e51cc35fa84603
Jul 21 17:03:50.126422 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.126390    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:50.126519 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.126455    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:50.126519 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.126484    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:50.387202 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.387164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" event={"ID":"1ed42d27-272e-4973-8f23-71a37d824130","Type":"ContainerStarted","Data":"7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"}
Jul 21 17:03:50.387357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.387228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" event={"ID":"1ed42d27-272e-4973-8f23-71a37d824130","Type":"ContainerStarted","Data":"0ef9e6fbb1e96aabca8ab67be8bd601fa454afaf10cdc55122e51cc35fa84603"}
Jul 21 17:03:50.411607 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.411563    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" podStartSLOduration=1.411550246 podStartE2EDuration="1.411550246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:50.410574883 +0000 UTC m=+2412.227254327" watchObservedRunningTime="2026-07-21 17:03:50.411550246 +0000 UTC m=+2412.228229760"
Jul 21 17:03:50.983489 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:50.983456    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:51.987819 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:51.987791    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:52.398497 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:52.398466    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:52.399488 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:52.399471    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:03:52.483995 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:52.483955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:52.580054 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:52.579952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:52.752231 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:52.752079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:52.883189 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:52.883148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:53.461936 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:53.461872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:53.562782 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:53.562748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:56.988096 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:56.988053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:58.358618 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.358277    2573 patch_prober.go:28] interesting pod/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:58294->10.132.0.65:15021: read: connection reset by peer" start-of-body=
Jul 21 17:03:58.358618 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.358363    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:58294->10.132.0.65:15021: read: connection reset by peer"
Jul 21 17:03:58.444345 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.444295    2573 generic.go:356] "Generic (PLEG): container finished" podID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerID="8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979" exitCode=0
Jul 21 17:03:58.444540 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.444355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" event={"ID":"8a4219f6-32b9-4148-855e-a4cba81c71d0","Type":"ContainerDied","Data":"8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"}
Jul 21 17:03:58.445009 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.444979    2573 scope.go:117] "RemoveContainer" containerID="8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"
Jul 21 17:03:58.446195 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.446160    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:58.446288 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.446247    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:58.446351 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:58.446293    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:03:59.462919 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:59.462583    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" event={"ID":"8a4219f6-32b9-4148-855e-a4cba81c71d0","Type":"ContainerStarted","Data":"32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3"}
Jul 21 17:03:59.601669 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:59.601641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:03:59.601839 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:59.601813    2573 patch_prober.go:28] interesting pod/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 21 17:03:59.601904 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:03:59.601863    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 21 17:04:00.602331 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:00.602250    2573 patch_prober.go:28] interesting pod/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 21 17:04:00.602331 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:00.602315    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 21 17:04:01.602714 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:01.602672    2573 patch_prober.go:28] interesting pod/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 21 17:04:01.603100 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:01.602743    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 21 17:04:02.602342 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:02.602303    2573 patch_prober.go:28] interesting pod/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 21 17:04:02.602514 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:02.602370    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 21 17:04:03.604779 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:03.604749    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:04:03.605226 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:03.605196    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:04:03.605743 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:03.605724    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:04:04.499735 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:04.499643    2573 generic.go:356] "Generic (PLEG): container finished" podID="1ed42d27-272e-4973-8f23-71a37d824130" containerID="7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2" exitCode=0
Jul 21 17:04:04.499735 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:04.499714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" event={"ID":"1ed42d27-272e-4973-8f23-71a37d824130","Type":"ContainerDied","Data":"7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"}
Jul 21 17:04:04.500114 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:04.500099    2573 scope.go:117] "RemoveContainer" containerID="7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"
Jul 21 17:04:04.501069 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:04.501040    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:04:04.501180 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:04.501120    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:04:04.501180 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:04.501170    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:04:05.507015 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:05.506982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" event={"ID":"1ed42d27-272e-4973-8f23-71a37d824130","Type":"ContainerStarted","Data":"e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62"}
Jul 21 17:04:05.982785 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:05.982751    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:04:05.984210 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:05.984181    2573 patch_prober.go:28] interesting pod/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 17:04:05.984337 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:05.984236    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 17:04:06.109185 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:06.109105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.215206 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:06.215169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.983191 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:06.983156    2573 patch_prober.go:28] interesting pod/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 17:04:06.983576 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:06.983222    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 17:04:07.398804 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:07.398770    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:04:07.982737 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:07.982708    2573 patch_prober.go:28] interesting pod/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 17:04:07.982909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:07.982755    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 17:04:08.688927 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:08.688874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:08.982869 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:08.982775    2573 patch_prober.go:28] interesting pod/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 17:04:08.982869 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:08.982834    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 17:04:09.986736 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:09.986703    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:04:09.987579 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:09.987558    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:04:14.334369 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:14.334339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:14.402308 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:14.402277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:33.114366 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.114336    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"]
Jul 21 17:04:33.116773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.116758    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.120824 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.120805    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8756ef\"/\"openshift-service-ca.crt\""
Jul 21 17:04:33.121479 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.121464    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8756ef\"/\"kube-root-ca.crt\""
Jul 21 17:04:33.122575 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.122556    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8756ef\"/\"default-dockercfg-xnlzf\""
Jul 21 17:04:33.122634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.122596    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8756ef\"/\"test-model-8756ef-kserve-self-signed-certs\""
Jul 21 17:04:33.134812 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.134791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"]
Jul 21 17:04:33.155912 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.155848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:33.234564 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.234544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dda6c7-7839-4077-9d2e-b6d85b95198c-tls-certs\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.234661 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.234578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-home\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.234661 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.234595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-dshm\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.234734 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.234699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-model-cache\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.234734 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.234728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-tmp-dir\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.234802 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.234759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m692\" (UniqueName: \"kubernetes.io/projected/97dda6c7-7839-4077-9d2e-b6d85b95198c-kube-api-access-7m692\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.335676 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.335648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m692\" (UniqueName: \"kubernetes.io/projected/97dda6c7-7839-4077-9d2e-b6d85b95198c-kube-api-access-7m692\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.335831 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.335691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dda6c7-7839-4077-9d2e-b6d85b95198c-tls-certs\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.335831 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.335720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-home\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.335831 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.335743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-dshm\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.335831 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.335814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-model-cache\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.336186 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.335848    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-tmp-dir\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.336247 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.336222    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-home\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.336295 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.336251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-tmp-dir\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.336332 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.336305    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-model-cache\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.338372 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.338344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-dshm\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.338531 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.338511    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dda6c7-7839-4077-9d2e-b6d85b95198c-tls-certs\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.345602 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.345582    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m692\" (UniqueName: \"kubernetes.io/projected/97dda6c7-7839-4077-9d2e-b6d85b95198c-kube-api-access-7m692\") pod \"test-model-8756ef-kserve-686d446cbc-qvz5p\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") " pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.425847 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.425786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:33.563651 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.563628    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"]
Jul 21 17:04:33.565294 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:04:33.565264    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97dda6c7_7839_4077_9d2e_b6d85b95198c.slice/crio-92d6e437251caed46342e2836e960e13235d34f3fe6263e5ebdce19ffc3c9720 WatchSource:0}: Error finding container 92d6e437251caed46342e2836e960e13235d34f3fe6263e5ebdce19ffc3c9720: Status 404 returned error can't find the container with id 92d6e437251caed46342e2836e960e13235d34f3fe6263e5ebdce19ffc3c9720
Jul 21 17:04:33.674076 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.674040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p" event={"ID":"97dda6c7-7839-4077-9d2e-b6d85b95198c","Type":"ContainerStarted","Data":"34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39"}
Jul 21 17:04:33.674209 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.674086    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p" event={"ID":"97dda6c7-7839-4077-9d2e-b6d85b95198c","Type":"ContainerStarted","Data":"92d6e437251caed46342e2836e960e13235d34f3fe6263e5ebdce19ffc3c9720"}
Jul 21 17:04:33.694322 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:33.694242    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p" podStartSLOduration=0.694229006 podStartE2EDuration="694.229006ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:04:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:04:33.693915848 +0000 UTC m=+2455.510595289" watchObservedRunningTime="2026-07-21 17:04:33.694229006 +0000 UTC m=+2455.510908449"
Jul 21 17:04:38.990456 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:38.990422    2573 scope.go:117] "RemoveContainer" containerID="998d06df07c12485f5a0f6590c6e470ad53a1cf31e4e152614b10fb82fef20a0"
Jul 21 17:04:43.426599 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:43.426568    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:43.427094 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:43.426612    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:43.438917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:43.438879    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:43.748422 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:43.748333    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:04:55.125107 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:55.125074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:55.183609 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:04:55.183583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:11.702562 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:11.702519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:12.630471 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:12.630443    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"]
Jul 21 17:05:13.332343 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:13.332310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:13.479542 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:13.479503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:23.578091 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:23.578056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:27.650826 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:27.650785    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p" podUID="97dda6c7-7839-4077-9d2e-b6d85b95198c" containerName="main" containerID="cri-o://34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39" gracePeriod=45
Jul 21 17:05:27.841032 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:27.841000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:27.899715 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:27.899692    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:05:28.002253 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.002159    2573 generic.go:356] "Generic (PLEG): container finished" podID="97dda6c7-7839-4077-9d2e-b6d85b95198c" containerID="34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39" exitCode=0
Jul 21 17:05:28.002253 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.002204    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"
Jul 21 17:05:28.002253 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.002246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p" event={"ID":"97dda6c7-7839-4077-9d2e-b6d85b95198c","Type":"ContainerDied","Data":"34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39"}
Jul 21 17:05:28.002463 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.002287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p" event={"ID":"97dda6c7-7839-4077-9d2e-b6d85b95198c","Type":"ContainerDied","Data":"92d6e437251caed46342e2836e960e13235d34f3fe6263e5ebdce19ffc3c9720"}
Jul 21 17:05:28.002463 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.002311    2573 scope.go:117] "RemoveContainer" containerID="34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39"
Jul 21 17:05:28.010990 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.010968    2573 scope.go:117] "RemoveContainer" containerID="34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39"
Jul 21 17:05:28.011247 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:05:28.011228    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39\": container with ID starting with 34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39 not found: ID does not exist" containerID="34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39"
Jul 21 17:05:28.011304 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.011256    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39"} err="failed to get container status \"34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39\": rpc error: code = NotFound desc = could not find container \"34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39\": container with ID starting with 34bf19008555642f0cb9bf230226a4816b364cf5d12625d116531c8e6ca40e39 not found: ID does not exist"
Jul 21 17:05:28.036745 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.036721    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dda6c7-7839-4077-9d2e-b6d85b95198c-tls-certs\") pod \"97dda6c7-7839-4077-9d2e-b6d85b95198c\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") "
Jul 21 17:05:28.036879 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.036811    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m692\" (UniqueName: \"kubernetes.io/projected/97dda6c7-7839-4077-9d2e-b6d85b95198c-kube-api-access-7m692\") pod \"97dda6c7-7839-4077-9d2e-b6d85b95198c\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") "
Jul 21 17:05:28.036879 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.036846    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-model-cache\") pod \"97dda6c7-7839-4077-9d2e-b6d85b95198c\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") "
Jul 21 17:05:28.037036 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.036948    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-tmp-dir\") pod \"97dda6c7-7839-4077-9d2e-b6d85b95198c\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") "
Jul 21 17:05:28.037036 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.036999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-dshm\") pod \"97dda6c7-7839-4077-9d2e-b6d85b95198c\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") "
Jul 21 17:05:28.037136 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037050    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-home\") pod \"97dda6c7-7839-4077-9d2e-b6d85b95198c\" (UID: \"97dda6c7-7839-4077-9d2e-b6d85b95198c\") "
Jul 21 17:05:28.037228 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037167    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-model-cache" (OuterVolumeSpecName: "model-cache") pod "97dda6c7-7839-4077-9d2e-b6d85b95198c" (UID: "97dda6c7-7839-4077-9d2e-b6d85b95198c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:28.037320 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037262    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "97dda6c7-7839-4077-9d2e-b6d85b95198c" (UID: "97dda6c7-7839-4077-9d2e-b6d85b95198c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:28.037391 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037340    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-home" (OuterVolumeSpecName: "home") pod "97dda6c7-7839-4077-9d2e-b6d85b95198c" (UID: "97dda6c7-7839-4077-9d2e-b6d85b95198c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:28.037488 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037467    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-model-cache\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:28.037488 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037491    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-tmp-dir\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:28.037638 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.037504    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-home\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:28.039113 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.039085    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97dda6c7-7839-4077-9d2e-b6d85b95198c-kube-api-access-7m692" (OuterVolumeSpecName: "kube-api-access-7m692") pod "97dda6c7-7839-4077-9d2e-b6d85b95198c" (UID: "97dda6c7-7839-4077-9d2e-b6d85b95198c"). InnerVolumeSpecName "kube-api-access-7m692". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:28.039113 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.039105    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97dda6c7-7839-4077-9d2e-b6d85b95198c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97dda6c7-7839-4077-9d2e-b6d85b95198c" (UID: "97dda6c7-7839-4077-9d2e-b6d85b95198c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:05:28.039268 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.039124    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-dshm" (OuterVolumeSpecName: "dshm") pod "97dda6c7-7839-4077-9d2e-b6d85b95198c" (UID: "97dda6c7-7839-4077-9d2e-b6d85b95198c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:28.138704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.138675    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m692\" (UniqueName: \"kubernetes.io/projected/97dda6c7-7839-4077-9d2e-b6d85b95198c-kube-api-access-7m692\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:28.138704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.138702    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97dda6c7-7839-4077-9d2e-b6d85b95198c-dshm\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:28.138863 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.138712    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dda6c7-7839-4077-9d2e-b6d85b95198c-tls-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:28.219618 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.219593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:28.327361 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.327326    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"]
Jul 21 17:05:28.332689 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.332665    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8756ef/test-model-8756ef-kserve-686d446cbc-qvz5p"]
Jul 21 17:05:28.700417 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:28.700340    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97dda6c7-7839-4077-9d2e-b6d85b95198c" path="/var/lib/kubelet/pods/97dda6c7-7839-4077-9d2e-b6d85b95198c/volumes"
Jul 21 17:05:34.550637 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:34.550548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:34.685837 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:34.685805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:34.801683 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:34.801610    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"]
Jul 21 17:05:34.801862 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:34.801836    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy" containerID="cri-o://32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3" gracePeriod=30
Jul 21 17:05:34.832957 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:34.832922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:35.318961 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:35.318929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:35.788639 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:35.788602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:35.906297 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:35.906267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:37.587873 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:37.587835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:40.059977 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.059954    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:05:40.071527 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.071460    2573 generic.go:356] "Generic (PLEG): container finished" podID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerID="32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3" exitCode=0
Jul 21 17:05:40.071527 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.071501    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"
Jul 21 17:05:40.071651 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.071540    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" event={"ID":"8a4219f6-32b9-4148-855e-a4cba81c71d0","Type":"ContainerDied","Data":"32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3"}
Jul 21 17:05:40.071651 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.071597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw" event={"ID":"8a4219f6-32b9-4148-855e-a4cba81c71d0","Type":"ContainerDied","Data":"68f82d4bcc28f6ed5242e97c09c13fcaf85d19ccbe50e641e7671877b2b2e82d"}
Jul 21 17:05:40.071651 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.071622    2573 scope.go:117] "RemoveContainer" containerID="32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3"
Jul 21 17:05:40.080401 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.080386    2573 scope.go:117] "RemoveContainer" containerID="8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"
Jul 21 17:05:40.100230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.100192    2573 scope.go:117] "RemoveContainer" containerID="32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3"
Jul 21 17:05:40.100610 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:05:40.100568    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3\": container with ID starting with 32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3 not found: ID does not exist" containerID="32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3"
Jul 21 17:05:40.100695 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.100631    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3"} err="failed to get container status \"32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3\": rpc error: code = NotFound desc = could not find container \"32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3\": container with ID starting with 32fea6121f69e73da0405416d3c1a67536b68cffdddd01d622b012ac009ed3a3 not found: ID does not exist"
Jul 21 17:05:40.100695 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.100652    2573 scope.go:117] "RemoveContainer" containerID="8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"
Jul 21 17:05:40.100952 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:05:40.100929    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979\": container with ID starting with 8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979 not found: ID does not exist" containerID="8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"
Jul 21 17:05:40.101039 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.100957    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979"} err="failed to get container status \"8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979\": rpc error: code = NotFound desc = could not find container \"8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979\": container with ID starting with 8313a9837c393cda83eb1daadc30b0f6ba03b70c29ccc2385a514c83e4bf8979 not found: ID does not exist"
Jul 21 17:05:40.248445 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248421    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-envoy\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248544 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-data\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248544 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-credential-socket\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248544 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248519    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqtc6\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-kube-api-access-qqtc6\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248700 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a4219f6-32b9-4148-855e-a4cba81c71d0-istiod-ca-cert\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248700 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248578    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-certs\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248700 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248612    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-podinfo\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248724    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-token\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-socket\") pod \"8a4219f6-32b9-4148-855e-a4cba81c71d0\" (UID: \"8a4219f6-32b9-4148-855e-a4cba81c71d0\") "
Jul 21 17:05:40.248993 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248824    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:40.248993 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.248935    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:40.249111 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.249020    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a4219f6-32b9-4148-855e-a4cba81c71d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:40.249219 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.249198    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.249280 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.249224    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a4219f6-32b9-4148-855e-a4cba81c71d0-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.249280 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.249239    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.249280 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.249200    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:40.249477 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.249452    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:40.250914 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.250871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-kube-api-access-qqtc6" (OuterVolumeSpecName: "kube-api-access-qqtc6") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "kube-api-access-qqtc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:40.251026 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.250956    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:05:40.251428 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.251407    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:40.251497 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.251413    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a4219f6-32b9-4148-855e-a4cba81c71d0" (UID: "8a4219f6-32b9-4148-855e-a4cba81c71d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:40.349687 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.349629    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.349687 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.349655    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.349687 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.349664    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.349687 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.349672    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.349687 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.349682    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a4219f6-32b9-4148-855e-a4cba81c71d0-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.349687 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.349689    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqtc6\" (UniqueName: \"kubernetes.io/projected/8a4219f6-32b9-4148-855e-a4cba81c71d0-kube-api-access-qqtc6\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:05:40.409940 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.409909    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"]
Jul 21 17:05:40.415394 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.415373    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2c9f37-openshift-default-86bb884977-9z6tw"]
Jul 21 17:05:40.700020 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:40.699940    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" path="/var/lib/kubelet/pods/8a4219f6-32b9-4148-855e-a4cba81c71d0/volumes"
Jul 21 17:05:46.083321 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:46.083278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:50.254113 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:50.254083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:50.656521 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:50.656485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:57.381754 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:57.381711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:57.457937 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:57.457907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:57.715739 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:57.715650    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"]
Jul 21 17:05:57.715909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:57.715849    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy" containerID="cri-o://e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62" gracePeriod=30
Jul 21 17:05:57.716555 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:57.716229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:57.948528 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:57.948485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:58.282414 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.282368    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:58.591873 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.591842    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"]
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592233    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592244    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592257    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592264    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592280    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97dda6c7-7839-4077-9d2e-b6d85b95198c" containerName="main"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592286    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="97dda6c7-7839-4077-9d2e-b6d85b95198c" containerName="main"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592354    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy"
Jul 21 17:05:58.592357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592360    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="97dda6c7-7839-4077-9d2e-b6d85b95198c" containerName="main"
Jul 21 17:05:58.592787 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.592369    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a4219f6-32b9-4148-855e-a4cba81c71d0" containerName="istio-proxy"
Jul 21 17:05:58.595724 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.595700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.602944 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.602673    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d8794b-openshift-default-dockercfg-khtx7\""
Jul 21 17:05:58.619232 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.619205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"]
Jul 21 17:05:58.645479 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.645452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:58.708121 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02c1e70-3dbb-4f17-a1be-308f37c08402-istiod-ca-cert\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708292 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbw9x\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-kube-api-access-gbw9x\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708292 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-socket\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708292 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-podinfo\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708292 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-credential-socket\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708292 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-certs\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708541 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-data\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708541 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-envoy\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.708541 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.708364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-token\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.770077 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.770045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:58.809193 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-socket\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809322 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-podinfo\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809322 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-credential-socket\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809322 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-certs\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809322 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-data\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809533 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-envoy\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809533 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-token\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809533 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02c1e70-3dbb-4f17-a1be-308f37c08402-istiod-ca-cert\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809533 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbw9x\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-kube-api-access-gbw9x\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809788 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-socket\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809788 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-credential-socket\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809788 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-data\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.809947 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.809791    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-certs\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.810229 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.810210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02c1e70-3dbb-4f17-a1be-308f37c08402-istiod-ca-cert\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.811629 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.811610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-podinfo\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.811722 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.811700    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-envoy\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.818326 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.818300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-token\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.818659 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.818640    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbw9x\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-kube-api-access-gbw9x\") pod \"e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") " pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:58.906871 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:58.906800    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:05:59.051540 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.051513    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"]
Jul 21 17:05:59.052586 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:05:59.052557    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02c1e70_3dbb_4f17_a1be_308f37c08402.slice/crio-437b7410d3fd192919662e8811474430f56a05f154e29f9305448aeaa9ae1e44 WatchSource:0}: Error finding container 437b7410d3fd192919662e8811474430f56a05f154e29f9305448aeaa9ae1e44: Status 404 returned error can't find the container with id 437b7410d3fd192919662e8811474430f56a05f154e29f9305448aeaa9ae1e44
Jul 21 17:05:59.054793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.054751    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:05:59.054871 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.054836    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:05:59.054931 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.054906    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:05:59.178759 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.178666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" event={"ID":"b02c1e70-3dbb-4f17-a1be-308f37c08402","Type":"ContainerStarted","Data":"68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"}
Jul 21 17:05:59.178924 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.178769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" event={"ID":"b02c1e70-3dbb-4f17-a1be-308f37c08402","Type":"ContainerStarted","Data":"437b7410d3fd192919662e8811474430f56a05f154e29f9305448aeaa9ae1e44"}
Jul 21 17:05:59.203191 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.203133    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podStartSLOduration=1.203115001 podStartE2EDuration="1.203115001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:05:59.200632934 +0000 UTC m=+2541.017312378" watchObservedRunningTime="2026-07-21 17:05:59.203115001 +0000 UTC m=+2541.019794446"
Jul 21 17:05:59.907775 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:05:59.907734    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:00.911943 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:00.911912    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:01.183554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:01.183473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:01.190657 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:01.190631    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:01.191671 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:01.191646    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:01.280198 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:01.280167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:01.452923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:01.452835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:01.659009 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:01.658976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:02.326795 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:02.326762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:02.439233 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:02.439205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:02.969280 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:02.969258    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:06:03.049471 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049442    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-credential-socket\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049607 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049492    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-certs\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049607 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049531    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-istio-token\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049711 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049617    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-envoy\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049711 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed42d27-272e-4973-8f23-71a37d824130-istiod-ca-cert\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049821 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049709    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-socket\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049821 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049719    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:03.049821 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049758    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed42d27-272e-4973-8f23-71a37d824130-istio-podinfo\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.049821 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049769    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:03.049821 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049802    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-data\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.050101 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.049827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p857v\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-kube-api-access-p857v\") pod \"1ed42d27-272e-4973-8f23-71a37d824130\" (UID: \"1ed42d27-272e-4973-8f23-71a37d824130\") "
Jul 21 17:06:03.050101 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.050039    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed42d27-272e-4973-8f23-71a37d824130-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:03.050265 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.050231    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:03.050265 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.050257    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed42d27-272e-4973-8f23-71a37d824130-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.050448 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.050280    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.050448 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.050297    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.050619 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.050592    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:03.051925 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.051867    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:03.052028 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.051918    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:03.052028 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.051925    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-kube-api-access-p857v" (OuterVolumeSpecName: "kube-api-access-p857v") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "kube-api-access-p857v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:03.052127 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.052047    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ed42d27-272e-4973-8f23-71a37d824130-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ed42d27-272e-4973-8f23-71a37d824130" (UID: "1ed42d27-272e-4973-8f23-71a37d824130"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:06:03.151588 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.151560    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p857v\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-kube-api-access-p857v\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.151588 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.151585    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed42d27-272e-4973-8f23-71a37d824130-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.151588 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.151594    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.151782 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.151602    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.151782 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.151611    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed42d27-272e-4973-8f23-71a37d824130-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.151782 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.151620    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed42d27-272e-4973-8f23-71a37d824130-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:03.203497 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.203470    2573 generic.go:356] "Generic (PLEG): container finished" podID="1ed42d27-272e-4973-8f23-71a37d824130" containerID="e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62" exitCode=0
Jul 21 17:06:03.203653 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.203529    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"
Jul 21 17:06:03.203653 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.203552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" event={"ID":"1ed42d27-272e-4973-8f23-71a37d824130","Type":"ContainerDied","Data":"e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62"}
Jul 21 17:06:03.203653 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.203603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw" event={"ID":"1ed42d27-272e-4973-8f23-71a37d824130","Type":"ContainerDied","Data":"0ef9e6fbb1e96aabca8ab67be8bd601fa454afaf10cdc55122e51cc35fa84603"}
Jul 21 17:06:03.203653 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.203629    2573 scope.go:117] "RemoveContainer" containerID="e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62"
Jul 21 17:06:03.214230 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.214215    2573 scope.go:117] "RemoveContainer" containerID="7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"
Jul 21 17:06:03.222451 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.222433    2573 scope.go:117] "RemoveContainer" containerID="e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62"
Jul 21 17:06:03.222690 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:06:03.222672    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62\": container with ID starting with e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62 not found: ID does not exist" containerID="e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62"
Jul 21 17:06:03.222731 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.222701    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62"} err="failed to get container status \"e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62\": rpc error: code = NotFound desc = could not find container \"e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62\": container with ID starting with e94b442a4c81632bebea6f4ffc7332c811f138d67b95e8f4fc0052e3f4df2b62 not found: ID does not exist"
Jul 21 17:06:03.222731 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.222718    2573 scope.go:117] "RemoveContainer" containerID="7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"
Jul 21 17:06:03.222977 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:06:03.222960    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2\": container with ID starting with 7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2 not found: ID does not exist" containerID="7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"
Jul 21 17:06:03.223028 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.222983    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2"} err="failed to get container status \"7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2\": rpc error: code = NotFound desc = could not find container \"7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2\": container with ID starting with 7e1a2fca0c02b2e2b36b7cf659107fdd458a6c3a3cd57709bbd25e761cea49a2 not found: ID does not exist"
Jul 21 17:06:03.236689 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.236668    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"]
Jul 21 17:06:03.259348 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:03.259329    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8756ef-openshift-default-588dd8ff5c-blnpw"]
Jul 21 17:06:04.699268 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:04.699232    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed42d27-272e-4973-8f23-71a37d824130" path="/var/lib/kubelet/pods/1ed42d27-272e-4973-8f23-71a37d824130/volumes"
Jul 21 17:06:05.682179 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:05.682146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:06.235143 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.235109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:06.545014 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.544985    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"]
Jul 21 17:06:06.545393 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.545379    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy"
Jul 21 17:06:06.545464 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.545395    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy"
Jul 21 17:06:06.545503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.545470    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy"
Jul 21 17:06:06.545503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.545479    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy"
Jul 21 17:06:06.548796 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.548779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.552449 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.552426    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0f9eb0-openshift-default-dockercfg-5nw9g\""
Jul 21 17:06:06.575979 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.575955    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"]
Jul 21 17:06:06.617457 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.617430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:06.683308 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-envoy\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683459 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-certs\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683459 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683351    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-socket\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683459 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdvl5\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-kube-api-access-fdvl5\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683574 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-token\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683574 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-data\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683574 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80051f7d-1fda-410a-82fe-d4d3678c99f8-istiod-ca-cert\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683670 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-credential-socket\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.683705 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.683679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-podinfo\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784188 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-envoy\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784355 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-certs\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784355 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-socket\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784480 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdvl5\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-kube-api-access-fdvl5\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784480 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-token\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784480 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-data\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784638 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80051f7d-1fda-410a-82fe-d4d3678c99f8-istiod-ca-cert\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784638 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-credential-socket\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784638 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-certs\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784638 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-podinfo\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.784873 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784669    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-socket\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.785015 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.784970    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-data\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.785149 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.785131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-credential-socket\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.785307 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.785285    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80051f7d-1fda-410a-82fe-d4d3678c99f8-istiod-ca-cert\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.786616 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.786594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-envoy\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.787104 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.787088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-podinfo\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.797114 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.797060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdvl5\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-kube-api-access-fdvl5\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.797706 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.797691    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-token\") pod \"e2e-api-b-0f9eb0-openshift-default-567988b689-42n78\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") " pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:06.860015 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:06.859993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:07.011970 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.011945    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"]
Jul 21 17:06:07.014012 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:06:07.013975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80051f7d_1fda_410a_82fe_d4d3678c99f8.slice/crio-d5dd80b0cfab65fc28cc28ebf1bd3f76d4840f8910c70491dc68bed56dc49b34 WatchSource:0}: Error finding container d5dd80b0cfab65fc28cc28ebf1bd3f76d4840f8910c70491dc68bed56dc49b34: Status 404 returned error can't find the container with id d5dd80b0cfab65fc28cc28ebf1bd3f76d4840f8910c70491dc68bed56dc49b34
Jul 21 17:06:07.016455 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.016422    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:07.016559 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.016486    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:07.016559 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.016515    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:07.035303 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.035272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:07.229380 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.229343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" event={"ID":"80051f7d-1fda-410a-82fe-d4d3678c99f8","Type":"ContainerStarted","Data":"86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"}
Jul 21 17:06:07.229555 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.229398    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" event={"ID":"80051f7d-1fda-410a-82fe-d4d3678c99f8","Type":"ContainerStarted","Data":"d5dd80b0cfab65fc28cc28ebf1bd3f76d4840f8910c70491dc68bed56dc49b34"}
Jul 21 17:06:07.254369 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.254325    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podStartSLOduration=1.254311159 podStartE2EDuration="1.254311159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:07.251357384 +0000 UTC m=+2549.068036828" watchObservedRunningTime="2026-07-21 17:06:07.254311159 +0000 UTC m=+2549.070990679"
Jul 21 17:06:07.860703 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:07.860658    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:08.865410 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:08.865371    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:09.240873 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:09.240782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:09.241758 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:09.241739    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:09.287094 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:09.287066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:09.523945 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:09.523850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:09.779670 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:09.779594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:09.983845 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:09.983818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:10.995034 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:10.995005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:11.188257 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:11.188224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:13.737223 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:13.737157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:14.428765 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:14.428727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:16.899067 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:16.897584    2573 patch_prober.go:28] interesting pod/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:33358->10.132.0.68:15021: read: connection reset by peer" start-of-body=
Jul 21 17:06:16.899067 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:16.897656    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:33358->10.132.0.68:15021: read: connection reset by peer"
Jul 21 17:06:17.294812 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:17.294776    2573 generic.go:356] "Generic (PLEG): container finished" podID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerID="68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce" exitCode=0
Jul 21 17:06:17.295013 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:17.294855    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" event={"ID":"b02c1e70-3dbb-4f17-a1be-308f37c08402","Type":"ContainerDied","Data":"68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"}
Jul 21 17:06:17.295299 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:17.295286    2573 scope.go:117] "RemoveContainer" containerID="68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"
Jul 21 17:06:17.296327 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:17.296296    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:17.296421 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:17.296362    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:17.296421 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:17.296394    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:18.303319 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:18.303283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" event={"ID":"b02c1e70-3dbb-4f17-a1be-308f37c08402","Type":"ContainerStarted","Data":"e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509"}
Jul 21 17:06:18.907974 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:18.907940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:18.908166 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:18.908039    2573 patch_prober.go:28] interesting pod/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 17:06:18.908166 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:18.908094    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 17:06:19.907875 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:19.907842    2573 patch_prober.go:28] interesting pod/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 17:06:19.908262 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:19.907914    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 17:06:20.907682 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:20.907642    2573 patch_prober.go:28] interesting pod/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 17:06:20.907857 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:20.907722    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 17:06:21.907941 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.907879    2573 patch_prober.go:28] interesting pod/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 17:06:21.908315 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.907962    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 17:06:21.936181 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.936146    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"]
Jul 21 17:06:21.936826 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.936801    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy"
Jul 21 17:06:21.936826 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.936824    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed42d27-272e-4973-8f23-71a37d824130" containerName="istio-proxy"
Jul 21 17:06:21.941047 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.941027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:21.958327 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.958294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:06:21.958482 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.958378    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:06:21.965877 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:21.964551    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"]
Jul 21 17:06:22.062910 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.062645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff5fe90-b109-4895-9907-22bc6cb12b24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d8794b-25n6b\" (UID: \"3ff5fe90-b109-4895-9907-22bc6cb12b24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:22.163489 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.163391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff5fe90-b109-4895-9907-22bc6cb12b24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d8794b-25n6b\" (UID: \"3ff5fe90-b109-4895-9907-22bc6cb12b24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:22.164039 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.164021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff5fe90-b109-4895-9907-22bc6cb12b24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d8794b-25n6b\" (UID: \"3ff5fe90-b109-4895-9907-22bc6cb12b24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:22.287392 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.287359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:22.648125 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.648095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"]
Jul 21 17:06:22.648860 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:06:22.648833    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff5fe90_b109_4895_9907_22bc6cb12b24.slice/crio-5468f0400c89593da8221bc5d36db3a309f573e32b5f9fafa18749cd359b9bfc WatchSource:0}: Error finding container 5468f0400c89593da8221bc5d36db3a309f573e32b5f9fafa18749cd359b9bfc: Status 404 returned error can't find the container with id 5468f0400c89593da8221bc5d36db3a309f573e32b5f9fafa18749cd359b9bfc
Jul 21 17:06:22.700988 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.700963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:22.809531 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.809493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:22.911377 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.911299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:22.911775 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.911723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:22.912383 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:22.912361    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:23.337256 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:23.337219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b" event={"ID":"3ff5fe90-b109-4895-9907-22bc6cb12b24","Type":"ContainerStarted","Data":"a36fdf895c2a1f14f8fc6463a1990cd26d7dfc66384f5d384703e9fb14114437"}
Jul 21 17:06:23.337422 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:23.337284    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b" event={"ID":"3ff5fe90-b109-4895-9907-22bc6cb12b24","Type":"ContainerStarted","Data":"5468f0400c89593da8221bc5d36db3a309f573e32b5f9fafa18749cd359b9bfc"}
Jul 21 17:06:23.366159 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:23.366091    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b" podStartSLOduration=2.366072634 podStartE2EDuration="2.366072634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:23.363657872 +0000 UTC m=+2565.180337315" watchObservedRunningTime="2026-07-21 17:06:23.366072634 +0000 UTC m=+2565.182752078"
Jul 21 17:06:24.346536 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:24.346501    2573 generic.go:356] "Generic (PLEG): container finished" podID="3ff5fe90-b109-4895-9907-22bc6cb12b24" containerID="a36fdf895c2a1f14f8fc6463a1990cd26d7dfc66384f5d384703e9fb14114437" exitCode=0
Jul 21 17:06:24.346939 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:24.346626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b" event={"ID":"3ff5fe90-b109-4895-9907-22bc6cb12b24","Type":"ContainerDied","Data":"a36fdf895c2a1f14f8fc6463a1990cd26d7dfc66384f5d384703e9fb14114437"}
Jul 21 17:06:25.058704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.057771    2573 patch_prober.go:28] interesting pod/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:51748->10.132.0.69:15021: read: connection reset by peer" start-of-body=
Jul 21 17:06:25.058704 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.057830    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:51748->10.132.0.69:15021: read: connection reset by peer"
Jul 21 17:06:25.353592 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.353531    2573 generic.go:356] "Generic (PLEG): container finished" podID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerID="86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34" exitCode=0
Jul 21 17:06:25.353954 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.353608    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" event={"ID":"80051f7d-1fda-410a-82fe-d4d3678c99f8","Type":"ContainerDied","Data":"86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"}
Jul 21 17:06:25.354266 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.354125    2573 scope.go:117] "RemoveContainer" containerID="86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"
Jul 21 17:06:25.355148 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.355118    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:25.355267 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.355204    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:25.355267 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.355255    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:06:25.522247 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.522220    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:25.599694 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.599660    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff5fe90-b109-4895-9907-22bc6cb12b24-maas-api-service-ca\") pod \"3ff5fe90-b109-4895-9907-22bc6cb12b24\" (UID: \"3ff5fe90-b109-4895-9907-22bc6cb12b24\") "
Jul 21 17:06:25.600013 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.599993    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ff5fe90-b109-4895-9907-22bc6cb12b24-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ff5fe90-b109-4895-9907-22bc6cb12b24" (UID: "3ff5fe90-b109-4895-9907-22bc6cb12b24"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:25.700530 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:25.700445    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff5fe90-b109-4895-9907-22bc6cb12b24-maas-api-service-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:26.360681 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.360644    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"
Jul 21 17:06:26.361154 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.360705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b" event={"ID":"3ff5fe90-b109-4895-9907-22bc6cb12b24","Type":"ContainerDied","Data":"5468f0400c89593da8221bc5d36db3a309f573e32b5f9fafa18749cd359b9bfc"}
Jul 21 17:06:26.361154 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.360754    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5468f0400c89593da8221bc5d36db3a309f573e32b5f9fafa18749cd359b9bfc"
Jul 21 17:06:26.362725 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.362699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" event={"ID":"80051f7d-1fda-410a-82fe-d4d3678c99f8","Type":"ContainerStarted","Data":"c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c"}
Jul 21 17:06:26.860354 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.860322    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:26.860533 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.860500    2573 patch_prober.go:28] interesting pod/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 17:06:26.860583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:26.860547    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 17:06:27.860559 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:27.860524    2573 patch_prober.go:28] interesting pod/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 17:06:27.860969 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:27.860575    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 17:06:28.861176 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:28.861140    2573 patch_prober.go:28] interesting pod/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 17:06:28.861581 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:28.861197    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 17:06:29.861094 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:29.861057    2573 patch_prober.go:28] interesting pod/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 17:06:29.861275 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:29.861113    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 17:06:30.863936 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:30.863904    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:30.864310 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:30.864155    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:30.864790 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:30.864774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:06:32.044951 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:32.044913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:32.149269 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:32.149240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:37.328702 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:37.328669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:42.001182 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:42.001146    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"]
Jul 21 17:06:42.003229 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:42.003198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:42.003754 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:42.003735    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d8794b-25n6b"]
Jul 21 17:06:42.377516 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:42.377477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:42.699078 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:42.698998    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff5fe90-b109-4895-9907-22bc6cb12b24" path="/var/lib/kubelet/pods/3ff5fe90-b109-4895-9907-22bc6cb12b24/volumes"
Jul 21 17:06:46.422512 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:46.422477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:48.462793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:48.462754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:48.567156 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:48.567121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:48.731234 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:48.731150    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"]
Jul 21 17:06:48.731423 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:48.731395    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" containerID="cri-o://e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509" gracePeriod=30
Jul 21 17:06:48.759494 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:48.759467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:48.961668 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:48.961635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:52.914356 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:52.914322    2573 patch_prober.go:28] interesting pod/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 17:06:52.914726 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:52.914394    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:06:53.991194 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:53.991168    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:54.066093 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066071    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-socket\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066218 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066131    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-certs\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066218 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066172    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-data\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066218 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066208    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02c1e70-3dbb-4f17-a1be-308f37c08402-istiod-ca-cert\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066224    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-envoy\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066255    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-podinfo\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066293    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-token\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066313    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:54.066384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066332    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-credential-socket\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066384 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066364    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbw9x\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-kube-api-access-gbw9x\") pod \"b02c1e70-3dbb-4f17-a1be-308f37c08402\" (UID: \"b02c1e70-3dbb-4f17-a1be-308f37c08402\") "
Jul 21 17:06:54.066691 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066429    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:54.066691 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066558    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:54.066691 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066596    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b02c1e70-3dbb-4f17-a1be-308f37c08402-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:54.066837 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066726    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.066837 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066745    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.066837 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066754    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.066837 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.066763    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02c1e70-3dbb-4f17-a1be-308f37c08402-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.067149 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.067121    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-data" (OuterVolumeSpecName: "istio-data") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:54.068607 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.068579    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:06:54.068724 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.068584    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-kube-api-access-gbw9x" (OuterVolumeSpecName: "kube-api-access-gbw9x") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "kube-api-access-gbw9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:54.068931 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.068903    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:54.068931 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.068879    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-token" (OuterVolumeSpecName: "istio-token") pod "b02c1e70-3dbb-4f17-a1be-308f37c08402" (UID: "b02c1e70-3dbb-4f17-a1be-308f37c08402"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:54.167133 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.167114    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.167133 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.167132    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.167254 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.167142    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.167254 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.167151    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.167254 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.167179    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbw9x\" (UniqueName: \"kubernetes.io/projected/b02c1e70-3dbb-4f17-a1be-308f37c08402-kube-api-access-gbw9x\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:06:54.527170 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.527086    2573 generic.go:356] "Generic (PLEG): container finished" podID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerID="e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509" exitCode=0
Jul 21 17:06:54.527170 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.527136    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"
Jul 21 17:06:54.527351 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.527170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" event={"ID":"b02c1e70-3dbb-4f17-a1be-308f37c08402","Type":"ContainerDied","Data":"e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509"}
Jul 21 17:06:54.527351 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.527224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d" event={"ID":"b02c1e70-3dbb-4f17-a1be-308f37c08402","Type":"ContainerDied","Data":"437b7410d3fd192919662e8811474430f56a05f154e29f9305448aeaa9ae1e44"}
Jul 21 17:06:54.527351 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.527248    2573 scope.go:117] "RemoveContainer" containerID="e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509"
Jul 21 17:06:54.536925 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.536908    2573 scope.go:117] "RemoveContainer" containerID="68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"
Jul 21 17:06:54.545406 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.545391    2573 scope.go:117] "RemoveContainer" containerID="e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509"
Jul 21 17:06:54.545642 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:06:54.545626    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509\": container with ID starting with e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509 not found: ID does not exist" containerID="e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509"
Jul 21 17:06:54.545725 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.545656    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509"} err="failed to get container status \"e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509\": rpc error: code = NotFound desc = could not find container \"e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509\": container with ID starting with e0128b09b92ee66b272a63682413384000fb8625976593387dd66c739b513509 not found: ID does not exist"
Jul 21 17:06:54.545725 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.545678    2573 scope.go:117] "RemoveContainer" containerID="68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"
Jul 21 17:06:54.545945 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:06:54.545927    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce\": container with ID starting with 68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce not found: ID does not exist" containerID="68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"
Jul 21 17:06:54.545995 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.545951    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce"} err="failed to get container status \"68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce\": rpc error: code = NotFound desc = could not find container \"68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce\": container with ID starting with 68e2c9e99cb45bdef0e87a49848d03ed6d6bcfe22c5a7a420a4e3444787fe0ce not found: ID does not exist"
Jul 21 17:06:54.561670 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.561647    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"]
Jul 21 17:06:54.565152 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.565131    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d8794b-openshift-default-6cd9745d47-x5b9d"]
Jul 21 17:06:54.698987 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:06:54.698958    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" path="/var/lib/kubelet/pods/b02c1e70-3dbb-4f17-a1be-308f37c08402/volumes"
Jul 21 17:07:04.695540 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:04.695426    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:09.251457 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:09.251420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:09.607713 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:09.607677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:15.829464 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:15.829419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:15.933287 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:15.933249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:16.089848 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:16.089762    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"]
Jul 21 17:07:16.090035 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:16.089978    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy" containerID="cri-o://c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c" gracePeriod=30
Jul 21 17:07:16.129283 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:16.129255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:16.355502 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:16.355419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:16.784317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:16.784289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.098558 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098479    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"]
Jul 21 17:07:17.098934 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098919    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff5fe90-b109-4895-9907-22bc6cb12b24" containerName="revoke-keys"
Jul 21 17:07:17.098934 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098935    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff5fe90-b109-4895-9907-22bc6cb12b24" containerName="revoke-keys"
Jul 21 17:07:17.099023 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098949    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy"
Jul 21 17:07:17.099023 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098955    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy"
Jul 21 17:07:17.099023 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098973    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy"
Jul 21 17:07:17.099023 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.098980    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy"
Jul 21 17:07:17.099148 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.099040    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy"
Jul 21 17:07:17.099148 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.099048    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02c1e70-3dbb-4f17-a1be-308f37c08402" containerName="istio-proxy"
Jul 21 17:07:17.099148 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.099057    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff5fe90-b109-4895-9907-22bc6cb12b24" containerName="revoke-keys"
Jul 21 17:07:17.102142 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.102127    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.108465 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.108436    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ef71cb-openshift-default-dockercfg-pkkq5\""
Jul 21 17:07:17.121522 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.121499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"]
Jul 21 17:07:17.142081 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.142059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.176939 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.176909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-data\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177066 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-token\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2831f91b-5482-4fb2-8a98-a05d284be74c-istiod-ca-cert\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177160 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-certs\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177160 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-socket\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177345 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-credential-socket\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177345 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfs2\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-kube-api-access-mgfs2\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177345 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-podinfo\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.177466 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.177343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-envoy\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278093 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278064    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-token\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278093 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2831f91b-5482-4fb2-8a98-a05d284be74c-istiod-ca-cert\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278287 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-certs\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278287 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-socket\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278368 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-credential-socket\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278414 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfs2\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-kube-api-access-mgfs2\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278480 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-podinfo\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278537 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-envoy\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278537 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-data\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278643 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-socket\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278643 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-certs\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278753 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-credential-socket\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.278935 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-data\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.279052 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.278977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2831f91b-5482-4fb2-8a98-a05d284be74c-istiod-ca-cert\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.280646 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.280625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-envoy\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.280901 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.280868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-podinfo\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.287854 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.287832    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-token\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.288383 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.288361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfs2\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-kube-api-access-mgfs2\") pod \"e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") " pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.414594 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.414483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:17.471455 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.471417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.559240 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.559213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"]
Jul 21 17:07:17.560135 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:07:17.560106    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2831f91b_5482_4fb2_8a98_a05d284be74c.slice/crio-b21e8db08d2aedd3ad16267add3099f595ea1a13b430aa0c001bff22c324b9cb WatchSource:0}: Error finding container b21e8db08d2aedd3ad16267add3099f595ea1a13b430aa0c001bff22c324b9cb: Status 404 returned error can't find the container with id b21e8db08d2aedd3ad16267add3099f595ea1a13b430aa0c001bff22c324b9cb
Jul 21 17:07:17.562259 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.562224    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:17.562361 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.562291    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:17.562361 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.562317    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:17.665138 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.665067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" event={"ID":"2831f91b-5482-4fb2-8a98-a05d284be74c","Type":"ContainerStarted","Data":"a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"}
Jul 21 17:07:17.665138 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.665120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" event={"ID":"2831f91b-5482-4fb2-8a98-a05d284be74c","Type":"ContainerStarted","Data":"b21e8db08d2aedd3ad16267add3099f595ea1a13b430aa0c001bff22c324b9cb"}
Jul 21 17:07:17.694755 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:17.694702    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" podStartSLOduration=0.694682536 podStartE2EDuration="694.682536ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:17.692515498 +0000 UTC m=+2619.509194944" watchObservedRunningTime="2026-07-21 17:07:17.694682536 +0000 UTC m=+2619.511361982"
Jul 21 17:07:18.414944 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:18.414918    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:18.420052 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:18.420027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:18.671374 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:18.671296    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:18.672276 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:18.672256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:19.661652 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:19.661610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:19.772645 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:19.772619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:19.878983 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:19.878927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:20.411712 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:20.411682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:20.515394 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:20.515365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:21.347425 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.347400    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:07:21.419443 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-certs\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419447    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdvl5\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-kube-api-access-fdvl5\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419480    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-socket\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419502    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-data\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-credential-socket\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419581    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80051f7d-1fda-410a-82fe-d4d3678c99f8-istiod-ca-cert\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419624    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-envoy\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419654    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-podinfo\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419683    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-token\") pod \"80051f7d-1fda-410a-82fe-d4d3678c99f8\" (UID: \"80051f7d-1fda-410a-82fe-d4d3678c99f8\") "
Jul 21 17:07:21.419793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419618    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:21.419793 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419728    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:21.420120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419875    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:21.420120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.419947    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80051f7d-1fda-410a-82fe-d4d3678c99f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:07:21.420120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.420099    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.420120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.420111    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.420120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.420120    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.420317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.420133    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80051f7d-1fda-410a-82fe-d4d3678c99f8-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.420567 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.420541    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:21.421742 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.421719    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-kube-api-access-fdvl5" (OuterVolumeSpecName: "kube-api-access-fdvl5") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "kube-api-access-fdvl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:07:21.421949 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.421924    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:07:21.422239 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.422219    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:21.422309 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.422233    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "80051f7d-1fda-410a-82fe-d4d3678c99f8" (UID: "80051f7d-1fda-410a-82fe-d4d3678c99f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:07:21.521600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.521567    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdvl5\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-kube-api-access-fdvl5\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.521600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.521597    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.521600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.521607    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.521826 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.521615    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.521826 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.521623    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80051f7d-1fda-410a-82fe-d4d3678c99f8-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:07:21.689590 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.689505    2573 generic.go:356] "Generic (PLEG): container finished" podID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerID="c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c" exitCode=0
Jul 21 17:07:21.689590 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.689557    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"
Jul 21 17:07:21.689849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.689595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" event={"ID":"80051f7d-1fda-410a-82fe-d4d3678c99f8","Type":"ContainerDied","Data":"c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c"}
Jul 21 17:07:21.689849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.689663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78" event={"ID":"80051f7d-1fda-410a-82fe-d4d3678c99f8","Type":"ContainerDied","Data":"d5dd80b0cfab65fc28cc28ebf1bd3f76d4840f8910c70491dc68bed56dc49b34"}
Jul 21 17:07:21.689849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.689692    2573 scope.go:117] "RemoveContainer" containerID="c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c"
Jul 21 17:07:21.699346 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.699334    2573 scope.go:117] "RemoveContainer" containerID="86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"
Jul 21 17:07:21.707607 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.707591    2573 scope.go:117] "RemoveContainer" containerID="c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c"
Jul 21 17:07:21.707836 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:07:21.707817    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c\": container with ID starting with c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c not found: ID does not exist" containerID="c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c"
Jul 21 17:07:21.707927 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.707843    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c"} err="failed to get container status \"c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c\": rpc error: code = NotFound desc = could not find container \"c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c\": container with ID starting with c3c19810b344b97949689c677dfc8dcfb2583c375246c685b03aaf61278d179c not found: ID does not exist"
Jul 21 17:07:21.707927 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.707860    2573 scope.go:117] "RemoveContainer" containerID="86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"
Jul 21 17:07:21.708125 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:07:21.708107    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34\": container with ID starting with 86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34 not found: ID does not exist" containerID="86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"
Jul 21 17:07:21.708183 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.708132    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34"} err="failed to get container status \"86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34\": rpc error: code = NotFound desc = could not find container \"86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34\": container with ID starting with 86c2f8eef88a88d735d36008d99ad6ff38523a4070a7be34a81190b44f9cbd34 not found: ID does not exist"
Jul 21 17:07:21.747106 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.747082    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"]
Jul 21 17:07:21.751202 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:21.751181    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0f9eb0-openshift-default-567988b689-42n78"]
Jul 21 17:07:22.699335 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:22.699303    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" path="/var/lib/kubelet/pods/80051f7d-1fda-410a-82fe-d4d3678c99f8/volumes"
Jul 21 17:07:24.269734 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.269699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:24.569768 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.569737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:24.890541 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.890464    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"]
Jul 21 17:07:24.891051 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.891035    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy"
Jul 21 17:07:24.891116 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.891054    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy"
Jul 21 17:07:24.891172 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.891161    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy"
Jul 21 17:07:24.896054 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.896033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.900512 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.900483    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b04ffb-openshift-default-dockercfg-kc6sd\""
Jul 21 17:07:24.918389 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.918366    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"]
Jul 21 17:07:24.937656 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.937622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:24.952152 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-envoy\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952257 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f20fb977-5a32-424c-8121-5ef255a64910-istio-podinfo\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952303 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-credential-socket\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952340 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-data\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952408 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m66w\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-kube-api-access-2m66w\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952454 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-socket\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952487 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-certs\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952525 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f20fb977-5a32-424c-8121-5ef255a64910-istiod-ca-cert\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:24.952525 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:24.952518    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-istio-token\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053237 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m66w\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-kube-api-access-2m66w\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-socket\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-certs\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f20fb977-5a32-424c-8121-5ef255a64910-istiod-ca-cert\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053337    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-istio-token\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-envoy\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f20fb977-5a32-424c-8121-5ef255a64910-istio-podinfo\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-socket\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-credential-socket\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-certs\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.053909 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.053806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-data\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.054318 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.054102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-data\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.054318 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.054104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f20fb977-5a32-424c-8121-5ef255a64910-istiod-ca-cert\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.054490 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.054457    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-credential-socket\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.056239 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.056217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f20fb977-5a32-424c-8121-5ef255a64910-istio-podinfo\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.056459 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.056441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-envoy\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.064785 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.064762    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-istio-token\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.065078 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.065052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m66w\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-kube-api-access-2m66w\") pod \"e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") " pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.207083 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.206999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:25.413531 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.413508    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"]
Jul 21 17:07:25.415683 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:07:25.415659    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20fb977_5a32_424c_8121_5ef255a64910.slice/crio-30a0308e9d0020223d7f3ed9b9e4e359f1716c68eb38b5cad91dd163b1c40ff9 WatchSource:0}: Error finding container 30a0308e9d0020223d7f3ed9b9e4e359f1716c68eb38b5cad91dd163b1c40ff9: Status 404 returned error can't find the container with id 30a0308e9d0020223d7f3ed9b9e4e359f1716c68eb38b5cad91dd163b1c40ff9
Jul 21 17:07:25.417873 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.417839    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:25.417965 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.417934    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:25.418006 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.417971    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:25.452232 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.452201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:25.717604 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.717515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" event={"ID":"f20fb977-5a32-424c-8121-5ef255a64910","Type":"ContainerStarted","Data":"82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"}
Jul 21 17:07:25.717604 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.717565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" event={"ID":"f20fb977-5a32-424c-8121-5ef255a64910","Type":"ContainerStarted","Data":"30a0308e9d0020223d7f3ed9b9e4e359f1716c68eb38b5cad91dd163b1c40ff9"}
Jul 21 17:07:25.748712 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:25.748650    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podStartSLOduration=1.748629132 podStartE2EDuration="1.748629132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:25.743366491 +0000 UTC m=+2627.560045935" watchObservedRunningTime="2026-07-21 17:07:25.748629132 +0000 UTC m=+2627.565308578"
Jul 21 17:07:26.208231 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:26.208197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:26.213188 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:26.213157    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:26.725140 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:26.725113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:26.727511 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:26.727482    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:27.922618 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:27.922549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:28.200621 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:28.200488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:28.386695 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:28.386660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:28.535420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:28.535386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:29.122113 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:29.122073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:29.217981 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:29.217949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:32.002776 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.002751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:32.104205 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.104181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:32.204755 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.204728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:32.772761 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.772722    2573 generic.go:356] "Generic (PLEG): container finished" podID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerID="a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1" exitCode=0
Jul 21 17:07:32.772977 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.772784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" event={"ID":"2831f91b-5482-4fb2-8a98-a05d284be74c","Type":"ContainerDied","Data":"a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"}
Jul 21 17:07:32.773214 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.773197    2573 scope.go:117] "RemoveContainer" containerID="a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"
Jul 21 17:07:32.774202 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.774171    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:32.774313 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.774256    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:32.774313 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:32.774302    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:33.671661 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:33.671625    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:33.780215 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:33.780177    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" event={"ID":"2831f91b-5482-4fb2-8a98-a05d284be74c","Type":"ContainerStarted","Data":"2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3"}
Jul 21 17:07:34.415506 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:34.415471    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:34.416750 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:34.416729    2573 patch_prober.go:28] interesting pod/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 17:07:34.416820 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:34.416777    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 17:07:35.415467 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:35.415432    2573 patch_prober.go:28] interesting pod/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 17:07:35.415981 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:35.415502    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 17:07:36.414941 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:36.414904    2573 patch_prober.go:28] interesting pod/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 17:07:36.415141 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:36.414970    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 17:07:37.415062 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:37.415025    2573 patch_prober.go:28] interesting pod/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 17:07:37.415473 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:37.415082    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 17:07:38.418993 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:38.418958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:38.419400 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:38.419238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:38.420120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:38.420101    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:07:41.286027 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.285992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:41.387073 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.386998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:41.726814 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.726730    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 17:07:41.726814 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.726792    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 17:07:41.836114 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.836086    2573 generic.go:356] "Generic (PLEG): container finished" podID="f20fb977-5a32-424c-8121-5ef255a64910" containerID="82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31" exitCode=0
Jul 21 17:07:41.836294 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.836175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" event={"ID":"f20fb977-5a32-424c-8121-5ef255a64910","Type":"ContainerDied","Data":"82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"}
Jul 21 17:07:41.836625 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.836609    2573 scope.go:117] "RemoveContainer" containerID="82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"
Jul 21 17:07:41.837661 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.837632    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:41.837718 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.837707    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:41.837756 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:41.837743    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:07:42.847423 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:42.847390    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" event={"ID":"f20fb977-5a32-424c-8121-5ef255a64910","Type":"ContainerStarted","Data":"6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381"}
Jul 21 17:07:43.208191 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:43.208100    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:43.208366 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:43.208259    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 17:07:43.208366 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:43.208324    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 17:07:44.207743 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:44.207706    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 17:07:44.208168 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:44.207786    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 17:07:45.208269 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:45.208235    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 17:07:45.208669 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:45.208289    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 17:07:46.207285 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:46.207251    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 17:07:46.207458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:46.207304    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 17:07:47.211720 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:47.211690    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:47.212155 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:47.212135    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:47.212699 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:47.212685    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:07:48.492198 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.492168    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"]
Jul 21 17:07:48.492810 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.492789    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy"
Jul 21 17:07:48.492855 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.492814    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy"
Jul 21 17:07:48.492971 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.492959    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="80051f7d-1fda-410a-82fe-d4d3678c99f8" containerName="istio-proxy"
Jul 21 17:07:48.496088 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.496070    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.500641 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.500506    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"openshift-service-ca.crt\""
Jul 21 17:07:48.500641 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.500520    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"kube-root-ca.crt\""
Jul 21 17:07:48.500641 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.500560    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"auth-test-model-ef71cb-kserve-self-signed-certs\""
Jul 21 17:07:48.501493 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.501468    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"default-dockercfg-fgdcv\""
Jul 21 17:07:48.504783 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.504736    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"]
Jul 21 17:07:48.509199 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.509178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:48.591938 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.591878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-dshm\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.592042 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.591979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-home\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.592042 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.591999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-model-cache\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.592160 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.592051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27wfg\" (UniqueName: \"kubernetes.io/projected/c78b4861-ee98-4135-8b55-666bfbd12bd2-kube-api-access-27wfg\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.592160 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.592084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78b4861-ee98-4135-8b55-666bfbd12bd2-tls-certs\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.592160 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.592109    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-tmp-dir\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.693680 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.693644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-home\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.693923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.693687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-model-cache\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.693923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.693729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27wfg\" (UniqueName: \"kubernetes.io/projected/c78b4861-ee98-4135-8b55-666bfbd12bd2-kube-api-access-27wfg\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.693923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.693770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78b4861-ee98-4135-8b55-666bfbd12bd2-tls-certs\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.693923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.693804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-tmp-dir\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.693923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.693909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-dshm\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.694213 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.694100    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-model-cache\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.694213 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.694120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-home\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.694321 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.694226    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-tmp-dir\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.696245 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.696220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-dshm\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.696404 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.696384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78b4861-ee98-4135-8b55-666bfbd12bd2-tls-certs\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.702317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.702294    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wfg\" (UniqueName: \"kubernetes.io/projected/c78b4861-ee98-4135-8b55-666bfbd12bd2-kube-api-access-27wfg\") pod \"auth-test-model-ef71cb-kserve-698f95f79f-2tk2k\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") " pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.807252 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.807227    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:48.944119 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:48.944090    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"]
Jul 21 17:07:48.945663 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:07:48.945638    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc78b4861_ee98_4135_8b55_666bfbd12bd2.slice/crio-81b7cce5e1cf32c4e2d536e331c5d846f8679e7b539cd439fa0588f4ec0561b7 WatchSource:0}: Error finding container 81b7cce5e1cf32c4e2d536e331c5d846f8679e7b539cd439fa0588f4ec0561b7: Status 404 returned error can't find the container with id 81b7cce5e1cf32c4e2d536e331c5d846f8679e7b539cd439fa0588f4ec0561b7
Jul 21 17:07:49.890568 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:49.890531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k" event={"ID":"c78b4861-ee98-4135-8b55-666bfbd12bd2","Type":"ContainerStarted","Data":"563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf"}
Jul 21 17:07:49.890984 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:49.890579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k" event={"ID":"c78b4861-ee98-4135-8b55-666bfbd12bd2","Type":"ContainerStarted","Data":"81b7cce5e1cf32c4e2d536e331c5d846f8679e7b539cd439fa0588f4ec0561b7"}
Jul 21 17:07:49.907878 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:49.907826    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k" podStartSLOduration=1.9078124029999999 podStartE2EDuration="1.907812403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:49.907632846 +0000 UTC m=+2651.724312290" watchObservedRunningTime="2026-07-21 17:07:49.907812403 +0000 UTC m=+2651.724491845"
Jul 21 17:07:49.911523 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:49.911497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:50.013077 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:50.013036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:58.807626 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:58.807592    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:58.808105 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:58.807637    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:58.820074 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:58.820050    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:07:58.950982 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:07:58.950952    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:08:38.903243 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:08:38.903158    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:08:38.909832 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:08:38.909794    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:08:42.546648 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:08:42.546611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:41.918856 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:09:41.918814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:42.019646 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:09:42.019612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:43.504943 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:09:43.504912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:43.619099 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:09:43.619073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:37.465896 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:37.465849    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"]
Jul 21 17:10:37.542548 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:37.542507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:39.147600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:39.147565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:49.848870 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:49.848834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:52.485949 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.485903    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k" podUID="c78b4861-ee98-4135-8b55-666bfbd12bd2" containerName="main" containerID="cri-o://563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf" gracePeriod=45
Jul 21 17:10:52.746009 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.745948    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:10:52.923160 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923133    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-dshm\") pod \"c78b4861-ee98-4135-8b55-666bfbd12bd2\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") "
Jul 21 17:10:52.923303 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923186    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-model-cache\") pod \"c78b4861-ee98-4135-8b55-666bfbd12bd2\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") "
Jul 21 17:10:52.923357 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923310    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78b4861-ee98-4135-8b55-666bfbd12bd2-tls-certs\") pod \"c78b4861-ee98-4135-8b55-666bfbd12bd2\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") "
Jul 21 17:10:52.923404 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27wfg\" (UniqueName: \"kubernetes.io/projected/c78b4861-ee98-4135-8b55-666bfbd12bd2-kube-api-access-27wfg\") pod \"c78b4861-ee98-4135-8b55-666bfbd12bd2\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") "
Jul 21 17:10:52.923404 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-home\") pod \"c78b4861-ee98-4135-8b55-666bfbd12bd2\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") "
Jul 21 17:10:52.923520 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923403    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-tmp-dir\") pod \"c78b4861-ee98-4135-8b55-666bfbd12bd2\" (UID: \"c78b4861-ee98-4135-8b55-666bfbd12bd2\") "
Jul 21 17:10:52.923520 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923498    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-model-cache" (OuterVolumeSpecName: "model-cache") pod "c78b4861-ee98-4135-8b55-666bfbd12bd2" (UID: "c78b4861-ee98-4135-8b55-666bfbd12bd2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:52.923743 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923712    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-home" (OuterVolumeSpecName: "home") pod "c78b4861-ee98-4135-8b55-666bfbd12bd2" (UID: "c78b4861-ee98-4135-8b55-666bfbd12bd2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:52.923743 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923725    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c78b4861-ee98-4135-8b55-666bfbd12bd2" (UID: "c78b4861-ee98-4135-8b55-666bfbd12bd2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:52.923929 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923802    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-home\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:10:52.923929 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923831    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-tmp-dir\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:10:52.923929 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.923847    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-model-cache\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:10:52.925650 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.925625    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-dshm" (OuterVolumeSpecName: "dshm") pod "c78b4861-ee98-4135-8b55-666bfbd12bd2" (UID: "c78b4861-ee98-4135-8b55-666bfbd12bd2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:52.925756 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.925671    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78b4861-ee98-4135-8b55-666bfbd12bd2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c78b4861-ee98-4135-8b55-666bfbd12bd2" (UID: "c78b4861-ee98-4135-8b55-666bfbd12bd2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:52.925809 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.925778    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78b4861-ee98-4135-8b55-666bfbd12bd2-kube-api-access-27wfg" (OuterVolumeSpecName: "kube-api-access-27wfg") pod "c78b4861-ee98-4135-8b55-666bfbd12bd2" (UID: "c78b4861-ee98-4135-8b55-666bfbd12bd2"). InnerVolumeSpecName "kube-api-access-27wfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:52.931233 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.931208    2573 generic.go:356] "Generic (PLEG): container finished" podID="c78b4861-ee98-4135-8b55-666bfbd12bd2" containerID="563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf" exitCode=0
Jul 21 17:10:52.931333 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.931243    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"
Jul 21 17:10:52.931333 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.931266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k" event={"ID":"c78b4861-ee98-4135-8b55-666bfbd12bd2","Type":"ContainerDied","Data":"563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf"}
Jul 21 17:10:52.931333 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.931304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k" event={"ID":"c78b4861-ee98-4135-8b55-666bfbd12bd2","Type":"ContainerDied","Data":"81b7cce5e1cf32c4e2d536e331c5d846f8679e7b539cd439fa0588f4ec0561b7"}
Jul 21 17:10:52.931333 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.931325    2573 scope.go:117] "RemoveContainer" containerID="563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf"
Jul 21 17:10:52.947712 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.947694    2573 scope.go:117] "RemoveContainer" containerID="563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf"
Jul 21 17:10:52.947983 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:10:52.947967    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf\": container with ID starting with 563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf not found: ID does not exist" containerID="563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf"
Jul 21 17:10:52.948042 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.947991    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf"} err="failed to get container status \"563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf\": rpc error: code = NotFound desc = could not find container \"563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf\": container with ID starting with 563451d334cb4e173b76c654c87ec36f6b053dde9c7ddca79947ae543cb79fcf not found: ID does not exist"
Jul 21 17:10:52.960970 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.960943    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"]
Jul 21 17:10:52.963419 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:52.963396    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/auth-test-model-ef71cb-kserve-698f95f79f-2tk2k"]
Jul 21 17:10:53.024990 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:53.024939    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c78b4861-ee98-4135-8b55-666bfbd12bd2-dshm\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.024990 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:53.024962    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c78b4861-ee98-4135-8b55-666bfbd12bd2-tls-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.024990 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:53.024972    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27wfg\" (UniqueName: \"kubernetes.io/projected/c78b4861-ee98-4135-8b55-666bfbd12bd2-kube-api-access-27wfg\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:10:54.700281 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:10:54.700244    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78b4861-ee98-4135-8b55-666bfbd12bd2" path="/var/lib/kubelet/pods/c78b4861-ee98-4135-8b55-666bfbd12bd2/volumes"
Jul 21 17:11:21.362652 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.362615    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"]
Jul 21 17:11:21.363157 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.363065    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78b4861-ee98-4135-8b55-666bfbd12bd2" containerName="main"
Jul 21 17:11:21.363157 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.363079    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78b4861-ee98-4135-8b55-666bfbd12bd2" containerName="main"
Jul 21 17:11:21.363236 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.363172    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78b4861-ee98-4135-8b55-666bfbd12bd2" containerName="main"
Jul 21 17:11:21.366353 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.366326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.376130 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.376102    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"default-dockercfg-784cf\""
Jul 21 17:11:21.376130 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.376111    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"kube-root-ca.crt\""
Jul 21 17:11:21.376286 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.376110    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"openshift-service-ca.crt\""
Jul 21 17:11:21.376286 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.376171    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"sub-test-model-b04ffb-kserve-self-signed-certs\""
Jul 21 17:11:21.385944 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.385924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"]
Jul 21 17:11:21.407505 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.407478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:21.464989 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.464964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-home\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.465128 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.465001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99lr4\" (UniqueName: \"kubernetes.io/projected/ac528c16-7413-4a7e-b993-0a2f460a8e3a-kube-api-access-99lr4\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.465128 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.465075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-model-cache\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.465128 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.465123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tmp-dir\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.465259 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.465161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tls-certs\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.465259 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.465208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-dshm\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566290 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tls-certs\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566486 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-dshm\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566486 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-home\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566486 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99lr4\" (UniqueName: \"kubernetes.io/projected/ac528c16-7413-4a7e-b993-0a2f460a8e3a-kube-api-access-99lr4\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566486 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-model-cache\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566486 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tmp-dir\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566828 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tmp-dir\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566922 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566877    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-home\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.566967 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.566872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-model-cache\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.568725 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.568698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-dshm\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.568973 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.568954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tls-certs\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.577025 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.576998    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99lr4\" (UniqueName: \"kubernetes.io/projected/ac528c16-7413-4a7e-b993-0a2f460a8e3a-kube-api-access-99lr4\") pod \"sub-test-model-b04ffb-kserve-77546d99f9-5rs9w\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") " pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.675185 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.675098    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:21.817538 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:21.817504    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"]
Jul 21 17:11:21.818240 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:11:21.818214    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac528c16_7413_4a7e_b993_0a2f460a8e3a.slice/crio-9ab199d0a66fc251efebc9e0f214e380f0418b5dd263fac9d37b3ab1abd3f6f5 WatchSource:0}: Error finding container 9ab199d0a66fc251efebc9e0f214e380f0418b5dd263fac9d37b3ab1abd3f6f5: Status 404 returned error can't find the container with id 9ab199d0a66fc251efebc9e0f214e380f0418b5dd263fac9d37b3ab1abd3f6f5
Jul 21 17:11:22.106052 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:22.106017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w" event={"ID":"ac528c16-7413-4a7e-b993-0a2f460a8e3a","Type":"ContainerStarted","Data":"764fb14bb668695dde10854e2b122eddb7052ab2012a8f9cdb79fc70f4296e77"}
Jul 21 17:11:22.106204 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:22.106061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w" event={"ID":"ac528c16-7413-4a7e-b993-0a2f460a8e3a","Type":"ContainerStarted","Data":"9ab199d0a66fc251efebc9e0f214e380f0418b5dd263fac9d37b3ab1abd3f6f5"}
Jul 21 17:11:22.129870 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:22.129819    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w" podStartSLOduration=1.129805299 podStartE2EDuration="1.129805299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:22.12849328 +0000 UTC m=+2863.945172716" watchObservedRunningTime="2026-07-21 17:11:22.129805299 +0000 UTC m=+2863.946484741"
Jul 21 17:11:29.636908 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:29.636859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:29.739138 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:29.739111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:31.675544 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:31.675463    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:31.675544 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:31.675506    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:31.687979 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:31.687954    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:32.182513 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:32.182481    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:11:59.318841 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:11:59.318805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:07.458901 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:07.458856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:08.314107 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:08.314078    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"]
Jul 21 17:12:08.336985 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:08.336957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:20.631451 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:20.631418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:23.334354 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.334315    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w" podUID="ac528c16-7413-4a7e-b993-0a2f460a8e3a" containerName="main" containerID="cri-o://764fb14bb668695dde10854e2b122eddb7052ab2012a8f9cdb79fc70f4296e77" gracePeriod=45
Jul 21 17:12:23.469619 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.469590    2573 generic.go:356] "Generic (PLEG): container finished" podID="ac528c16-7413-4a7e-b993-0a2f460a8e3a" containerID="764fb14bb668695dde10854e2b122eddb7052ab2012a8f9cdb79fc70f4296e77" exitCode=0
Jul 21 17:12:23.469744 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.469664    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w" event={"ID":"ac528c16-7413-4a7e-b993-0a2f460a8e3a","Type":"ContainerDied","Data":"764fb14bb668695dde10854e2b122eddb7052ab2012a8f9cdb79fc70f4296e77"}
Jul 21 17:12:23.597337 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.597283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:12:23.694923 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.694867    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99lr4\" (UniqueName: \"kubernetes.io/projected/ac528c16-7413-4a7e-b993-0a2f460a8e3a-kube-api-access-99lr4\") pod \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") "
Jul 21 17:12:23.695100 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.694960    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-home\") pod \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") "
Jul 21 17:12:23.695100 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695055    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-model-cache\") pod \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") "
Jul 21 17:12:23.695100 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695085    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-dshm\") pod \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") "
Jul 21 17:12:23.695281 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695131    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tls-certs\") pod \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") "
Jul 21 17:12:23.695281 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695200    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tmp-dir\") pod \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\" (UID: \"ac528c16-7413-4a7e-b993-0a2f460a8e3a\") "
Jul 21 17:12:23.695281 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695200    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-home" (OuterVolumeSpecName: "home") pod "ac528c16-7413-4a7e-b993-0a2f460a8e3a" (UID: "ac528c16-7413-4a7e-b993-0a2f460a8e3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:23.695281 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac528c16-7413-4a7e-b993-0a2f460a8e3a" (UID: "ac528c16-7413-4a7e-b993-0a2f460a8e3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:23.695556 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695521    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac528c16-7413-4a7e-b993-0a2f460a8e3a" (UID: "ac528c16-7413-4a7e-b993-0a2f460a8e3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:23.695684 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695591    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-home\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:12:23.695684 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.695606    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-model-cache\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:12:23.697524 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.697500    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac528c16-7413-4a7e-b993-0a2f460a8e3a-kube-api-access-99lr4" (OuterVolumeSpecName: "kube-api-access-99lr4") pod "ac528c16-7413-4a7e-b993-0a2f460a8e3a" (UID: "ac528c16-7413-4a7e-b993-0a2f460a8e3a"). InnerVolumeSpecName "kube-api-access-99lr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:12:23.697673 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.697652    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-dshm" (OuterVolumeSpecName: "dshm") pod "ac528c16-7413-4a7e-b993-0a2f460a8e3a" (UID: "ac528c16-7413-4a7e-b993-0a2f460a8e3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:23.697731 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.697676    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac528c16-7413-4a7e-b993-0a2f460a8e3a" (UID: "ac528c16-7413-4a7e-b993-0a2f460a8e3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:12:23.796323 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.796288    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99lr4\" (UniqueName: \"kubernetes.io/projected/ac528c16-7413-4a7e-b993-0a2f460a8e3a-kube-api-access-99lr4\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:12:23.796323 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.796317    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-dshm\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:12:23.796323 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.796328    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tls-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:12:23.796555 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:23.796338    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac528c16-7413-4a7e-b993-0a2f460a8e3a-tmp-dir\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:12:24.477077 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:24.477046    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"
Jul 21 17:12:24.477491 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:24.477089    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w" event={"ID":"ac528c16-7413-4a7e-b993-0a2f460a8e3a","Type":"ContainerDied","Data":"9ab199d0a66fc251efebc9e0f214e380f0418b5dd263fac9d37b3ab1abd3f6f5"}
Jul 21 17:12:24.477491 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:24.477140    2573 scope.go:117] "RemoveContainer" containerID="764fb14bb668695dde10854e2b122eddb7052ab2012a8f9cdb79fc70f4296e77"
Jul 21 17:12:24.499514 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:24.499492    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"]
Jul 21 17:12:24.504273 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:24.504253    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/sub-test-model-b04ffb-kserve-77546d99f9-5rs9w"]
Jul 21 17:12:24.699792 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:24.699759    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac528c16-7413-4a7e-b993-0a2f460a8e3a" path="/var/lib/kubelet/pods/ac528c16-7413-4a7e-b993-0a2f460a8e3a/volumes"
Jul 21 17:12:32.790549 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:32.790520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:32.889327 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:32.889294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:39.101718 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:39.101686    2573 scope.go:117] "RemoveContainer" containerID="a36fdf895c2a1f14f8fc6463a1990cd26d7dfc66384f5d384703e9fb14114437"
Jul 21 17:12:42.098772 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:42.098742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:42.198344 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:42.198312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:48.699713 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.699685    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"]
Jul 21 17:12:48.700132 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.700116    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac528c16-7413-4a7e-b993-0a2f460a8e3a" containerName="main"
Jul 21 17:12:48.700176 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.700134    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac528c16-7413-4a7e-b993-0a2f460a8e3a" containerName="main"
Jul 21 17:12:48.700232 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.700224    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac528c16-7413-4a7e-b993-0a2f460a8e3a" containerName="main"
Jul 21 17:12:48.703263 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.703245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.707408 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.707386    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"openshift-service-ca.crt\""
Jul 21 17:12:48.707520 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.707447    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"kube-root-ca.crt\""
Jul 21 17:12:48.707520 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.707448    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"default-dockercfg-784cf\""
Jul 21 17:12:48.707520 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.707488    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"rate-test-model-b04ffb-kserve-self-signed-certs\""
Jul 21 17:12:48.713595 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.713573    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"]
Jul 21 17:12:48.724514 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.724479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:48.802143 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.802111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxbj\" (UniqueName: \"kubernetes.io/projected/af498c96-c755-4e48-819c-37e4cfc5a61e-kube-api-access-qfxbj\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.802274 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.802159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-dshm\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.802274 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.802180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-model-cache\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.802274 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.802254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-tmp-dir\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.802382 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.802311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af498c96-c755-4e48-819c-37e4cfc5a61e-tls-certs\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.802382 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.802340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-home\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.903590 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.903561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-tmp-dir\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.903773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.903624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af498c96-c755-4e48-819c-37e4cfc5a61e-tls-certs\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.903773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.903651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-home\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.903773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.903683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxbj\" (UniqueName: \"kubernetes.io/projected/af498c96-c755-4e48-819c-37e4cfc5a61e-kube-api-access-qfxbj\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.903773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.903701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-dshm\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.903773 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.903719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-model-cache\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.904143 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.904052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-tmp-dir\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.904186 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.904172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-home\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.904456 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.904431    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-model-cache\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.906356 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.906334    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af498c96-c755-4e48-819c-37e4cfc5a61e-tls-certs\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.906485 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.906465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-dshm\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:48.913581 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:48.913522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxbj\" (UniqueName: \"kubernetes.io/projected/af498c96-c755-4e48-819c-37e4cfc5a61e-kube-api-access-qfxbj\") pod \"rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") " pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:49.014051 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:49.013974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:49.152034 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:49.152005    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"]
Jul 21 17:12:49.153040 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:12:49.153019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf498c96_c755_4e48_819c_37e4cfc5a61e.slice/crio-8a1615995e183dee8ee51c03905b71649ed8a16d3b7128eadf5971655d4b0ebe WatchSource:0}: Error finding container 8a1615995e183dee8ee51c03905b71649ed8a16d3b7128eadf5971655d4b0ebe: Status 404 returned error can't find the container with id 8a1615995e183dee8ee51c03905b71649ed8a16d3b7128eadf5971655d4b0ebe
Jul 21 17:12:49.631337 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:49.631300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w" event={"ID":"af498c96-c755-4e48-819c-37e4cfc5a61e","Type":"ContainerStarted","Data":"a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df"}
Jul 21 17:12:49.631582 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:49.631347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w" event={"ID":"af498c96-c755-4e48-819c-37e4cfc5a61e","Type":"ContainerStarted","Data":"8a1615995e183dee8ee51c03905b71649ed8a16d3b7128eadf5971655d4b0ebe"}
Jul 21 17:12:49.652099 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:49.652056    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w" podStartSLOduration=1.652042975 podStartE2EDuration="1.652042975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:49.650498988 +0000 UTC m=+2951.467178444" watchObservedRunningTime="2026-07-21 17:12:49.652042975 +0000 UTC m=+2951.468722417"
Jul 21 17:12:50.801006 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:50.800971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:50.902058 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:50.902031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:59.015073 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:59.015033    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:59.015073 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:59.015079    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:59.027713 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:59.027682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:12:59.700198 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:12:59.700171    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:13:11.459569 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:11.459489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:29.448213 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:29.448184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:30.401132 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:30.401096    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"]
Jul 21 17:13:30.430362 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:30.430324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:31.326096 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.326064    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7715-140054353101360"]
Jul 21 17:13:31.329600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.329585    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:31.332600 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.332580    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x2hln\""
Jul 21 17:13:31.336571 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.336496    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353101360"]
Jul 21 17:13:31.390627 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.390603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js9zb\" (UniqueName: \"kubernetes.io/projected/ca6d4628-2e87-4099-96bb-26e4aaee409c-kube-api-access-js9zb\") pod \"test-curl-7715-140054353101360\" (UID: \"ca6d4628-2e87-4099-96bb-26e4aaee409c\") " pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:31.491659 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.491628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js9zb\" (UniqueName: \"kubernetes.io/projected/ca6d4628-2e87-4099-96bb-26e4aaee409c-kube-api-access-js9zb\") pod \"test-curl-7715-140054353101360\" (UID: \"ca6d4628-2e87-4099-96bb-26e4aaee409c\") " pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:31.501954 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.501925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js9zb\" (UniqueName: \"kubernetes.io/projected/ca6d4628-2e87-4099-96bb-26e4aaee409c-kube-api-access-js9zb\") pod \"test-curl-7715-140054353101360\" (UID: \"ca6d4628-2e87-4099-96bb-26e4aaee409c\") " pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:31.641192 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.641132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:31.780713 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.780688    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353101360"]
Jul 21 17:13:31.782527 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:13:31.782499    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca6d4628_2e87_4099_96bb_26e4aaee409c.slice/crio-6a65275772bfecd2057018dd45784fabf4d3126f9446f84a09d009f15cc538e4 WatchSource:0}: Error finding container 6a65275772bfecd2057018dd45784fabf4d3126f9446f84a09d009f15cc538e4: Status 404 returned error can't find the container with id 6a65275772bfecd2057018dd45784fabf4d3126f9446f84a09d009f15cc538e4
Jul 21 17:13:31.783961 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.783943    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:13:31.872433 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:31.872400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353101360" event={"ID":"ca6d4628-2e87-4099-96bb-26e4aaee409c","Type":"ContainerStarted","Data":"6a65275772bfecd2057018dd45784fabf4d3126f9446f84a09d009f15cc538e4"}
Jul 21 17:13:32.879951 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:32.879915    2573 generic.go:356] "Generic (PLEG): container finished" podID="ca6d4628-2e87-4099-96bb-26e4aaee409c" containerID="55f47dbe1d395c63d7af9cbf30c2744fe2eb81de18562018c5f0690ca8ea51fc" exitCode=0
Jul 21 17:13:32.880299 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:32.879969    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353101360" event={"ID":"ca6d4628-2e87-4099-96bb-26e4aaee409c","Type":"ContainerDied","Data":"55f47dbe1d395c63d7af9cbf30c2744fe2eb81de18562018c5f0690ca8ea51fc"}
Jul 21 17:13:34.027144 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.027114    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:34.048368 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.048346    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7715-140054353101360_ca6d4628-2e87-4099-96bb-26e4aaee409c/test-curl-7715-140054353101360/0.log"
Jul 21 17:13:34.072282 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.072247    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7715-140054353101360"]
Jul 21 17:13:34.074676 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.074651    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7715-140054353101360"]
Jul 21 17:13:34.116155 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.116132    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js9zb\" (UniqueName: \"kubernetes.io/projected/ca6d4628-2e87-4099-96bb-26e4aaee409c-kube-api-access-js9zb\") pod \"ca6d4628-2e87-4099-96bb-26e4aaee409c\" (UID: \"ca6d4628-2e87-4099-96bb-26e4aaee409c\") "
Jul 21 17:13:34.118125 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.118105    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca6d4628-2e87-4099-96bb-26e4aaee409c-kube-api-access-js9zb" (OuterVolumeSpecName: "kube-api-access-js9zb") pod "ca6d4628-2e87-4099-96bb-26e4aaee409c" (UID: "ca6d4628-2e87-4099-96bb-26e4aaee409c"). InnerVolumeSpecName "kube-api-access-js9zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:34.198271 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.198215    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7715-140054353103664"]
Jul 21 17:13:34.198624 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.198612    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6d4628-2e87-4099-96bb-26e4aaee409c" containerName="test-curl-7715-140054353101360"
Jul 21 17:13:34.198667 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.198626    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6d4628-2e87-4099-96bb-26e4aaee409c" containerName="test-curl-7715-140054353101360"
Jul 21 17:13:34.198709 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.198705    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca6d4628-2e87-4099-96bb-26e4aaee409c" containerName="test-curl-7715-140054353101360"
Jul 21 17:13:34.201754 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.201740    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:34.207489 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.207469    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353103664"]
Jul 21 17:13:34.217517 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.217496    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js9zb\" (UniqueName: \"kubernetes.io/projected/ca6d4628-2e87-4099-96bb-26e4aaee409c-kube-api-access-js9zb\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:34.318769 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.318745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnljr\" (UniqueName: \"kubernetes.io/projected/0f060a50-9dca-4ceb-908d-239ec848500d-kube-api-access-bnljr\") pod \"test-curl-7715-140054353103664\" (UID: \"0f060a50-9dca-4ceb-908d-239ec848500d\") " pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:34.419876 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.419851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnljr\" (UniqueName: \"kubernetes.io/projected/0f060a50-9dca-4ceb-908d-239ec848500d-kube-api-access-bnljr\") pod \"test-curl-7715-140054353103664\" (UID: \"0f060a50-9dca-4ceb-908d-239ec848500d\") " pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:34.429249 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.429228    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnljr\" (UniqueName: \"kubernetes.io/projected/0f060a50-9dca-4ceb-908d-239ec848500d-kube-api-access-bnljr\") pod \"test-curl-7715-140054353103664\" (UID: \"0f060a50-9dca-4ceb-908d-239ec848500d\") " pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:34.512363 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.512306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:34.644010 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.643972    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353103664"]
Jul 21 17:13:34.647152 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:13:34.647120    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f060a50_9dca_4ceb_908d_239ec848500d.slice/crio-7915620b9364a8f71f9342cd4515c7d72360071a8158a11c402e117e10705af2 WatchSource:0}: Error finding container 7915620b9364a8f71f9342cd4515c7d72360071a8158a11c402e117e10705af2: Status 404 returned error can't find the container with id 7915620b9364a8f71f9342cd4515c7d72360071a8158a11c402e117e10705af2
Jul 21 17:13:34.700849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.700818    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca6d4628-2e87-4099-96bb-26e4aaee409c" path="/var/lib/kubelet/pods/ca6d4628-2e87-4099-96bb-26e4aaee409c/volumes"
Jul 21 17:13:34.892178 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.892152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353103664" event={"ID":"0f060a50-9dca-4ceb-908d-239ec848500d","Type":"ContainerStarted","Data":"7915620b9364a8f71f9342cd4515c7d72360071a8158a11c402e117e10705af2"}
Jul 21 17:13:34.893615 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.893595    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353101360"
Jul 21 17:13:34.893719 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:34.893638    2573 scope.go:117] "RemoveContainer" containerID="55f47dbe1d395c63d7af9cbf30c2744fe2eb81de18562018c5f0690ca8ea51fc"
Jul 21 17:13:35.902290 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:35.902253    2573 generic.go:356] "Generic (PLEG): container finished" podID="0f060a50-9dca-4ceb-908d-239ec848500d" containerID="7a2b091733fe168e80bb917f7595767b6a27ef74547adcbb7f8e80e17e3f61ea" exitCode=0
Jul 21 17:13:35.902677 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:35.902349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353103664" event={"ID":"0f060a50-9dca-4ceb-908d-239ec848500d","Type":"ContainerDied","Data":"7a2b091733fe168e80bb917f7595767b6a27ef74547adcbb7f8e80e17e3f61ea"}
Jul 21 17:13:37.036444 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.036422    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:37.058275 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.058249    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7715-140054353103664_0f060a50-9dca-4ceb-908d-239ec848500d/test-curl-7715-140054353103664/0.log"
Jul 21 17:13:37.084019 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.083994    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7715-140054353103664"]
Jul 21 17:13:37.087546 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.087524    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7715-140054353103664"]
Jul 21 17:13:37.144458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.144431    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnljr\" (UniqueName: \"kubernetes.io/projected/0f060a50-9dca-4ceb-908d-239ec848500d-kube-api-access-bnljr\") pod \"0f060a50-9dca-4ceb-908d-239ec848500d\" (UID: \"0f060a50-9dca-4ceb-908d-239ec848500d\") "
Jul 21 17:13:37.146458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.146436    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f060a50-9dca-4ceb-908d-239ec848500d-kube-api-access-bnljr" (OuterVolumeSpecName: "kube-api-access-bnljr") pod "0f060a50-9dca-4ceb-908d-239ec848500d" (UID: "0f060a50-9dca-4ceb-908d-239ec848500d"). InnerVolumeSpecName "kube-api-access-bnljr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:37.245397 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.245335    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnljr\" (UniqueName: \"kubernetes.io/projected/0f060a50-9dca-4ceb-908d-239ec848500d-kube-api-access-bnljr\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:37.247921 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.247899    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:37.248317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.248289    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f060a50-9dca-4ceb-908d-239ec848500d" containerName="test-curl-7715-140054353103664"
Jul 21 17:13:37.248317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.248306    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f060a50-9dca-4ceb-908d-239ec848500d" containerName="test-curl-7715-140054353103664"
Jul 21 17:13:37.248500 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.248405    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f060a50-9dca-4ceb-908d-239ec848500d" containerName="test-curl-7715-140054353103664"
Jul 21 17:13:37.251511 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.251494    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:37.261138 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.261114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:37.346754 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.346721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl68l\" (UniqueName: \"kubernetes.io/projected/2ba87221-6239-467c-b8a0-8b1a387ab7b6-kube-api-access-fl68l\") pod \"test-curl-7715-140054353035600\" (UID: \"2ba87221-6239-467c-b8a0-8b1a387ab7b6\") " pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:37.448202 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.448172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl68l\" (UniqueName: \"kubernetes.io/projected/2ba87221-6239-467c-b8a0-8b1a387ab7b6-kube-api-access-fl68l\") pod \"test-curl-7715-140054353035600\" (UID: \"2ba87221-6239-467c-b8a0-8b1a387ab7b6\") " pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:37.460672 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.460643    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl68l\" (UniqueName: \"kubernetes.io/projected/2ba87221-6239-467c-b8a0-8b1a387ab7b6-kube-api-access-fl68l\") pod \"test-curl-7715-140054353035600\" (UID: \"2ba87221-6239-467c-b8a0-8b1a387ab7b6\") " pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:37.565448 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.565423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:37.702165 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.702084    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:37.704775 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:13:37.704746    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ba87221_6239_467c_b8a0_8b1a387ab7b6.slice/crio-a12832c38f68eab87faa7e9408113fc2fcb07051132e299eb1a2323a63b5ae70 WatchSource:0}: Error finding container a12832c38f68eab87faa7e9408113fc2fcb07051132e299eb1a2323a63b5ae70: Status 404 returned error can't find the container with id a12832c38f68eab87faa7e9408113fc2fcb07051132e299eb1a2323a63b5ae70
Jul 21 17:13:37.914537 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.914470    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353035600" event={"ID":"2ba87221-6239-467c-b8a0-8b1a387ab7b6","Type":"ContainerStarted","Data":"a12832c38f68eab87faa7e9408113fc2fcb07051132e299eb1a2323a63b5ae70"}
Jul 21 17:13:37.915649 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.915624    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7915620b9364a8f71f9342cd4515c7d72360071a8158a11c402e117e10705af2"
Jul 21 17:13:37.915752 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:37.915662    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:37.927113 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:13:37.927087    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7715-140054353103664\" is forbidden: User \"system:node:ip-10-0-136-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-117.ec2.internal' and this object" podUID="0f060a50-9dca-4ceb-908d-239ec848500d" pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:38.705761 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:38.705726    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f060a50-9dca-4ceb-908d-239ec848500d" path="/var/lib/kubelet/pods/0f060a50-9dca-4ceb-908d-239ec848500d/volumes"
Jul 21 17:13:38.707750 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:13:38.707723    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7715-140054353103664\" is forbidden: User \"system:node:ip-10-0-136-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-117.ec2.internal' and this object" podUID="0f060a50-9dca-4ceb-908d-239ec848500d" pod="opendatahub/test-curl-7715-140054353103664"
Jul 21 17:13:38.925056 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:38.925021    2573 generic.go:356] "Generic (PLEG): container finished" podID="2ba87221-6239-467c-b8a0-8b1a387ab7b6" containerID="575d28cef8bc73c06dfd4d810042a6788dd2246884a5fee6944324ddb477d5b5" exitCode=0
Jul 21 17:13:38.925231 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:38.925082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353035600" event={"ID":"2ba87221-6239-467c-b8a0-8b1a387ab7b6","Type":"ContainerDied","Data":"575d28cef8bc73c06dfd4d810042a6788dd2246884a5fee6944324ddb477d5b5"}
Jul 21 17:13:38.947703 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:38.947673    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:13:38.957113 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:38.957048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:13:40.070636 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.070614    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.090594 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.090571    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7715-140054353035600_2ba87221-6239-467c-b8a0-8b1a387ab7b6/test-curl-7715-140054353035600/0.log"
Jul 21 17:13:40.115579 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.115555    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:40.119798 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.119777    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:40.173512 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.173490    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl68l\" (UniqueName: \"kubernetes.io/projected/2ba87221-6239-467c-b8a0-8b1a387ab7b6-kube-api-access-fl68l\") pod \"2ba87221-6239-467c-b8a0-8b1a387ab7b6\" (UID: \"2ba87221-6239-467c-b8a0-8b1a387ab7b6\") "
Jul 21 17:13:40.175435 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.175413    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba87221-6239-467c-b8a0-8b1a387ab7b6-kube-api-access-fl68l" (OuterVolumeSpecName: "kube-api-access-fl68l") pod "2ba87221-6239-467c-b8a0-8b1a387ab7b6" (UID: "2ba87221-6239-467c-b8a0-8b1a387ab7b6"). InnerVolumeSpecName "kube-api-access-fl68l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:40.274690 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.274667    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl68l\" (UniqueName: \"kubernetes.io/projected/2ba87221-6239-467c-b8a0-8b1a387ab7b6-kube-api-access-fl68l\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:40.699987 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.699958    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ba87221-6239-467c-b8a0-8b1a387ab7b6" path="/var/lib/kubelet/pods/2ba87221-6239-467c-b8a0-8b1a387ab7b6/volumes"
Jul 21 17:13:40.937795 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.937767    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.937973 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:40.937825    2573 scope.go:117] "RemoveContainer" containerID="575d28cef8bc73c06dfd4d810042a6788dd2246884a5fee6944324ddb477d5b5"
Jul 21 17:13:43.609272 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.609234    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:43.609810 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.609790    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba87221-6239-467c-b8a0-8b1a387ab7b6" containerName="test-curl-7715-140054353035600"
Jul 21 17:13:43.609921 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.609812    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba87221-6239-467c-b8a0-8b1a387ab7b6" containerName="test-curl-7715-140054353035600"
Jul 21 17:13:43.609992 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.609977    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba87221-6239-467c-b8a0-8b1a387ab7b6" containerName="test-curl-7715-140054353035600"
Jul 21 17:13:43.618272 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.618248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:43.622076 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.622049    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x2hln\""
Jul 21 17:13:43.624431 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.624180    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:43.703877 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.703850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt2t8\" (UniqueName: \"kubernetes.io/projected/58044996-23c4-4f62-ae27-3e73de3ee5df-kube-api-access-dt2t8\") pod \"test-curl-7715-140054353122336\" (UID: \"58044996-23c4-4f62-ae27-3e73de3ee5df\") " pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:43.804512 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.804487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt2t8\" (UniqueName: \"kubernetes.io/projected/58044996-23c4-4f62-ae27-3e73de3ee5df-kube-api-access-dt2t8\") pod \"test-curl-7715-140054353122336\" (UID: \"58044996-23c4-4f62-ae27-3e73de3ee5df\") " pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:43.814265 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.814243    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt2t8\" (UniqueName: \"kubernetes.io/projected/58044996-23c4-4f62-ae27-3e73de3ee5df-kube-api-access-dt2t8\") pod \"test-curl-7715-140054353122336\" (UID: \"58044996-23c4-4f62-ae27-3e73de3ee5df\") " pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:43.932560 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:43.932505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:44.069554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:44.069508    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:44.072485 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:13:44.072456    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58044996_23c4_4f62_ae27_3e73de3ee5df.slice/crio-bbffa47cc840280d882494dde8967cecc90bd727251372694bc7f444610122dd WatchSource:0}: Error finding container bbffa47cc840280d882494dde8967cecc90bd727251372694bc7f444610122dd: Status 404 returned error can't find the container with id bbffa47cc840280d882494dde8967cecc90bd727251372694bc7f444610122dd
Jul 21 17:13:44.964857 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:44.964815    2573 generic.go:356] "Generic (PLEG): container finished" podID="58044996-23c4-4f62-ae27-3e73de3ee5df" containerID="39e820430a65b321e36fd0982720b67f50689965d09361124e9e801855d06a5c" exitCode=0
Jul 21 17:13:44.965237 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:44.964874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353122336" event={"ID":"58044996-23c4-4f62-ae27-3e73de3ee5df","Type":"ContainerDied","Data":"39e820430a65b321e36fd0982720b67f50689965d09361124e9e801855d06a5c"}
Jul 21 17:13:44.965237 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:44.964945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353122336" event={"ID":"58044996-23c4-4f62-ae27-3e73de3ee5df","Type":"ContainerStarted","Data":"bbffa47cc840280d882494dde8967cecc90bd727251372694bc7f444610122dd"}
Jul 21 17:13:45.420694 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.420658    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w" podUID="af498c96-c755-4e48-819c-37e4cfc5a61e" containerName="main" containerID="cri-o://a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df" gracePeriod=45
Jul 21 17:13:45.682779 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.682720    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:13:45.822663 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822639    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af498c96-c755-4e48-819c-37e4cfc5a61e-tls-certs\") pod \"af498c96-c755-4e48-819c-37e4cfc5a61e\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") "
Jul 21 17:13:45.822791 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-model-cache\") pod \"af498c96-c755-4e48-819c-37e4cfc5a61e\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") "
Jul 21 17:13:45.822791 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822716    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-home\") pod \"af498c96-c755-4e48-819c-37e4cfc5a61e\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") "
Jul 21 17:13:45.822791 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822746    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-tmp-dir\") pod \"af498c96-c755-4e48-819c-37e4cfc5a61e\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") "
Jul 21 17:13:45.822955 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822797    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-dshm\") pod \"af498c96-c755-4e48-819c-37e4cfc5a61e\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") "
Jul 21 17:13:45.822955 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822837    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfxbj\" (UniqueName: \"kubernetes.io/projected/af498c96-c755-4e48-819c-37e4cfc5a61e-kube-api-access-qfxbj\") pod \"af498c96-c755-4e48-819c-37e4cfc5a61e\" (UID: \"af498c96-c755-4e48-819c-37e4cfc5a61e\") "
Jul 21 17:13:45.823063 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.822996    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-model-cache" (OuterVolumeSpecName: "model-cache") pod "af498c96-c755-4e48-819c-37e4cfc5a61e" (UID: "af498c96-c755-4e48-819c-37e4cfc5a61e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:45.823063 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.823007    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-home" (OuterVolumeSpecName: "home") pod "af498c96-c755-4e48-819c-37e4cfc5a61e" (UID: "af498c96-c755-4e48-819c-37e4cfc5a61e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:45.823063 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.823043    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af498c96-c755-4e48-819c-37e4cfc5a61e" (UID: "af498c96-c755-4e48-819c-37e4cfc5a61e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:45.823406 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.823385    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-model-cache\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.823516 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.823409    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-home\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.823516 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.823421    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-tmp-dir\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.825052 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.825024    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af498c96-c755-4e48-819c-37e4cfc5a61e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af498c96-c755-4e48-819c-37e4cfc5a61e" (UID: "af498c96-c755-4e48-819c-37e4cfc5a61e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:13:45.825052 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.825038    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-dshm" (OuterVolumeSpecName: "dshm") pod "af498c96-c755-4e48-819c-37e4cfc5a61e" (UID: "af498c96-c755-4e48-819c-37e4cfc5a61e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:45.825202 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.825086    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af498c96-c755-4e48-819c-37e4cfc5a61e-kube-api-access-qfxbj" (OuterVolumeSpecName: "kube-api-access-qfxbj") pod "af498c96-c755-4e48-819c-37e4cfc5a61e" (UID: "af498c96-c755-4e48-819c-37e4cfc5a61e"). InnerVolumeSpecName "kube-api-access-qfxbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:45.924460 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.924434    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af498c96-c755-4e48-819c-37e4cfc5a61e-tls-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.924460 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.924455    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af498c96-c755-4e48-819c-37e4cfc5a61e-dshm\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.924460 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.924463    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfxbj\" (UniqueName: \"kubernetes.io/projected/af498c96-c755-4e48-819c-37e4cfc5a61e-kube-api-access-qfxbj\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.972176 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.972109    2573 generic.go:356] "Generic (PLEG): container finished" podID="af498c96-c755-4e48-819c-37e4cfc5a61e" containerID="a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df" exitCode=0
Jul 21 17:13:45.972176 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.972153    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"
Jul 21 17:13:45.972568 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.972195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w" event={"ID":"af498c96-c755-4e48-819c-37e4cfc5a61e","Type":"ContainerDied","Data":"a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df"}
Jul 21 17:13:45.972568 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.972236    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w" event={"ID":"af498c96-c755-4e48-819c-37e4cfc5a61e","Type":"ContainerDied","Data":"8a1615995e183dee8ee51c03905b71649ed8a16d3b7128eadf5971655d4b0ebe"}
Jul 21 17:13:45.972568 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.972254    2573 scope.go:117] "RemoveContainer" containerID="a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df"
Jul 21 17:13:45.983405 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.983387    2573 scope.go:117] "RemoveContainer" containerID="a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df"
Jul 21 17:13:45.983670 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:13:45.983651    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df\": container with ID starting with a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df not found: ID does not exist" containerID="a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df"
Jul 21 17:13:45.983731 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.983679    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df"} err="failed to get container status \"a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df\": rpc error: code = NotFound desc = could not find container \"a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df\": container with ID starting with a9a87240f1c8c5c5f1625b4a45537e387a6e0ad804ba164d58133e1c4a28f0df not found: ID does not exist"
Jul 21 17:13:45.998238 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:45.998213    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"]
Jul 21 17:13:46.000690 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.000670    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/rate-test-model-b04ffb-kserve-6bfd46c5cf-xq92w"]
Jul 21 17:13:46.110386 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.110366    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.131488 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.131466    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7715-140054353122336_58044996-23c4-4f62-ae27-3e73de3ee5df/test-curl-7715-140054353122336/0.log"
Jul 21 17:13:46.155293 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.155266    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:46.159401 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.159379    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:46.226634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.226569    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt2t8\" (UniqueName: \"kubernetes.io/projected/58044996-23c4-4f62-ae27-3e73de3ee5df-kube-api-access-dt2t8\") pod \"58044996-23c4-4f62-ae27-3e73de3ee5df\" (UID: \"58044996-23c4-4f62-ae27-3e73de3ee5df\") "
Jul 21 17:13:46.228566 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.228542    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58044996-23c4-4f62-ae27-3e73de3ee5df-kube-api-access-dt2t8" (OuterVolumeSpecName: "kube-api-access-dt2t8") pod "58044996-23c4-4f62-ae27-3e73de3ee5df" (UID: "58044996-23c4-4f62-ae27-3e73de3ee5df"). InnerVolumeSpecName "kube-api-access-dt2t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:46.327643 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.327606    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt2t8\" (UniqueName: \"kubernetes.io/projected/58044996-23c4-4f62-ae27-3e73de3ee5df-kube-api-access-dt2t8\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:13:46.700435 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.700405    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58044996-23c4-4f62-ae27-3e73de3ee5df" path="/var/lib/kubelet/pods/58044996-23c4-4f62-ae27-3e73de3ee5df/volumes"
Jul 21 17:13:46.700792 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.700778    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af498c96-c755-4e48-819c-37e4cfc5a61e" path="/var/lib/kubelet/pods/af498c96-c755-4e48-819c-37e4cfc5a61e/volumes"
Jul 21 17:13:46.979691 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.979623    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.979691 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:46.979672    2573 scope.go:117] "RemoveContainer" containerID="39e820430a65b321e36fd0982720b67f50689965d09361124e9e801855d06a5c"
Jul 21 17:13:49.536274 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:49.536238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:49.636430 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:49.636394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:59.314588 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:13:59.314554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:03.974574 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:03.974532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:04.180149 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:04.180111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:10.499455 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:10.499402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:10.609664 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:10.609632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:10.790806 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:10.790779    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"]
Jul 21 17:14:10.791032 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:10.790994    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy" containerID="cri-o://2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3" gracePeriod=30
Jul 21 17:14:10.840930 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:10.840869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:11.004668 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:11.004633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:11.693527 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:11.693481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:11.794794 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:11.794767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:16.054317 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.054256    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2831f91b-5482-4fb2-8a98-a05d284be74c-istiod-ca-cert\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118264    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgfs2\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-kube-api-access-mgfs2\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118313    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-certs\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-credential-socket\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-podinfo\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118401    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-envoy\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118426    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-token\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118479    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-socket\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.118917 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.118560    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-data\") pod \"2831f91b-5482-4fb2-8a98-a05d284be74c\" (UID: \"2831f91b-5482-4fb2-8a98-a05d284be74c\") "
Jul 21 17:14:16.122670 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.119657    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-data" (OuterVolumeSpecName: "istio-data") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:16.122825 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.122726    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:16.122987 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.122965    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:16.123190 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.123142    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:16.123293 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.123214    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2831f91b-5482-4fb2-8a98-a05d284be74c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:14:16.125224 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.125191    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:16.125342 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.125225    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-token" (OuterVolumeSpecName: "istio-token") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:16.125551 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.125531    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:14:16.125652 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.125633    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-kube-api-access-mgfs2" (OuterVolumeSpecName: "kube-api-access-mgfs2") pod "2831f91b-5482-4fb2-8a98-a05d284be74c" (UID: "2831f91b-5482-4fb2-8a98-a05d284be74c"). InnerVolumeSpecName "kube-api-access-mgfs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:16.156274 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.156244    2573 generic.go:356] "Generic (PLEG): container finished" podID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerID="2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3" exitCode=0
Jul 21 17:14:16.156370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.156299    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"
Jul 21 17:14:16.156370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.156331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" event={"ID":"2831f91b-5482-4fb2-8a98-a05d284be74c","Type":"ContainerDied","Data":"2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3"}
Jul 21 17:14:16.156443 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.156389    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc" event={"ID":"2831f91b-5482-4fb2-8a98-a05d284be74c","Type":"ContainerDied","Data":"b21e8db08d2aedd3ad16267add3099f595ea1a13b430aa0c001bff22c324b9cb"}
Jul 21 17:14:16.156443 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.156411    2573 scope.go:117] "RemoveContainer" containerID="2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3"
Jul 21 17:14:16.165716 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.165700    2573 scope.go:117] "RemoveContainer" containerID="a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"
Jul 21 17:14:16.174572 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.174555    2573 scope.go:117] "RemoveContainer" containerID="2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3"
Jul 21 17:14:16.174810 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:14:16.174793    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3\": container with ID starting with 2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3 not found: ID does not exist" containerID="2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3"
Jul 21 17:14:16.174849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.174819    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3"} err="failed to get container status \"2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3\": rpc error: code = NotFound desc = could not find container \"2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3\": container with ID starting with 2a350aa7cf997044534c2a92fdc34d4deb1d862ea5ee20f5f472eec92746fdf3 not found: ID does not exist"
Jul 21 17:14:16.174849 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.174836    2573 scope.go:117] "RemoveContainer" containerID="a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"
Jul 21 17:14:16.175069 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:14:16.175053    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1\": container with ID starting with a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1 not found: ID does not exist" containerID="a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"
Jul 21 17:14:16.175115 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.175076    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1"} err="failed to get container status \"a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1\": rpc error: code = NotFound desc = could not find container \"a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1\": container with ID starting with a323cbbdcf91dc01e7f21d2125c4e6a90a6ebc44466243b9d70b87203e53c3c1 not found: ID does not exist"
Jul 21 17:14:16.193459 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.193436    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"]
Jul 21 17:14:16.219470 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219450    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgfs2\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-kube-api-access-mgfs2\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219472    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219482    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219487    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ef71cb-openshift-default-66c544b5d7-dx5mc"]
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219490    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219538    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219548    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219554 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219557    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219813 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219566    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2831f91b-5482-4fb2-8a98-a05d284be74c-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.219813 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.219576    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2831f91b-5482-4fb2-8a98-a05d284be74c-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:16.698903 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:16.698855    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" path="/var/lib/kubelet/pods/2831f91b-5482-4fb2-8a98-a05d284be74c/volumes"
Jul 21 17:14:21.724387 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:21.724347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:26.226325 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:26.226295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:26.603182 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:26.603135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:32.496262 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:32.496180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:32.603489 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:32.603446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:32.745299 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:32.745268    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"]
Jul 21 17:14:32.745530 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:32.745495    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy" containerID="cri-o://6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381" gracePeriod=30
Jul 21 17:14:33.041443 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:33.041414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:33.128057 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:33.128032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:38.011801 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.011745    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:14:38.101619 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101590    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-envoy\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.101769 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-data\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.101769 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101678    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-credential-socket\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.101769 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101717    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f20fb977-5a32-424c-8121-5ef255a64910-istiod-ca-cert\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.101769 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101747    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-certs\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.102018 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-istio-token\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.102018 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101821    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-socket\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.102018 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101921    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m66w\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-kube-api-access-2m66w\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.102018 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.101950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f20fb977-5a32-424c-8121-5ef255a64910-istio-podinfo\") pod \"f20fb977-5a32-424c-8121-5ef255a64910\" (UID: \"f20fb977-5a32-424c-8121-5ef255a64910\") "
Jul 21 17:14:38.102216 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102065    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:38.102269 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102209    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f20fb977-5a32-424c-8121-5ef255a64910-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:14:38.102346 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102325    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f20fb977-5a32-424c-8121-5ef255a64910-istiod-ca-cert\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.102402 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102353    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-credential-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.102452 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102410    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:38.102452 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102435    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:38.102768 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.102736    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-data" (OuterVolumeSpecName: "istio-data") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:38.104180 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.104152    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-kube-api-access-2m66w" (OuterVolumeSpecName: "kube-api-access-2m66w") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "kube-api-access-2m66w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:38.104269 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.104176    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-istio-token" (OuterVolumeSpecName: "istio-token") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:38.104313 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.104271    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:38.104370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.104350    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f20fb977-5a32-424c-8121-5ef255a64910-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f20fb977-5a32-424c-8121-5ef255a64910" (UID: "f20fb977-5a32-424c-8121-5ef255a64910"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:14:38.203368 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203344    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m66w\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-kube-api-access-2m66w\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.203368 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203368    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f20fb977-5a32-424c-8121-5ef255a64910-istio-podinfo\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.203503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203377    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-envoy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.203503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203385    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-istio-data\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.203503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203393    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.203503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203400    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f20fb977-5a32-424c-8121-5ef255a64910-istio-token\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.203503 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.203407    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f20fb977-5a32-424c-8121-5ef255a64910-workload-socket\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\""
Jul 21 17:14:38.279189 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.279119    2573 generic.go:356] "Generic (PLEG): container finished" podID="f20fb977-5a32-424c-8121-5ef255a64910" containerID="6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381" exitCode=0
Jul 21 17:14:38.279189 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.279175    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"
Jul 21 17:14:38.279326 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.279195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" event={"ID":"f20fb977-5a32-424c-8121-5ef255a64910","Type":"ContainerDied","Data":"6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381"}
Jul 21 17:14:38.279326 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.279245    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb" event={"ID":"f20fb977-5a32-424c-8121-5ef255a64910","Type":"ContainerDied","Data":"30a0308e9d0020223d7f3ed9b9e4e359f1716c68eb38b5cad91dd163b1c40ff9"}
Jul 21 17:14:38.279326 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.279267    2573 scope.go:117] "RemoveContainer" containerID="6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381"
Jul 21 17:14:38.292286 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.292269    2573 scope.go:117] "RemoveContainer" containerID="82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"
Jul 21 17:14:38.300188 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.300169    2573 scope.go:117] "RemoveContainer" containerID="6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381"
Jul 21 17:14:38.300428 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:14:38.300410    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381\": container with ID starting with 6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381 not found: ID does not exist" containerID="6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381"
Jul 21 17:14:38.300477 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.300435    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381"} err="failed to get container status \"6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381\": rpc error: code = NotFound desc = could not find container \"6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381\": container with ID starting with 6b5f26b296d25774c87eb07bfdec8454b1b4c68996f9093afff217cc72e23381 not found: ID does not exist"
Jul 21 17:14:38.300477 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.300453    2573 scope.go:117] "RemoveContainer" containerID="82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"
Jul 21 17:14:38.300670 ip-10-0-136-117 kubenswrapper[2573]: E0721 17:14:38.300651    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31\": container with ID starting with 82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31 not found: ID does not exist" containerID="82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"
Jul 21 17:14:38.300712 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.300678    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31"} err="failed to get container status \"82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31\": rpc error: code = NotFound desc = could not find container \"82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31\": container with ID starting with 82dc036a05a94dd127c250ab04f8e492818c8fe5d41d9f3478514060e3fc1d31 not found: ID does not exist"
Jul 21 17:14:38.305709 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.305689    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"]
Jul 21 17:14:38.310732 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.310712    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b04ffb-openshift-default-84f85566c5-x45zb"]
Jul 21 17:14:38.699700 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.699671    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f20fb977-5a32-424c-8121-5ef255a64910" path="/var/lib/kubelet/pods/f20fb977-5a32-424c-8121-5ef255a64910/volumes"
Jul 21 17:14:38.934745 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:38.934716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fd46cd8d7-l8fzj_260230f6-bd1d-426f-b0db-fed5db014e75/manager/0.log"
Jul 21 17:14:39.526596 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:39.526523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-wd554_43977ce1-ca4b-4806-9a06-a56b269cf3e7/manager/0.log"
Jul 21 17:14:39.538487 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:39.538465    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-wd554_43977ce1-ca4b-4806-9a06-a56b269cf3e7/copy-manifests/0.log"
Jul 21 17:14:39.992192 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:39.992165    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744205-2lpwk_ebb93208-8b5e-4a4a-a308-7dd9fc1900b9/cleanup/0.log"
Jul 21 17:14:40.938627 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:40.938597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q_5ac82232-1a8b-43d4-97e3-d8f74b522ce0/util/0.log"
Jul 21 17:14:40.945167 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:40.945148    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q_5ac82232-1a8b-43d4-97e3-d8f74b522ce0/pull/0.log"
Jul 21 17:14:40.951629 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:40.951605    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q_5ac82232-1a8b-43d4-97e3-d8f74b522ce0/extract/0.log"
Jul 21 17:14:41.060528 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.060508    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn_4e714eb7-5d46-48cb-86a6-812d1821276a/util/0.log"
Jul 21 17:14:41.067543 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.067524    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn_4e714eb7-5d46-48cb-86a6-812d1821276a/pull/0.log"
Jul 21 17:14:41.074443 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.074428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn_4e714eb7-5d46-48cb-86a6-812d1821276a/extract/0.log"
Jul 21 17:14:41.190991 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.190938    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94_763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e/util/0.log"
Jul 21 17:14:41.199054 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.199037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94_763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e/pull/0.log"
Jul 21 17:14:41.206851 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.206836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94_763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e/extract/0.log"
Jul 21 17:14:41.325361 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.325339    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv_5601bf2b-0aa2-4c3f-ae46-c34477363f20/util/0.log"
Jul 21 17:14:41.338005 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.337988    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv_5601bf2b-0aa2-4c3f-ae46-c34477363f20/pull/0.log"
Jul 21 17:14:41.356006 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.355990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv_5601bf2b-0aa2-4c3f-ae46-c34477363f20/extract/0.log"
Jul 21 17:14:41.589085 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.589065    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7hb5j_195c1016-a9e0-43be-9ac3-4c6adf62c104/manager/0.log"
Jul 21 17:14:41.703053 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.703036    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gcskq_15fcff7d-72d5-4fde-83ba-1cf7508d3a44/manager/0.log"
Jul 21 17:14:41.809775 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.809752    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bprrj_4f24d633-6a10-43d0-ac28-216102a655ec/kuadrant-console-plugin/0.log"
Jul 21 17:14:41.922063 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:41.922009    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ns92n_eedaae06-fe13-4d7f-b74d-b741c798ab8c/registry-server/0.log"
Jul 21 17:14:42.259780 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:42.259714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h68fq_2e266f3b-109c-4f4d-8268-4e8936a19b21/manager/0.log"
Jul 21 17:14:42.644592 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:42.644568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678jd96m_01298b2d-d29f-46b4-921f-ebd4732cb228/istio-proxy/0.log"
Jul 21 17:14:42.957407 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:42.957332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:43.033524 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:43.033496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:43.418730 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:43.418703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6657d_2d89ae9f-b93a-4b85-88ed-91571aafd463/payload-processing/0.log"
Jul 21 17:14:43.533416 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:43.533392    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f856cfbd-lm9zd_cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d/router/0.log"
Jul 21 17:14:44.428169 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:44.428139    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-zbf4q_61688d0f-c950-4284-93a1-beb6ecdc59fd/main/0.log"
Jul 21 17:14:50.020214 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:50.020173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:50.099875 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:50.099846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:53.047715 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:53.047685    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t5vff_578cf7bc-822e-45e0-9a9e-5bcdeacd3e05/global-pull-secret-syncer/0.log"
Jul 21 17:14:53.100873 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:53.100841    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d2ttl_958dba57-9f58-4dfc-af58-f4ce3923ccda/konnectivity-agent/0.log"
Jul 21 17:14:53.296628 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:53.296601    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-117.ec2.internal_1aebb5d7600211fff1b0f477746bc1ef/haproxy/0.log"
Jul 21 17:14:58.015131 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.015104    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q_5ac82232-1a8b-43d4-97e3-d8f74b522ce0/extract/0.log"
Jul 21 17:14:58.044155 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.044134    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q_5ac82232-1a8b-43d4-97e3-d8f74b522ce0/util/0.log"
Jul 21 17:14:58.074139 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.074117    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzn6q_5ac82232-1a8b-43d4-97e3-d8f74b522ce0/pull/0.log"
Jul 21 17:14:58.104932 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.104910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn_4e714eb7-5d46-48cb-86a6-812d1821276a/extract/0.log"
Jul 21 17:14:58.131206 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.131188    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn_4e714eb7-5d46-48cb-86a6-812d1821276a/util/0.log"
Jul 21 17:14:58.154417 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.154397    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097rsn_4e714eb7-5d46-48cb-86a6-812d1821276a/pull/0.log"
Jul 21 17:14:58.190084 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.190067    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94_763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e/extract/0.log"
Jul 21 17:14:58.226120 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.226101    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94_763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e/util/0.log"
Jul 21 17:14:58.246796 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.246779    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jjd94_763f17ac-3fa9-4f37-bf9d-6bc7b1f67d3e/pull/0.log"
Jul 21 17:14:58.273954 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.273873    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv_5601bf2b-0aa2-4c3f-ae46-c34477363f20/extract/0.log"
Jul 21 17:14:58.294973 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.294950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv_5601bf2b-0aa2-4c3f-ae46-c34477363f20/util/0.log"
Jul 21 17:14:58.326700 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.326669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tbzmv_5601bf2b-0aa2-4c3f-ae46-c34477363f20/pull/0.log"
Jul 21 17:14:58.876406 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.876376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7hb5j_195c1016-a9e0-43be-9ac3-4c6adf62c104/manager/0.log"
Jul 21 17:14:58.903356 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.903322    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gcskq_15fcff7d-72d5-4fde-83ba-1cf7508d3a44/manager/0.log"
Jul 21 17:14:58.931467 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.931447    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bprrj_4f24d633-6a10-43d0-ac28-216102a655ec/kuadrant-console-plugin/0.log"
Jul 21 17:14:58.971150 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:58.971124    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ns92n_eedaae06-fe13-4d7f-b74d-b741c798ab8c/registry-server/0.log"
Jul 21 17:14:59.271691 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:14:59.271613    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h68fq_2e266f3b-109c-4f4d-8268-4e8936a19b21/manager/0.log"
Jul 21 17:15:00.141482 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141453    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"]
Jul 21 17:15:00.141899 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141876    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141902    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141914    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58044996-23c4-4f62-ae27-3e73de3ee5df" containerName="test-curl-7715-140054353122336"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141923    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58044996-23c4-4f62-ae27-3e73de3ee5df" containerName="test-curl-7715-140054353122336"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141942    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141948    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141957    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy"
Jul 21 17:15:00.141962 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141962    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141970    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af498c96-c755-4e48-819c-37e4cfc5a61e" containerName="main"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.141975    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="af498c96-c755-4e48-819c-37e4cfc5a61e" containerName="main"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.142043    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.142050    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="58044996-23c4-4f62-ae27-3e73de3ee5df" containerName="test-curl-7715-140054353122336"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.142059    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.142066    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="af498c96-c755-4e48-819c-37e4cfc5a61e" containerName="main"
Jul 21 17:15:00.142211 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.142072    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20fb977-5a32-424c-8121-5ef255a64910" containerName="istio-proxy"
Jul 21 17:15:00.145164 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.145148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"
Jul 21 17:15:00.148368 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.148351    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:15:00.153114 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.153091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"]
Jul 21 17:15:00.155737 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.155720    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"
Jul 21 17:15:00.300286 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.300260    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"]
Jul 21 17:15:00.301928 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:15:00.301880    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f91287a_0f8d_4416_9c96_b53e8aa7c4c8.slice/crio-41d45f271e789be49caef7c7d1e1e9f09049b77dca7aaae7776d9bba36accaeb WatchSource:0}: Error finding container 41d45f271e789be49caef7c7d1e1e9f09049b77dca7aaae7776d9bba36accaeb: Status 404 returned error can't find the container with id 41d45f271e789be49caef7c7d1e1e9f09049b77dca7aaae7776d9bba36accaeb
Jul 21 17:15:00.401679 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.401619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw" event={"ID":"3f91287a-0f8d-4416-9c96-b53e8aa7c4c8","Type":"ContainerStarted","Data":"41d45f271e789be49caef7c7d1e1e9f09049b77dca7aaae7776d9bba36accaeb"}
Jul 21 17:15:00.931899 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.931872    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/alertmanager/0.log"
Jul 21 17:15:00.979818 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:00.979784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/config-reloader/0.log"
Jul 21 17:15:01.022617 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.022590    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/kube-rbac-proxy-web/0.log"
Jul 21 17:15:01.055994 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.055969    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/kube-rbac-proxy/0.log"
Jul 21 17:15:01.082437 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.082411    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/kube-rbac-proxy-metric/0.log"
Jul 21 17:15:01.113569 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.113549    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/prom-label-proxy/0.log"
Jul 21 17:15:01.142414 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.142397    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ba1a17f-5ab9-4143-b0b8-6bb3ef078f90/init-config-reloader/0.log"
Jul 21 17:15:01.307927 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.307909    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65cc7dcb55-7fgc5_a9f59f70-460b-4dbb-97d4-3538757ca4dd/metrics-server/0.log"
Jul 21 17:15:01.344602 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.344580    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-v4d5h_de4805ac-7f09-4245-9268-d2e9e43d161e/monitoring-plugin/0.log"
Jul 21 17:15:01.409015 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.408985    2573 generic.go:356] "Generic (PLEG): container finished" podID="3f91287a-0f8d-4416-9c96-b53e8aa7c4c8" containerID="80a30bed1605281a91caed955ab20dea5d6105a2fc6a0957f0663e93a4bf515d" exitCode=0
Jul 21 17:15:01.409116 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.409061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw" event={"ID":"3f91287a-0f8d-4416-9c96-b53e8aa7c4c8","Type":"ContainerDied","Data":"80a30bed1605281a91caed955ab20dea5d6105a2fc6a0957f0663e93a4bf515d"}
Jul 21 17:15:01.549092 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.549071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnd9n_ed77d135-3e89-4076-a6ff-f991b3e157ec/node-exporter/0.log"
Jul 21 17:15:01.581620 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.581602    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnd9n_ed77d135-3e89-4076-a6ff-f991b3e157ec/kube-rbac-proxy/0.log"
Jul 21 17:15:01.621325 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:01.621310    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnd9n_ed77d135-3e89-4076-a6ff-f991b3e157ec/init-textfile/0.log"
Jul 21 17:15:02.042056 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:02.042028    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c77dbb78-jzgv7_e22db16d-c1d1-4eb8-acea-0e68b63b9a69/telemeter-client/0.log"
Jul 21 17:15:02.078569 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:02.078546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c77dbb78-jzgv7_e22db16d-c1d1-4eb8-acea-0e68b63b9a69/reload/0.log"
Jul 21 17:15:02.112270 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:02.112246    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c77dbb78-jzgv7_e22db16d-c1d1-4eb8-acea-0e68b63b9a69/kube-rbac-proxy/0.log"
Jul 21 17:15:02.552827 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:02.552803    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"
Jul 21 17:15:03.243669 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.243629    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"]
Jul 21 17:15:03.244107 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.244093    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f91287a-0f8d-4416-9c96-b53e8aa7c4c8" containerName="cleanup"
Jul 21 17:15:03.244159 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.244109    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f91287a-0f8d-4416-9c96-b53e8aa7c4c8" containerName="cleanup"
Jul 21 17:15:03.244159 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.244120    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy"
Jul 21 17:15:03.244159 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.244126    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy"
Jul 21 17:15:03.244253 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.244202    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f91287a-0f8d-4416-9c96-b53e8aa7c4c8" containerName="cleanup"
Jul 21 17:15:03.244253 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.244228    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2831f91b-5482-4fb2-8a98-a05d284be74c" containerName="istio-proxy"
Jul 21 17:15:03.247165 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.247150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.249807 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.249780    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79c4t\"/\"kube-root-ca.crt\""
Jul 21 17:15:03.251010 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.250988    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-79c4t\"/\"default-dockercfg-cd55w\""
Jul 21 17:15:03.251145 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.251022    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79c4t\"/\"openshift-service-ca.crt\""
Jul 21 17:15:03.255911 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.255859    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"]
Jul 21 17:15:03.312635 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.312598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-lib-modules\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.312635 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.312644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-sys\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.312855 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.312725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-proc\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.312855 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.312790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p65jz\" (UniqueName: \"kubernetes.io/projected/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-kube-api-access-p65jz\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.312855 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.312840    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-podres\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.399699 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.399673    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-f5xrs_39c670d6-4da9-4374-acb4-7499c8366821/networking-console-plugin/0.log"
Jul 21 17:15:03.414277 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p65jz\" (UniqueName: \"kubernetes.io/projected/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-kube-api-access-p65jz\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-podres\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-lib-modules\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-sys\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414458 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-proc\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-podres\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-proc\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-lib-modules\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.414634 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.414472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-sys\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.420854 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.420828    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw"
Jul 21 17:15:03.420854 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.420839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-gfmdw" event={"ID":"3f91287a-0f8d-4416-9c96-b53e8aa7c4c8","Type":"ContainerDied","Data":"41d45f271e789be49caef7c7d1e1e9f09049b77dca7aaae7776d9bba36accaeb"}
Jul 21 17:15:03.421070 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.420916    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41d45f271e789be49caef7c7d1e1e9f09049b77dca7aaae7776d9bba36accaeb"
Jul 21 17:15:03.422867 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.422845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p65jz\" (UniqueName: \"kubernetes.io/projected/722dccf2-a2d7-4b5a-9e90-73cf1d9750a9-kube-api-access-p65jz\") pod \"perf-node-gather-daemonset-xj8rh\" (UID: \"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.558420 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.558388    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:03.692228 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.692201    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"]
Jul 21 17:15:03.693379 ip-10-0-136-117 kubenswrapper[2573]: W0721 17:15:03.693356    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod722dccf2_a2d7_4b5a_9e90_73cf1d9750a9.slice/crio-57e922bcf79180a345ef1389456d4c63fb7e28b42ae4e1cc1769c37a95adc5f7 WatchSource:0}: Error finding container 57e922bcf79180a345ef1389456d4c63fb7e28b42ae4e1cc1769c37a95adc5f7: Status 404 returned error can't find the container with id 57e922bcf79180a345ef1389456d4c63fb7e28b42ae4e1cc1769c37a95adc5f7
Jul 21 17:15:03.996027 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:03.995946    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/1.log"
Jul 21 17:15:04.000316 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:04.000295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-4zxkf_128d24cd-aa73-42c4-9e55-e86f5cdcfe9f/console-operator/2.log"
Jul 21 17:15:04.427221 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:04.427181    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh" event={"ID":"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9","Type":"ContainerStarted","Data":"0cb8d870c320dab06dfcfa038e51485d3924b3d74f6bce54ea72a2639957ddb7"}
Jul 21 17:15:04.427370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:04.427244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh" event={"ID":"722dccf2-a2d7-4b5a-9e90-73cf1d9750a9","Type":"ContainerStarted","Data":"57e922bcf79180a345ef1389456d4c63fb7e28b42ae4e1cc1769c37a95adc5f7"}
Jul 21 17:15:04.427370 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:04.427356    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:04.448071 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:04.448026    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh" podStartSLOduration=1.448011239 podStartE2EDuration="1.448011239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:04.445560279 +0000 UTC m=+3086.262239723" watchObservedRunningTime="2026-07-21 17:15:04.448011239 +0000 UTC m=+3086.264690729"
Jul 21 17:15:04.467166 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:04.467142    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b5dbb845-jvzk7_5cf782b2-dbbd-4f6a-98a2-62fea719fe84/console/0.log"
Jul 21 17:15:05.166814 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:05.166785    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-kkg88_10af9cc1-6f96-4de9-9070-6e4b37928744/volume-data-source-validator/0.log"
Jul 21 17:15:06.289295 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:06.289260    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ld5xs_62d8da46-8968-4210-be61-1918cdbe0d08/dns/0.log"
Jul 21 17:15:06.311628 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:06.311602    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ld5xs_62d8da46-8968-4210-be61-1918cdbe0d08/kube-rbac-proxy/0.log"
Jul 21 17:15:06.384780 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:06.384750    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qmxdc_380a2811-539d-4a04-80db-bcd28c818aa0/dns-node-resolver/0.log"
Jul 21 17:15:06.999258 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:06.999228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lmkk_fca8c040-f5b1-4c4d-9a97-02a5e53b0cc5/node-ca/0.log"
Jul 21 17:15:07.992655 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:07.992629    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678jd96m_01298b2d-d29f-46b4-921f-ebd4732cb228/istio-proxy/0.log"
Jul 21 17:15:08.399450 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:08.399422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6657d_2d89ae9f-b93a-4b85-88ed-91571aafd463/payload-processing/0.log"
Jul 21 17:15:08.421232 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:08.421208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f856cfbd-lm9zd_cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d/router/0.log"
Jul 21 17:15:09.160183 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:09.160153    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-crz5z_8375b1de-1c02-46e5-87e5-4ae126e409a7/serve-healthcheck-canary/0.log"
Jul 21 17:15:09.652080 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:09.652049    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-8d44g_84578956-b209-46c3-a514-bb177be7c4d5/insights-operator/0.log"
Jul 21 17:15:09.652619 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:09.652602    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-8d44g_84578956-b209-46c3-a514-bb177be7c4d5/insights-operator/1.log"
Jul 21 17:15:09.672561 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:09.672528    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cq7x6_fd46952a-489d-4ba9-b3a1-3a3381e10f24/kube-rbac-proxy/0.log"
Jul 21 17:15:09.693824 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:09.693803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cq7x6_fd46952a-489d-4ba9-b3a1-3a3381e10f24/exporter/0.log"
Jul 21 17:15:09.714759 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:09.714741    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cq7x6_fd46952a-489d-4ba9-b3a1-3a3381e10f24/extractor/0.log"
Jul 21 17:15:10.442170 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:10.442143    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-xj8rh"
Jul 21 17:15:12.603320 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:12.603284    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fd46cd8d7-l8fzj_260230f6-bd1d-426f-b0db-fed5db014e75/manager/0.log"
Jul 21 17:15:12.945107 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:12.945078    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-wd554_43977ce1-ca4b-4806-9a06-a56b269cf3e7/manager/0.log"
Jul 21 17:15:12.963380 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:12.963355    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-wd554_43977ce1-ca4b-4806-9a06-a56b269cf3e7/copy-manifests/0.log"
Jul 21 17:15:13.658583 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:13.658503    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678jd96m_01298b2d-d29f-46b4-921f-ebd4732cb228/istio-proxy/0.log"
Jul 21 17:15:14.021700 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:14.021623    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6657d_2d89ae9f-b93a-4b85-88ed-91571aafd463/payload-processing/0.log"
Jul 21 17:15:14.080233 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:14.080206    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f856cfbd-lm9zd_cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d/router/0.log"
Jul 21 17:15:14.227573 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:14.227536    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76d8f8b6b-nd8p2_6c25bf65-c359-4bb4-8292-f67824013ee2/manager/0.log"
Jul 21 17:15:14.278610 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:14.278537    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hsc95_73ed8fc3-2aeb-4198-8963-7db3fe971ad6/openshift-lws-operator/0.log"
Jul 21 17:15:15.426591 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:15.426557    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678jd96m_01298b2d-d29f-46b4-921f-ebd4732cb228/istio-proxy/0.log"
Jul 21 17:15:15.787448 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:15.787425    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-6657d_2d89ae9f-b93a-4b85-88ed-91571aafd463/payload-processing/0.log"
Jul 21 17:15:15.800497 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:15.800472    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f856cfbd-lm9zd_cb3d910f-80f7-4f3e-b8d8-6b73ed781e5d/router/0.log"
Jul 21 17:15:19.699194 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:19.699160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-kg7kc_a263039b-51ed-4fdc-983f-badb7f77fcbd/kube-storage-version-migrator-operator/1.log"
Jul 21 17:15:19.700258 ip-10-0-136-117 kubenswrapper[2573]: I0721 17:15:19.700222    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-kg7kc_a263039b-51ed-4fdc-983f-badb7f77fcbd/kube-storage-version-migrator-operator/0.log"