Jul 02 19:00:29.229404 ip-10-0-135-32 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 19:00:29.229419 ip-10-0-135-32 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 19:00:29.229430 ip-10-0-135-32 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 19:00:29.229730 ip-10-0-135-32 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 19:00:39.417667 ip-10-0-135-32 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 19:00:39.417701 ip-10-0-135-32 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 40b3e4c270c643bf81d44064e29ed51b --
Jul 02 19:02:15.518169 ip-10-0-135-32 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:02:15.954199 ip-10-0-135-32 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:02:15.954199 ip-10-0-135-32 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:02:15.954199 ip-10-0-135-32 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:02:15.954199 ip-10-0-135-32 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:02:15.954199 ip-10-0-135-32 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:02:15.955220 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.955133    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:02:15.961625 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961606    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:02:15.961625 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961624    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961628    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961632    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961635    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961638    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961645    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961649    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961652    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961654    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961657    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961660    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961662    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961665    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961668    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961670    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961673    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961676    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961678    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961681    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961683    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:02:15.961698 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961686    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961689    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961692    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961694    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961697    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961699    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961702    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961705    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961708    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961711    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961713    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961716    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961718    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961720    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961723    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961726    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961728    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961731    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961734    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:02:15.962217 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961737    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961739    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961741    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961744    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961746    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961749    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961751    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961753    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961756    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961760    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961764    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961768    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961772    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961775    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961778    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961783    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961787    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961790    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961793    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:02:15.962669 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961796    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961799    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961814    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961816    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961819    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961822    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961825    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961828    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961831    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961835    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961838    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961840    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961847    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961850    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961852    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961855    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961857    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961860    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961863    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961865    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:02:15.963158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961868    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961870    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961873    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961876    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961878    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961881    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961883    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961885    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961889    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961891    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961894    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961898    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961901    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961903    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961906    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961908    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961911    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961914    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961916    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.961919    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:02:15.963654 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962699    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962706    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962710    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962713    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962716    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962723    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962726    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962729    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962731    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962734    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962737    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962739    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962742    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962744    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962747    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962750    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962753    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962755    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962758    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962760    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:02:15.964145 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962763    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962766    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962769    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962771    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962774    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962777    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962779    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962782    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962785    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962787    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962790    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962792    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962795    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962816    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962820    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962823    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962826    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962829    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962833    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962835    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:02:15.964655 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962838    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962841    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962844    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962846    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962849    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962852    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962855    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962857    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962860    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962863    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962865    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962868    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962870    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962873    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962875    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962878    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962880    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962883    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962886    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962888    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:02:15.965158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962891    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962893    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962896    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962898    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962901    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962903    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962906    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962908    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962914    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962916    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962919    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962922    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962925    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962927    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962930    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962933    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962936    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962938    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962941    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962943    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:02:15.965652 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962946    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962948    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962951    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962954    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962956    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962959    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962961    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962966    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962969    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962972    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962974    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962977    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962979    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962982    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962985    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962989    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962992    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962994    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.962998    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:02:15.966247 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963422    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963430    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963433    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963436    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963439    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963442    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963445    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963447    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963453    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963455    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963458    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963460    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963463    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963465    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963468    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963471    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963473    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963475    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963478    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:02:15.966716 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963481    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963484    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963486    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963489    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963491    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963494    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963496    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963499    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963501    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963503    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963506    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963508    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963511    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963513    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963517    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963520    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963522    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963525    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963529    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963532    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:02:15.967333 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963534    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963539    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963542    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963544    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963547    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963549    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963552    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963555    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963557    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963560    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963562    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963564    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963567    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963569    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963572    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963574    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963577    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963581    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963584    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963588    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:02:15.968034 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963592    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963604    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963607    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963611    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963615    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963618    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963623    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963625    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963628    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963631    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963633    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963637    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963639    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963643    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963645    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963648    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963650    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963653    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963655    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963658    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:02:15.968513 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963660    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963663    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963665    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963668    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963671    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963673    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963676    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963678    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963681    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963683    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963686    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963688    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963691    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963693    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963696    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963699    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963702    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963704    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963708    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.963711    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:02:15.969027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963776    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963784    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963791    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963796    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963814    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963818    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963822    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963827    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963830    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963833    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963837    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963841    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963844    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963847    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963849    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963852    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963855    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963858    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963862    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963865    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963868    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963871    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963874    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963878    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:02:15.969507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963881    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963884    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963887    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963890    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963893    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963896    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963901    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963903    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963908    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963911    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963914    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963917    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963920    2572 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963924    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963929    2572 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963932    2572 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963935    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963938    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963942    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963945    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963949    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963952    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963955    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963957    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963960    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:02:15.970100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963963    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963966    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963969    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963972    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963974    2572 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963978    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963981    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963984    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963987    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963991    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963993    2572 flags.go:64] FLAG: --help="false"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963996    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-135-32.ec2.internal"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.963999    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964004    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964006    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964010    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964013    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964016    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964019    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964021    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964024    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964028    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964031    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964034    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:02:15.970737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964037    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964040    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964043    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964046    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964049    2572 flags.go:64] FLAG: --lock-file=""
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964051    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964054    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964057    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964062    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964065    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964068    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964071    2572 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964074    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964077    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964080    2572 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964083    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964087    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964090    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964094    2572 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964097    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964101    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964105    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964107    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964110    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964113    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:02:15.971332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964116    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964123    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964126    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964129    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964132    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964136    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964142    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964145    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964148    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964152    2572 flags.go:64] FLAG: --port="10250"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964155    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964158    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c72baa284523c62"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964161    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964164    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964167    2572 flags.go:64] FLAG: --register-node="true"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964170    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964173    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964176    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964179    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964181    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964185    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964188    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964191    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964194    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964196    2572 flags.go:64] FLAG: --runonce="false"
Jul 02 19:02:15.971954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964199    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964202    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964205    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964208    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964211    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964214    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964217    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964220    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964223    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964225    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964228    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964233    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964236    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964240    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964242    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964248    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964251    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964254    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964258    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964261    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964263    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964266    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964269    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964272    2572 flags.go:64] FLAG: --v="2"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964276    2572 flags.go:64] FLAG: --version="false"
Jul 02 19:02:15.972554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964280    2572 flags.go:64] FLAG: --vmodule=""
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964284    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.964287    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964421    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964425    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964428    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964431    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964435    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964438    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964441    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964443    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964446    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964449    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964451    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964454    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964456    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964459    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964461    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964466    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964468    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:02:15.973177 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964471    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964474    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964476    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964479    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964481    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964483    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964486    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964489    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964491    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964494    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964496    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964498    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964501    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964504    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964507    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964509    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964512    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964515    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964517    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:02:15.973642 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964520    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964522    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964525    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964528    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964532    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964535    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964537    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964540    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964542    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964545    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964547    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964553    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964555    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964558    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964561    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964564    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964566    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964569    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964571    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:02:15.974158 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964574    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964576    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964579    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964582    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964586    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964589    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964592    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964594    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964597    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964600    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964602    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964605    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964608    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964610    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964613    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964615    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964618    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964620    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964623    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964625    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:02:15.974605 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964628    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964630    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964633    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964635    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964639    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964642    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964644    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964647    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964649    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964653    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964655    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964658    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964662    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964664    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964668    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964672    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964675    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964678    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964681    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964684    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:02:15.975111 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964686    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964689    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964692    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.964694    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.965387    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.973236    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.973254    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.973273    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.973279    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973333    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973338    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973342    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973345    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973348    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973352    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:02:15.975575 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973354    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973357    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973360    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973363    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973365    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973368    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973371    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973375    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973378    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973382    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973384    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973387    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973389    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973392    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973394    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973397    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973400    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973402    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973405    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:02:15.975989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973407    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973410    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973418    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973421    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973424    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973427    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973430    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973432    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973435    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973438    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973440    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973443    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973446    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973448    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973451    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973454    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973456    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973459    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973461    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973464    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:02:15.976448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973467    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973470    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973473    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973475    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973478    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973480    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973482    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973485    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973487    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973490    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973493    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973495    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973498    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973501    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973503    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973505    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973508    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973512    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973516    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973519    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:02:15.976954 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973521    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973524    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973526    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973529    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973532    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973534    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973537    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973539    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973541    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973544    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973548    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973551    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973554    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973557    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973560    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973563    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973566    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973568    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973571    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:02:15.977450 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973574    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973577    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973580    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973582    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973589    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973592    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973595    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973598    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973600    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973603    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973606    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973609    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973611    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973614    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973617    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:02:15.977924 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.973622    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973741    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973748    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973752    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973755    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973758    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973761    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973764    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973767    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973771    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973774    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973777    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973779    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973783    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973786    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973788    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973791    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973793    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:02:15.978317 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973796    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973798    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973815    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973818    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973820    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973823    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973826    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973828    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973832    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973835    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973838    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973840    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973843    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973846    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973848    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973851    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973853    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973856    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973858    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973860    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:02:15.978779 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973863    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973866    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973868    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973871    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973873    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973875    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973878    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973880    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973883    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973886    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973889    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973891    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973894    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973896    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973899    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973901    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973904    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973906    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973908    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973911    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:02:15.979271 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973914    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973916    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973919    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973921    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973924    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973926    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973929    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973931    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973934    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973937    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973939    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973941    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973944    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973946    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973948    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973951    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973953    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973956    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973958    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:02:15.979771 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973960    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973963    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973966    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973969    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973971    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973974    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973976    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973980    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973983    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973986    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973989    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973991    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973993    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973996    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.973999    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974001    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974004    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974006    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974009    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974011    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:02:15.980249 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974014    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974016    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:15.974018    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.974023    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.974153    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.978096    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.979747    2572 server.go:1019] "Starting client certificate rotation"
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.979849    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:02:15.980727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.979900    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:02:15.982725 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.982709    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:02:15.984840 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.984823    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:02:15.996303 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.996285    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:02:15.998590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.998577    2572 log.go:25] "Validated CRI v1 image API"
Jul 02 19:02:15.999746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:15.999717    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:02:16.006920 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.006898    2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9715f414-c991-4a6e-8a03-ca07c2c46247:/dev/nvme0n1p3 aafccc7e-44a9-4867-a4ee-5ba75ce05182:/dev/nvme0n1p4]
Jul 02 19:02:16.006985 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.006919    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:02:16.010614 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.010595    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:02:16.011911 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.011789    2572 manager.go:216] Machine: {Timestamp:2026-07-02 19:02:16.010532484 +0000 UTC m=+0.382287195 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102890 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2902684aa0de98647a117e1f345d SystemUUID:ec2f2902-684a-a0de-9864-7a117e1f345d BootID:40b3e4c2-70c6-43bf-81d4-4064e29ed51b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:90:de:c6:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:90:de:c6:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:d4:fb:a0:77:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:02:16.011911 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.011910    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:02:16.012024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.011991    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:02:16.013784 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.013759    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:02:16.013931 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.013787    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:02:16.016567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.016557    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:02:16.016607 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.016571    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:02:16.016607 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.016579    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:02:16.017312 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.017301    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:02:16.018881 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.018871    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:02:16.022031 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022019    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:02:16.022157 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022147    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:02:16.022196 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022179    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:02:16.022196 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022189    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:02:16.022253 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022202    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:02:16.022253 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022211    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:02:16.022253 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022219    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:02:16.022605 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022593    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:02:16.022650 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.022611    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:02:16.025904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.025890    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:02:16.028389 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.028372    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:02:16.028447 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.028406    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:02:16.029855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029844    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:02:16.029890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029860    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:02:16.029890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029869    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:02:16.029890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029874    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:02:16.029890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029882    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:02:16.029890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029887    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:02:16.030028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029895    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:02:16.030028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029901    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:02:16.030028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029907    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:02:16.030028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029911    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:02:16.030028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029920    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:02:16.030028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.029925    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:02:16.031561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.031550    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:02:16.031606 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.031563    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:02:16.034679 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.034652    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:02:16.034679 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.034650    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:02:16.034789 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.034707    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:02:16.034943 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.034927    2572 server.go:1268] "Started kubelet"
Jul 02 19:02:16.035017 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.034978    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:02:16.035177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.035123    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:02:16.035263 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.035198    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:02:16.035962 ip-10-0-135-32 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:02:16.037348 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.037334    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:02:16.039581 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.039562    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:02:16.042720 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.042693    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:02:16.046688 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.045592    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-32.ec2.internal.18be8e46862456be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-32.ec2.internal,UID:ip-10-0-135-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-32.ec2.internal,},FirstTimestamp:2026-07-02 19:02:16.034678462 +0000 UTC m=+0.406433221,LastTimestamp:2026-07-02 19:02:16.034678462 +0000 UTC m=+0.406433221,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-32.ec2.internal,}"
Jul 02 19:02:16.049845 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.049825    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:02:16.049845 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.049832    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:02:16.049974 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.049960    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.050745 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050720    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:02:16.050745 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050728    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:02:16.050745 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050733    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:02:16.050745 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050760    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:02:16.050745 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050765    2572 factory.go:55] Registering systemd factory
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050775    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050882    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050892    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.050993    2572 factory.go:153] Registering CRI-O factory
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.051005    2572 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.051028    2572 factory.go:103] Registering Raw factory
Jul 02 19:02:16.051035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.051040    2572 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:02:16.051522 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.051508    2572 manager.go:349] Starting recovery of all containers
Jul 02 19:02:16.051857 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.051833    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:02:16.051994 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.051954    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:02:16.063765 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.063743    2572 manager.go:354] Recovery completed
Jul 02 19:02:16.065832 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.065814    2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 02 19:02:16.068968 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.068946    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jwgnd"
Jul 02 19:02:16.069630 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.069617    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.071589 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.071574    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.071661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.071610    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.071661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.071629    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.072275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.072260    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:02:16.072275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.072273    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:02:16.072384 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.072290    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:02:16.072384 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.072274    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.073165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.073149    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.073232 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.073179    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.073232 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.073188    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.073439 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.073416    2572 policy_none.go:49] "None policy: Start"
Jul 02 19:02:16.073471 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.073445    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:02:16.073471 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.073462    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:02:16.079188 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.079171    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jwgnd"
Jul 02 19:02:16.079936 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.079864    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-32.ec2.internal.18be8e46885789cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-32.ec2.internal,UID:ip-10-0-135-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-32.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-32.ec2.internal,},FirstTimestamp:2026-07-02 19:02:16.071588299 +0000 UTC m=+0.443343012,LastTimestamp:2026-07-02 19:02:16.071588299 +0000 UTC m=+0.443343012,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-32.ec2.internal,}"
Jul 02 19:02:16.150243 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.150210    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.154298    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.155460    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.155504    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.155530    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.155570    2572 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.158482    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:02:16.211027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.210487    2572 policy_none.go:47] "Start"
Jul 02 19:02:16.240521 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.240330    2572 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:02:16.240612 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.240554    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:02:16.240612 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.240566    2572 server.go:87] "Starting device plugin registration server"
Jul 02 19:02:16.240835 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.240816    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:02:16.240936 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.240831    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:02:16.240936 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.240923    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:02:16.241043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.241028    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:02:16.241043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.241038    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:02:16.242423 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.241957    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:02:16.242423 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.242010    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.256158 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.256136    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"]
Jul 02 19:02:16.256251 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.256195    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.257334 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.257306    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.257593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.257574    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.257643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.257609    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.257643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.257625    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.259131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.259119    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.259261 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.259248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.259294 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.259277    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.260199 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.260183    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.260274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.260197    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.260274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.260216    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.260274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.260231    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.260411 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.260217    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.260411 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.260302    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.261711 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.261695    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.261791 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.261725    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.262497 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.262479    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.262608 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.262505    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.262608 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.262521    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.279340 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.279319    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.283783 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.283767    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.341232 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.341200    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:16.342151 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.342132    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:16.342255 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.342163    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:16.342255 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.342172    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:16.342255 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.342196    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.352106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.352088    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.352169 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.352109    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-32.ec2.internal\": node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.353515 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.353500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/691e52ad59e0d902715180e32ae604d0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"691e52ad59e0d902715180e32ae604d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.353565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.353525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffa3c5b08f070591b622327619791d72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"ffa3c5b08f070591b622327619791d72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.353565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.353541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffa3c5b08f070591b622327619791d72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"ffa3c5b08f070591b622327619791d72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.373711 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.373689    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.454099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.454036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffa3c5b08f070591b622327619791d72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"ffa3c5b08f070591b622327619791d72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.454099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.454068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffa3c5b08f070591b622327619791d72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"ffa3c5b08f070591b622327619791d72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.454099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.454084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/691e52ad59e0d902715180e32ae604d0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"691e52ad59e0d902715180e32ae604d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.454242 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.454139    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/691e52ad59e0d902715180e32ae604d0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"691e52ad59e0d902715180e32ae604d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.454242 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.454143    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffa3c5b08f070591b622327619791d72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"ffa3c5b08f070591b622327619791d72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.454242 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.454139    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffa3c5b08f070591b622327619791d72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"ffa3c5b08f070591b622327619791d72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.474182 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.474147    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.575035 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.575000    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.582173 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.582151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.587247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.587231    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:16.675582 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.675544    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.776164 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.776137    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.877627 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.877587    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.978205 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:16.978163    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:16.979365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.979345    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:02:16.979508 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:16.979490    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:02:17.078558 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:17.078478    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:17.081775 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.081742    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:57:16 +0000 UTC" deadline="2028-02-13 05:14:27.884076828 +0000 UTC"
Jul 02 19:02:17.081775 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.081772    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14170h12m10.802308249s"
Jul 02 19:02:17.179049 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:17.179004    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:17.221359 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.221321    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:02:17.222796 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.222767    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:02:17.222926 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.222826    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:02:17.222926 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.222840    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:02:17.242567 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:17.242521    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691e52ad59e0d902715180e32ae604d0.slice/crio-1d35ce0c9d284e111b25dbe82a01ca78198e8ea5780780f75298af432fe5c3f3 WatchSource:0}: Error finding container 1d35ce0c9d284e111b25dbe82a01ca78198e8ea5780780f75298af432fe5c3f3: Status 404 returned error can't find the container with id 1d35ce0c9d284e111b25dbe82a01ca78198e8ea5780780f75298af432fe5c3f3
Jul 02 19:02:17.246869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.246852    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:02:17.253963 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:17.253936    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa3c5b08f070591b622327619791d72.slice/crio-0c44035e5d72e69b668902296682ae29d3520f52f740cb727df942b808bde304 WatchSource:0}: Error finding container 0c44035e5d72e69b668902296682ae29d3520f52f740cb727df942b808bde304: Status 404 returned error can't find the container with id 0c44035e5d72e69b668902296682ae29d3520f52f740cb727df942b808bde304
Jul 02 19:02:17.280467 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:17.280436    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found"
Jul 02 19:02:17.283427 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.283410    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:02:17.353131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.353056    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:17.366121 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.366103    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:02:17.368228 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.368213    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"
Jul 02 19:02:17.382763 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.382743    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:02:17.459831 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.459801    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:02:17.504991 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.504960    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:02:17.938310 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:17.938275    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:02:18.023987 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.023940    2572 apiserver.go:52] "Watching apiserver"
Jul 02 19:02:18.032148 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.031700    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:02:18.034513 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.034474    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-lklf2","kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal","openshift-dns/node-resolver-jghjq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal","openshift-multus/multus-mm6g4","openshift-multus/network-metrics-daemon-24bgr","openshift-network-diagnostics/network-check-target-cd9wj","openshift-network-operator/iptables-alerter-2vdlv","kube-system/global-pull-secret-syncer-jc67t","kube-system/konnectivity-agent-cm8kq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw","openshift-cluster-node-tuning-operator/tuned-ss55l","openshift-image-registry/node-ca-t8k6f","openshift-multus/multus-additional-cni-plugins-j6dzp"]
Jul 02 19:02:18.037387 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.037358    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.039936 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.039917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.040541 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.040399    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7kzlv\""
Jul 02 19:02:18.040541 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.040415    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:02:18.040703 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.040632    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:02:18.042929 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.042910    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.043142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.043126    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:02:18.043253 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.043133    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.043452 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.043396    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.043531 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.043503    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jrfbx\""
Jul 02 19:02:18.043708 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.043689    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:02:18.043891 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.043856    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:02:18.044887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.044854    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.046131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.046112    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.046237 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.046210    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.047079 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.047032    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f8kgh\""
Jul 02 19:02:18.047384 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.047368    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.048058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.048039    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.048466 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.048446    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.048663 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.048647    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:02:18.049490 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.048837    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jhwbd\""
Jul 02 19:02:18.049490 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.049322    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:02:18.049897 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.049738    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m5v75\""
Jul 02 19:02:18.050673 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.050097    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:02:18.050673 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.050351    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.050673 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.050463    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:18.052001 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.051906    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.054352 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.054181    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.054352 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.054214    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:02:18.054352 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.054238    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xlqd\""
Jul 02 19:02:18.054566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.054413    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.054566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.054536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.056832 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.056812    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:02:18.057150 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.057130    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.057419 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.057401    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.057678 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.057660    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zbqwz\""
Jul 02 19:02:18.058103 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.057918    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.058103 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.057996    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:18.060418 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.060396    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:18.060517 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.060474    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:18.062291 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-modprobe-d\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.062406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysctl-d\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.062406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-os-release\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.062406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062376    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.062406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062400    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-run\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062424    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-cni-bin\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-conf-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062511    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-sys-fs\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062537    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cnibin\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062588    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysconfig\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.062622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062611    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-k8s-cni-cncf-io\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062646    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-kubelet\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-socket-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkk5f\" (UniqueName: \"kubernetes.io/projected/3cf36feb-7387-4944-a64c-6d2019419686-kube-api-access-pkk5f\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysctl-conf\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-systemd\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-sys\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-cni-binary-copy\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-netns\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062928    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-hostroot\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-multus-certs\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.062989    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdd6\" (UniqueName: \"kubernetes.io/projected/4aedc5c1-65fc-44b6-bb08-5f72641fed58-kube-api-access-gqdd6\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063053    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7ce4001-40cb-4c97-97a3-e59a793880c9-konnectivity-ca\") pod \"konnectivity-agent-cm8kq\" (UID: \"c7ce4001-40cb-4c97-97a3-e59a793880c9\") " pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063081    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-os-release\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063107    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-lib-modules\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-system-cni-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-cni-multus\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063186    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkqg\" (UniqueName: \"kubernetes.io/projected/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-kube-api-access-njkqg\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-device-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063276    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-system-cni-dir\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6b9268f-a010-415e-8c68-964fed87830f-host\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-var-lib-kubelet\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063360    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-host\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063385    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xrm2\" (UniqueName: \"kubernetes.io/projected/730f1e3e-919e-48e8-8f21-f509efd3e6ac-kube-api-access-5xrm2\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.063604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq89h\" (UniqueName: \"kubernetes.io/projected/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-kube-api-access-mq89h\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063573    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-kubernetes\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-tuned\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730f1e3e-919e-48e8-8f21-f509efd3e6ac-tmp\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-cnibin\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-cni-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-socket-dir-parent\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-daemon-config\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-etc-kubernetes\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.063979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-registration-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.064008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.064041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7ce4001-40cb-4c97-97a3-e59a793880c9-agent-certs\") pod \"konnectivity-agent-cm8kq\" (UID: \"c7ce4001-40cb-4c97-97a3-e59a793880c9\") " pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.064068    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f6b9268f-a010-415e-8c68-964fed87830f-serviceca\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.064115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h84bp\" (UniqueName: \"kubernetes.io/projected/f6b9268f-a010-415e-8c68-964fed87830f-kube-api-access-h84bp\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.064407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.064267    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.065247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.065086    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.067385 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.067363    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-88g9k\""
Jul 02 19:02:18.068135 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.067735    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:02:18.068135 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.067770    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.068135 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.067931    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-srlf6\""
Jul 02 19:02:18.068135 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.068110    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:02:18.068379 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.068166    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:02:18.068379 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.068356    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:02:18.068481 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.068391    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:02:18.068481 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.068448    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.070030 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.069613    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:02:18.071966 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.071495    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:02:18.089779 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.089714    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tvvms"
Jul 02 19:02:18.099741 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.099708    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tvvms"
Jul 02 19:02:18.152916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.152794    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:02:18.163608 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.163554    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"ffa3c5b08f070591b622327619791d72","Type":"ContainerStarted","Data":"0c44035e5d72e69b668902296682ae29d3520f52f740cb727df942b808bde304"}
Jul 02 19:02:18.164411 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164387    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7ce4001-40cb-4c97-97a3-e59a793880c9-konnectivity-ca\") pod \"konnectivity-agent-cm8kq\" (UID: \"c7ce4001-40cb-4c97-97a3-e59a793880c9\") " pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.164542 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-lib-modules\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.164542 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-system-cni-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.164542 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovnkube-script-lib\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.164542 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-system-cni-dir\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6b9268f-a010-415e-8c68-964fed87830f-host\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-host\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xrm2\" (UniqueName: \"kubernetes.io/projected/730f1e3e-919e-48e8-8f21-f509efd3e6ac-kube-api-access-5xrm2\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164674    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w788h\" (UniqueName: \"kubernetes.io/projected/bdc38945-c0fb-4101-9d4f-dae67eb2552f-kube-api-access-w788h\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164688    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-system-cni-dir\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-socket-dir-parent\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.164744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164748    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq89h\" (UniqueName: \"kubernetes.io/projected/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-kube-api-access-mq89h\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164856    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-tuned\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-cnibin\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.164935    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-cni-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164966    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-etc-kubernetes\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.164813    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-lib-modules\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.165001    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:02:18.664979528 +0000 UTC m=+3.036734246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165035    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-system-cni-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165104    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7ce4001-40cb-4c97-97a3-e59a793880c9-konnectivity-ca\") pod \"konnectivity-agent-cm8kq\" (UID: \"c7ce4001-40cb-4c97-97a3-e59a793880c9\") " pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165119    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-registration-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7ce4001-40cb-4c97-97a3-e59a793880c9-agent-certs\") pod \"konnectivity-agent-cm8kq\" (UID: \"c7ce4001-40cb-4c97-97a3-e59a793880c9\") " pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.165176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165202    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-host\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165208    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6b9268f-a010-415e-8c68-964fed87830f-host\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165200    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" event={"ID":"691e52ad59e0d902715180e32ae604d0","Type":"ContainerStarted","Data":"1d35ce0c9d284e111b25dbe82a01ca78198e8ea5780780f75298af432fe5c3f3"}
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-run\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165279    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-run\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-conf-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165318    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-kubelet-config\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vnqz\" (UniqueName: \"kubernetes.io/projected/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-kube-api-access-6vnqz\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165402    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165403    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/000b8b07-ebc7-466c-a66a-41d4d57fbc90-hosts-file\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165445    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-conf-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165483    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-etc-kubernetes\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165498    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-registration-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165504    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-cnibin\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cnibin\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165503    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysconfig\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.165965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-k8s-cni-cncf-io\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-sys-fs\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysctl-conf\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-systemd\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-device-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165738    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-dbus\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165805    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cnibin\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165813    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-sys-fs\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-var-lib-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165858    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysconfig\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165873    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovnkube-config\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovn-node-metrics-cert\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165930    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-k8s-cni-cncf-io\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.165960    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-os-release\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166043    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166061    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-cni-dir\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166105    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-socket-dir-parent\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.166925 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166126    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-cni-multus\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166129    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysctl-conf\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-slash\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166161    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-device-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166169    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aedc5c1-65fc-44b6-bb08-5f72641fed58-os-release\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166190    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-systemd\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166229    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-var-lib-kubelet\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-systemd-units\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166301    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-var-lib-kubelet\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166352    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-cni-multus\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-env-overrides\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zk7m\" (UniqueName: \"kubernetes.io/projected/000b8b07-ebc7-466c-a66a-41d4d57fbc90-kube-api-access-8zk7m\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-daemon-config\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166490    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-kubernetes\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166580    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-kubernetes\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730f1e3e-919e-48e8-8f21-f509efd3e6ac-tmp\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.167787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166633    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166702    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/000b8b07-ebc7-466c-a66a-41d4d57fbc90-tmp-dir\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f6b9268f-a010-415e-8c68-964fed87830f-serviceca\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166850    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h84bp\" (UniqueName: \"kubernetes.io/projected/f6b9268f-a010-415e-8c68-964fed87830f-kube-api-access-h84bp\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-modprobe-d\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysctl-d\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-os-release\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166961    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.166988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-host-slash\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167009    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-multus-daemon-config\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-cni-bin\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167061    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-cni-bin\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167068    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-kubelet\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167113    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-run-netns\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167139    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-systemd\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.168692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167163    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-node-log\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-log-socket\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167214    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-cni-bin\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167225    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f6b9268f-a010-415e-8c68-964fed87830f-serviceca\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-cni-netd\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167342    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-kubelet\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-socket-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167406    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-sysctl-d\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167407    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-modprobe-d\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkk5f\" (UniqueName: \"kubernetes.io/projected/3cf36feb-7387-4944-a64c-6d2019419686-kube-api-access-pkk5f\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167449    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167457    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-iptables-alerter-script\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-etc-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167516    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-os-release\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-ovn\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167555    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-var-lib-kubelet\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.169646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167568    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167657    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3cf36feb-7387-4944-a64c-6d2019419686-socket-dir\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-sys\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-cni-binary-copy\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-netns\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-hostroot\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167827    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-multus-certs\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167856    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njkqg\" (UniqueName: \"kubernetes.io/projected/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-kube-api-access-njkqg\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdd6\" (UniqueName: \"kubernetes.io/projected/4aedc5c1-65fc-44b6-bb08-5f72641fed58-kube-api-access-gqdd6\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.168205    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-netns\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.168218    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.168255    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-host-run-multus-certs\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.168280    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-hostroot\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.167854    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aedc5c1-65fc-44b6-bb08-5f72641fed58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.168431    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/730f1e3e-919e-48e8-8f21-f509efd3e6ac-sys\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.168506    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-cni-binary-copy\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.170517 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.170197    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/730f1e3e-919e-48e8-8f21-f509efd3e6ac-etc-tuned\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.171280 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.170813    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730f1e3e-919e-48e8-8f21-f509efd3e6ac-tmp\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.171430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.171408    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7ce4001-40cb-4c97-97a3-e59a793880c9-agent-certs\") pod \"konnectivity-agent-cm8kq\" (UID: \"c7ce4001-40cb-4c97-97a3-e59a793880c9\") " pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.183216 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.183155    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkk5f\" (UniqueName: \"kubernetes.io/projected/3cf36feb-7387-4944-a64c-6d2019419686-kube-api-access-pkk5f\") pod \"aws-ebs-csi-driver-node-vpfbw\" (UID: \"3cf36feb-7387-4944-a64c-6d2019419686\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.183362 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.183163    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xrm2\" (UniqueName: \"kubernetes.io/projected/730f1e3e-919e-48e8-8f21-f509efd3e6ac-kube-api-access-5xrm2\") pod \"tuned-ss55l\" (UID: \"730f1e3e-919e-48e8-8f21-f509efd3e6ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.184079 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.184050    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkqg\" (UniqueName: \"kubernetes.io/projected/5b1fd3d8-64b4-4d0d-9a69-02b8a382f808-kube-api-access-njkqg\") pod \"multus-mm6g4\" (UID: \"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808\") " pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.184079 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.184066    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq89h\" (UniqueName: \"kubernetes.io/projected/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-kube-api-access-mq89h\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.184280 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.184252    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdd6\" (UniqueName: \"kubernetes.io/projected/4aedc5c1-65fc-44b6-bb08-5f72641fed58-kube-api-access-gqdd6\") pod \"multus-additional-cni-plugins-j6dzp\" (UID: \"4aedc5c1-65fc-44b6-bb08-5f72641fed58\") " pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.186118 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.186060    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h84bp\" (UniqueName: \"kubernetes.io/projected/f6b9268f-a010-415e-8c68-964fed87830f-kube-api-access-h84bp\") pod \"node-ca-t8k6f\" (UID: \"f6b9268f-a010-415e-8c68-964fed87830f\") " pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.268523 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovnkube-script-lib\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.268523 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.268785 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w788h\" (UniqueName: \"kubernetes.io/projected/bdc38945-c0fb-4101-9d4f-dae67eb2552f-kube-api-access-w788h\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.268785 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.268657    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:18.268785 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.268736    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:18.768715548 +0000 UTC m=+3.140470255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:18.269003 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269003 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-kubelet-config\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.269003 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vnqz\" (UniqueName: \"kubernetes.io/projected/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-kube-api-access-6vnqz\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.269003 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/000b8b07-ebc7-466c-a66a-41d4d57fbc90-hosts-file\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.269003 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-dbus\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269016    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-kubelet-config\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269017    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-var-lib-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269054    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-var-lib-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269064    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovnkube-config\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269090    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovn-node-metrics-cert\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-slash\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-systemd-units\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-env-overrides\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zk7m\" (UniqueName: \"kubernetes.io/projected/000b8b07-ebc7-466c-a66a-41d4d57fbc90-kube-api-access-8zk7m\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269230    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovnkube-script-lib\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.268959    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.269274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/000b8b07-ebc7-466c-a66a-41d4d57fbc90-tmp-dir\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269316    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/000b8b07-ebc7-466c-a66a-41d4d57fbc90-hosts-file\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269385    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-dbus\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269439    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-systemd-units\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269714    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-slash\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269739    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/000b8b07-ebc7-466c-a66a-41d4d57fbc90-tmp-dir\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269766    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-host-slash\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269858    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-kubelet\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-run-netns\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269911    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-systemd\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-node-log\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269965    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-log-socket\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-cni-bin\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270001    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-host-slash\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270016    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-cni-netd\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270035    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-node-log\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-iptables-alerter-script\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270053    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-run-netns\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.269960    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-kubelet\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270090    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-systemd\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270114    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-log-socket\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270126    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-etc-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270141    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-cni-bin\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-ovn\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270165    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-cni-netd\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270196    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovnkube-config\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270209    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdc38945-c0fb-4101-9d4f-dae67eb2552f-env-overrides\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270213    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-etc-openvswitch\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270262    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-run-ovn\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270304    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdc38945-c0fb-4101-9d4f-dae67eb2552f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.270834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.270647    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-iptables-alerter-script\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.272467 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.272446    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdc38945-c0fb-4101-9d4f-dae67eb2552f-ovn-node-metrics-cert\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.281507 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.281472    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:18.281670 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.281519    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:18.281670 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.281535    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:18.281670 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.281639    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:18.781618617 +0000 UTC m=+3.153373321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:18.283951 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.283926    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w788h\" (UniqueName: \"kubernetes.io/projected/bdc38945-c0fb-4101-9d4f-dae67eb2552f-kube-api-access-w788h\") pod \"ovnkube-node-lklf2\" (UID: \"bdc38945-c0fb-4101-9d4f-dae67eb2552f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.284133 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.284114    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zk7m\" (UniqueName: \"kubernetes.io/projected/000b8b07-ebc7-466c-a66a-41d4d57fbc90-kube-api-access-8zk7m\") pod \"node-resolver-jghjq\" (UID: \"000b8b07-ebc7-466c-a66a-41d4d57fbc90\") " pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.284201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.284140    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vnqz\" (UniqueName: \"kubernetes.io/projected/c28c100a-dd34-4e55-a5dd-6958d84a3fdd-kube-api-access-6vnqz\") pod \"iptables-alerter-2vdlv\" (UID: \"c28c100a-dd34-4e55-a5dd-6958d84a3fdd\") " pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.356276 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.356238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:18.366201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.366176    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j6dzp"
Jul 02 19:02:18.377424 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.377392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8k6f"
Jul 02 19:02:18.382664 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.382641    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ss55l"
Jul 02 19:02:18.401758 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.401731    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mm6g4"
Jul 02 19:02:18.410880 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.410859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw"
Jul 02 19:02:18.421933 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.421904    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vdlv"
Jul 02 19:02:18.429096 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.429069    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:18.435168 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.435132    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jghjq"
Jul 02 19:02:18.674462 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.674374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:18.674677 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.674514    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:18.674677 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.674582    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.674564307 +0000 UTC m=+4.046319008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:18.775390 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.775357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:18.775616 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.775511    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:18.775616 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.775608    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.775590366 +0000 UTC m=+4.147345067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:18.876332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:18.876274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:18.876549 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.876473    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:18.876549 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.876496    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:18.876549 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.876513    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:18.876692 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:18.876599    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.876576823 +0000 UTC m=+4.248331549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:19.104568 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:19.104520    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:57:18 +0000 UTC" deadline="2028-04-02 05:53:40.74173301 +0000 UTC"
Jul 02 19:02:19.104568 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:19.104560    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15346h51m21.637178512s"
Jul 02 19:02:19.424773 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.424748    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1fd3d8_64b4_4d0d_9a69_02b8a382f808.slice/crio-dd8475c4ea5a6cf2f21b66f81c42c8b1271c2bfbda42fe567677b3d8b3bb1534 WatchSource:0}: Error finding container dd8475c4ea5a6cf2f21b66f81c42c8b1271c2bfbda42fe567677b3d8b3bb1534: Status 404 returned error can't find the container with id dd8475c4ea5a6cf2f21b66f81c42c8b1271c2bfbda42fe567677b3d8b3bb1534
Jul 02 19:02:19.426448 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.426421    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730f1e3e_919e_48e8_8f21_f509efd3e6ac.slice/crio-6ce3bb6b6173e491b1b543f9952fe06721e29fb8fa3cf5ca627d792a544ed6c3 WatchSource:0}: Error finding container 6ce3bb6b6173e491b1b543f9952fe06721e29fb8fa3cf5ca627d792a544ed6c3: Status 404 returned error can't find the container with id 6ce3bb6b6173e491b1b543f9952fe06721e29fb8fa3cf5ca627d792a544ed6c3
Jul 02 19:02:19.431708 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.431681    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aedc5c1_65fc_44b6_bb08_5f72641fed58.slice/crio-188d5b8cea9ca1c9fbbc1342e6bcb86b7b195e5d368e391dd2d39308b37d6bd8 WatchSource:0}: Error finding container 188d5b8cea9ca1c9fbbc1342e6bcb86b7b195e5d368e391dd2d39308b37d6bd8: Status 404 returned error can't find the container with id 188d5b8cea9ca1c9fbbc1342e6bcb86b7b195e5d368e391dd2d39308b37d6bd8
Jul 02 19:02:19.433931 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.433417    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf36feb_7387_4944_a64c_6d2019419686.slice/crio-dfd7ded500984ce3aa04fb07549adf4d3ffd19c6598f5436109606f4a4a0d264 WatchSource:0}: Error finding container dfd7ded500984ce3aa04fb07549adf4d3ffd19c6598f5436109606f4a4a0d264: Status 404 returned error can't find the container with id dfd7ded500984ce3aa04fb07549adf4d3ffd19c6598f5436109606f4a4a0d264
Jul 02 19:02:19.435678 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.434756    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc38945_c0fb_4101_9d4f_dae67eb2552f.slice/crio-620807deb948bd700c49de7baadb9f0d537f6682208f07c893c4db0944ca76da WatchSource:0}: Error finding container 620807deb948bd700c49de7baadb9f0d537f6682208f07c893c4db0944ca76da: Status 404 returned error can't find the container with id 620807deb948bd700c49de7baadb9f0d537f6682208f07c893c4db0944ca76da
Jul 02 19:02:19.436487 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.436263    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b9268f_a010_415e_8c68_964fed87830f.slice/crio-b4818df940201ae2b7850578100d2d4550040900edaf014dd4054b4468ec7d46 WatchSource:0}: Error finding container b4818df940201ae2b7850578100d2d4550040900edaf014dd4054b4468ec7d46: Status 404 returned error can't find the container with id b4818df940201ae2b7850578100d2d4550040900edaf014dd4054b4468ec7d46
Jul 02 19:02:19.438484 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.438463    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000b8b07_ebc7_466c_a66a_41d4d57fbc90.slice/crio-ec8540741df5923eaa7f2cbe3d6ad7cfb403bacedc7b44e7c4279031e30cd6f8 WatchSource:0}: Error finding container ec8540741df5923eaa7f2cbe3d6ad7cfb403bacedc7b44e7c4279031e30cd6f8: Status 404 returned error can't find the container with id ec8540741df5923eaa7f2cbe3d6ad7cfb403bacedc7b44e7c4279031e30cd6f8
Jul 02 19:02:19.443440 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:19.443277    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ce4001_40cb_4c97_97a3_e59a793880c9.slice/crio-85211e7526e373829ff43eeb06b4f9b6eebc6b14e623581def9514ddc0a5ad6f WatchSource:0}: Error finding container 85211e7526e373829ff43eeb06b4f9b6eebc6b14e623581def9514ddc0a5ad6f: Status 404 returned error can't find the container with id 85211e7526e373829ff43eeb06b4f9b6eebc6b14e623581def9514ddc0a5ad6f
Jul 02 19:02:19.683553 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:19.683286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:19.683553 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.683445    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:19.683764 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.683573    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:02:21.683557023 +0000 UTC m=+6.055311724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:19.784451 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:19.784418    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:19.784599 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.784577    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:19.784658 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.784648    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:21.784632984 +0000 UTC m=+6.156387692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:19.885267 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:19.885227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:19.885430 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.885397    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:19.885430 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.885417    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:19.885430 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.885428    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:19.885532 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:19.885483    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:21.885469426 +0000 UTC m=+6.257224128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:20.104959 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.104892    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:57:18 +0000 UTC" deadline="2028-03-24 01:39:18.916719268 +0000 UTC"
Jul 02 19:02:20.104959 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.104952    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15126h36m58.811770543s"
Jul 02 19:02:20.156666 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.156621    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:20.156904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.156636    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:20.156904 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:20.156767    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:20.156904 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:20.156871    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:20.157099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.156943    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:20.157099 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:20.157023    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:20.171647 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.171609    2572 generic.go:356] "Generic (PLEG): container finished" podID="ffa3c5b08f070591b622327619791d72" containerID="fac1cbe25c206242965c96fcfea51474a5748a742c1f0dfaf02e3231ee73b426" exitCode=0
Jul 02 19:02:20.171822 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.171703    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"ffa3c5b08f070591b622327619791d72","Type":"ContainerDied","Data":"fac1cbe25c206242965c96fcfea51474a5748a742c1f0dfaf02e3231ee73b426"}
Jul 02 19:02:20.174008 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.173980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cm8kq" event={"ID":"c7ce4001-40cb-4c97-97a3-e59a793880c9","Type":"ContainerStarted","Data":"85211e7526e373829ff43eeb06b4f9b6eebc6b14e623581def9514ddc0a5ad6f"}
Jul 02 19:02:20.175454 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.175421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vdlv" event={"ID":"c28c100a-dd34-4e55-a5dd-6958d84a3fdd","Type":"ContainerStarted","Data":"0da0221ac94b5a01d32910b3bbf96f79fdb051d964ed72062c6256c9ef97ebe3"}
Jul 02 19:02:20.176661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.176632    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jghjq" event={"ID":"000b8b07-ebc7-466c-a66a-41d4d57fbc90","Type":"ContainerStarted","Data":"ec8540741df5923eaa7f2cbe3d6ad7cfb403bacedc7b44e7c4279031e30cd6f8"}
Jul 02 19:02:20.177948 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.177917    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"620807deb948bd700c49de7baadb9f0d537f6682208f07c893c4db0944ca76da"}
Jul 02 19:02:20.179181 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.179160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw" event={"ID":"3cf36feb-7387-4944-a64c-6d2019419686","Type":"ContainerStarted","Data":"dfd7ded500984ce3aa04fb07549adf4d3ffd19c6598f5436109606f4a4a0d264"}
Jul 02 19:02:20.180402 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.180378    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerStarted","Data":"188d5b8cea9ca1c9fbbc1342e6bcb86b7b195e5d368e391dd2d39308b37d6bd8"}
Jul 02 19:02:20.181819 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.181791    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" event={"ID":"691e52ad59e0d902715180e32ae604d0","Type":"ContainerStarted","Data":"a087c62217102ba349c37e3b3a93354b4efff771246566f702b6f72d630b6539"}
Jul 02 19:02:20.183245 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.183216    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8k6f" event={"ID":"f6b9268f-a010-415e-8c68-964fed87830f","Type":"ContainerStarted","Data":"b4818df940201ae2b7850578100d2d4550040900edaf014dd4054b4468ec7d46"}
Jul 02 19:02:20.184582 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.184554    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ss55l" event={"ID":"730f1e3e-919e-48e8-8f21-f509efd3e6ac","Type":"ContainerStarted","Data":"6ce3bb6b6173e491b1b543f9952fe06721e29fb8fa3cf5ca627d792a544ed6c3"}
Jul 02 19:02:20.185801 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.185775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mm6g4" event={"ID":"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808","Type":"ContainerStarted","Data":"dd8475c4ea5a6cf2f21b66f81c42c8b1271c2bfbda42fe567677b3d8b3bb1534"}
Jul 02 19:02:20.201985 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:20.201761    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" podStartSLOduration=3.201719217 podStartE2EDuration="3.201719217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:20.201714154 +0000 UTC m=+4.573468883" watchObservedRunningTime="2026-07-02 19:02:20.201719217 +0000 UTC m=+4.573473943"
Jul 02 19:02:21.198012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:21.197919    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"ffa3c5b08f070591b622327619791d72","Type":"ContainerStarted","Data":"8b8dc7d1287f554b319461cffdbb0859f133a607e17225acdc5c3146806f5342"}
Jul 02 19:02:21.699651 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:21.699599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:21.699855 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.699748    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:21.699855 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.699818    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:02:25.699798388 +0000 UTC m=+10.071553090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:21.800630 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:21.800591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:21.800831 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.800805    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:21.800922 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.800894    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:25.800874747 +0000 UTC m=+10.172629453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:21.901612 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:21.901562    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:21.901809 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.901791    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:21.901907 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.901815    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:21.901907 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.901830    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:21.902032 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:21.901918    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:25.901898369 +0000 UTC m=+10.273653070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:22.156972 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:22.156935    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:22.156972 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:22.156954    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:22.157240 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:22.157089    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:22.157240 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:22.157109    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:22.157353 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:22.157233    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:22.157409 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:22.157347    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:24.156106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:24.156045    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:24.156106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:24.156073    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:24.156594 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:24.156177    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:24.156594 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:24.156264    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:24.156594 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:24.156304    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:24.156594 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:24.156402    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:25.730058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:25.729994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:25.730501 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.730164    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:25.730501 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.730238    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:02:33.730217253 +0000 UTC m=+18.101971972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:25.831000 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:25.830772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:25.831000 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.830955    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:25.831229 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.831022    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:33.831004595 +0000 UTC m=+18.202759312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:25.931958 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:25.931916    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:25.932139 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.932108    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:25.932139 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.932132    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:25.932272 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.932146    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:25.932272 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:25.932215    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:33.932194929 +0000 UTC m=+18.303949632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:26.157280 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:26.157189    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:26.157437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:26.157289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:26.157437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:26.157316    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:26.157437 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:26.157331    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:26.157437 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:26.157388    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:26.157624 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:26.157458    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:28.156988 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:28.156950    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:28.157456 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:28.156963    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:28.157456 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:28.157106    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:28.157456 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:28.157228    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:28.157456 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:28.157296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:28.157456 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:28.157370    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:30.156916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.156601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:30.156916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.156601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:30.156916 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:30.156729    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:30.156916 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:30.156835    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:30.156916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.156881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:30.157495 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:30.156947    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:30.231251 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.231217    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cm8kq" event={"ID":"c7ce4001-40cb-4c97-97a3-e59a793880c9","Type":"ContainerStarted","Data":"78f6e44113426b69d3987f1b0762a9bc197effbd07e00c663e9ed74675364605"}
Jul 02 19:02:30.237818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.237773    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw" event={"ID":"3cf36feb-7387-4944-a64c-6d2019419686","Type":"ContainerStarted","Data":"c6c498b702eabaa301e11370559569cd146d2717e036821601b78858983b2fe0"}
Jul 02 19:02:30.245912 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.245873    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" podStartSLOduration=13.245854616 podStartE2EDuration="13.245854616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:21.214231691 +0000 UTC m=+5.585986419" watchObservedRunningTime="2026-07-02 19:02:30.245854616 +0000 UTC m=+14.617609339"
Jul 02 19:02:30.246253 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.246220    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cm8kq" podStartSLOduration=3.9054350639999997 podStartE2EDuration="14.246205349s" totalImagesPullingTime="10.340770285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:30.245409768 +0000 UTC m=+14.617164492" watchObservedRunningTime="2026-07-02 19:02:30.246205349 +0000 UTC m=+14.617960068"
Jul 02 19:02:30.831866 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.831766    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:30.832938 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:30.832670    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:31.241818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.241765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jghjq" event={"ID":"000b8b07-ebc7-466c-a66a-41d4d57fbc90","Type":"ContainerStarted","Data":"dabb24a3407610fb625bd5656245c290006f71917cc6d8ceab9bf1da2fef8f7a"}
Jul 02 19:02:31.244436 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.244401    2572 generic.go:356] "Generic (PLEG): container finished" podID="4aedc5c1-65fc-44b6-bb08-5f72641fed58" containerID="a71a1525bcf735a40a6dfadff44b30e795f042f566f49b4b3a719c32e59df3dc" exitCode=0
Jul 02 19:02:31.244569 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.244492    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerDied","Data":"a71a1525bcf735a40a6dfadff44b30e795f042f566f49b4b3a719c32e59df3dc"}
Jul 02 19:02:31.247666 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.247621    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8k6f" event={"ID":"f6b9268f-a010-415e-8c68-964fed87830f","Type":"ContainerStarted","Data":"cda9d671e92521f206083f9a6ba52b7eb8f5d4034caea159db4fae86f0ecd929"}
Jul 02 19:02:31.250468 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.250418    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ss55l" event={"ID":"730f1e3e-919e-48e8-8f21-f509efd3e6ac","Type":"ContainerStarted","Data":"b3cd9756f4740338a6df223111899929dec7125676261122144d70573376e028"}
Jul 02 19:02:31.257841 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.257780    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jghjq" podStartSLOduration=3.72538502 podStartE2EDuration="14.257763219s" totalImagesPullingTime="10.532378199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:31.2570997 +0000 UTC m=+15.628854420" watchObservedRunningTime="2026-07-02 19:02:31.257763219 +0000 UTC m=+15.629517944"
Jul 02 19:02:31.297305 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:31.297252    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t8k6f" podStartSLOduration=4.765020332 podStartE2EDuration="15.297231348s" totalImagesPullingTime="10.532211016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:31.29690181 +0000 UTC m=+15.668656532" watchObservedRunningTime="2026-07-02 19:02:31.297231348 +0000 UTC m=+15.668986071"
Jul 02 19:02:32.156199 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.156168    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:32.156376 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.156168    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:32.156376 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:32.156307    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:32.156376 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.156180    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:32.156532 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:32.156418    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:32.156532 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:32.156500    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:32.254261 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.254175    2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 19:02:32.254261 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.254193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vdlv" event={"ID":"c28c100a-dd34-4e55-a5dd-6958d84a3fdd","Type":"ContainerStarted","Data":"e224ba3c36d4a887ae56f41933ee934cdd10de115cb067b3a480d6616183a56d"}
Jul 02 19:02:32.268843 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.268781    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2vdlv" podStartSLOduration=5.737588619 podStartE2EDuration="16.268767172s" totalImagesPullingTime="10.531178553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:32.268743399 +0000 UTC m=+16.640498118" watchObservedRunningTime="2026-07-02 19:02:32.268767172 +0000 UTC m=+16.640521895"
Jul 02 19:02:32.269076 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:32.269049    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ss55l" podStartSLOduration=5.709150646 podStartE2EDuration="16.269040433s" totalImagesPullingTime="10.559889787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:31.31416188 +0000 UTC m=+15.685916639" watchObservedRunningTime="2026-07-02 19:02:32.269040433 +0000 UTC m=+16.640795195"
Jul 02 19:02:33.795433 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:33.795402    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:33.795992 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.795520    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:33.795992 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.795571    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:02:49.795558207 +0000 UTC m=+34.167312908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:33.896203 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:33.896162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:33.896361 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.896347    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:33.896420 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.896410    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:49.896394474 +0000 UTC m=+34.268149173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:33.996614 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:33.996586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:33.996778 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.996758    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:33.996848 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.996783    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:33.996848 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.996798    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:33.996908 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:33.996873    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:49.996858496 +0000 UTC m=+34.368613195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:34.157008 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:34.156916    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:34.157162 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:34.156923    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:34.157162 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:34.157058    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:34.157162 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:34.156926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:34.157162 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:34.157139    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:34.157368 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:34.157190    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:36.157024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:36.156986    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:36.157782 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:36.157083    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:36.157782 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:36.157165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:36.157782 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:36.157197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:36.157782 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:36.157278    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:36.157782 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:36.157358    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:38.156282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:38.156240    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:38.156833 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:38.156251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:38.156833 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:38.156405    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:38.156833 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:38.156473    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:38.156833 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:38.156600    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:38.156833 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:38.156691    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:39.556548 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:39.556349    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:02:40.156421 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.156389    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:40.156621 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.156391    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:40.156621 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.156389    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:40.156621 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:40.156566    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:40.156764 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:40.156655    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:40.156764 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:40.156727    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:40.255334 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.255241    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:02:39.556535556Z","UUID":"0b03b643-f7ed-4946-afe0-1eae7bc78af6","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:02:40.256961 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.256934    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:02:40.257092 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.256971    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:02:40.272326 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.272301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"5707c7818648b8122eac251185284858a90a7ba9a4b32c0f045abd2f198ce3b8"}
Jul 02 19:02:40.272487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.272400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"a6981c928b5a5adcb4c2a61bd3b960c1c29fbb355b55b4461382487748cd4b1b"}
Jul 02 19:02:40.272487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.272450    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"9cae9bf09412b8e58b5b698b06a00280643863045b29f67f26afb5fec3021297"}
Jul 02 19:02:40.272610 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.272494    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"5ecd96d2c719f53642bc0f733b055f017dd82366f2b7673f73d03a186583dd26"}
Jul 02 19:02:40.272610 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.272542    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"e01db8d0b373822af2430a9e84604be6b5317a94812a4a0c66d0c3bb1ddc8bdc"}
Jul 02 19:02:40.272610 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.272589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"b49aeae9dea3ce9cb57aab609ac97d821b27839e007c2ca37a2a6e3686b9725c"}
Jul 02 19:02:40.274401 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.274369    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw" event={"ID":"3cf36feb-7387-4944-a64c-6d2019419686","Type":"ContainerStarted","Data":"94f54dcd7f8b2989b912f4959c80697eb112b9c11e79b6dad064c856bff4e183"}
Jul 02 19:02:40.276089 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.276063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mm6g4" event={"ID":"5b1fd3d8-64b4-4d0d-9a69-02b8a382f808","Type":"ContainerStarted","Data":"1922fa7bf1f17b444b83e3d66ca7ef3cf4419d9fc5cd320f865e98752bb76edc"}
Jul 02 19:02:40.299138 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:40.299093    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mm6g4" podStartSLOduration=4.247769315 podStartE2EDuration="24.299079541s" totalImagesPullingTime="20.051310226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:40.299036323 +0000 UTC m=+24.670791045" watchObservedRunningTime="2026-07-02 19:02:40.299079541 +0000 UTC m=+24.670834264"
Jul 02 19:02:41.280364 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:41.280286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw" event={"ID":"3cf36feb-7387-4944-a64c-6d2019419686","Type":"ContainerStarted","Data":"ef0f6b2d1674833ded18fc7db84acd85a605a698d17a6b5c82ce6ce48fc7a89d"}
Jul 02 19:02:41.297144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:41.297097    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpfbw" podStartSLOduration=4.125788469 podStartE2EDuration="25.297081565s" totalImagesPullingTime="21.171293096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:41.297032976 +0000 UTC m=+25.668787697" watchObservedRunningTime="2026-07-02 19:02:41.297081565 +0000 UTC m=+25.668836287"
Jul 02 19:02:41.903556 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:41.903518    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:41.903730 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:41.903688    2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 19:02:41.904233 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:41.904215    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cm8kq"
Jul 02 19:02:42.156423 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:42.156341    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:42.156423 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:42.156374    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:42.156640 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:42.156341    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:42.156640 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:42.156463    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:42.156640 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:42.156552    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:42.156772 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:42.156642    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:42.286619 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:42.286585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"4e22f851a4d81c39edbb31d1208c16892a9c95575f6996ab7b46238bf4695b17"}
Jul 02 19:02:44.155982 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.155944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:44.156562 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.155958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:44.156562 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:44.156085    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:44.156562 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.155958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:44.156562 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:44.156153    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:44.156562 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:44.156219    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:44.295539 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.295503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" event={"ID":"bdc38945-c0fb-4101-9d4f-dae67eb2552f","Type":"ContainerStarted","Data":"38545198158fa734065eee97e1acdc96d9dde41c6261047a69df893187419a93"}
Jul 02 19:02:44.295872 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.295847    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:44.296015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.295934    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:44.313813 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.313772    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:44.322940 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:44.322884    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2" podStartSLOduration=7.263884805 podStartE2EDuration="27.32285944s" totalImagesPullingTime="20.058974635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:44.322460645 +0000 UTC m=+28.694215366" watchObservedRunningTime="2026-07-02 19:02:44.32285944 +0000 UTC m=+28.694614223"
Jul 02 19:02:45.298035 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:45.298004    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:45.314511 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:45.314485    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:02:46.157233 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.157200    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:46.157409 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:46.157291    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:46.157409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.157316    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:46.157409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.157340    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:46.157542 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:46.157416    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:46.157542 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:46.157486    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:46.265575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.265551    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jc67t"]
Jul 02 19:02:46.268501 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.268474    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cd9wj"]
Jul 02 19:02:46.269139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.269120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-24bgr"]
Jul 02 19:02:46.302264 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.302238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:46.302762 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.302304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerStarted","Data":"0d39b35a57fa23e5faeec4dd3808bfe007dbcf5aad0c2e6686a57051ebcdad9f"}
Jul 02 19:02:46.302762 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.302333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:46.302762 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:46.302476    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:46.302957 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:46.302888    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:46.302957 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:46.302917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:46.303061 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:46.302996    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:47.305612 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:47.305582    2572 generic.go:356] "Generic (PLEG): container finished" podID="4aedc5c1-65fc-44b6-bb08-5f72641fed58" containerID="0d39b35a57fa23e5faeec4dd3808bfe007dbcf5aad0c2e6686a57051ebcdad9f" exitCode=0
Jul 02 19:02:47.306065 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:47.305676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerDied","Data":"0d39b35a57fa23e5faeec4dd3808bfe007dbcf5aad0c2e6686a57051ebcdad9f"}
Jul 02 19:02:48.156617 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:48.156076    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:48.156617 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:48.156126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:48.156617 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:48.156216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:48.156617 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:48.156229    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:48.156617 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:48.156336    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:48.156617 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:48.156450    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:48.309991 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:48.309962    2572 generic.go:356] "Generic (PLEG): container finished" podID="4aedc5c1-65fc-44b6-bb08-5f72641fed58" containerID="29105b5f377d2f01c087c8ccf68cdac7db079024acb544d244ae7f79cceb6d77" exitCode=0
Jul 02 19:02:48.310282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:48.310022    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerDied","Data":"29105b5f377d2f01c087c8ccf68cdac7db079024acb544d244ae7f79cceb6d77"}
Jul 02 19:02:49.314692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:49.314495    2572 generic.go:356] "Generic (PLEG): container finished" podID="4aedc5c1-65fc-44b6-bb08-5f72641fed58" containerID="8ce918d4005dbf07bbaa9a6606ef92019dc29853dde90000625e0a8bd4f1494a" exitCode=0
Jul 02 19:02:49.314692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:49.314568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerDied","Data":"8ce918d4005dbf07bbaa9a6606ef92019dc29853dde90000625e0a8bd4f1494a"}
Jul 02 19:02:49.815528 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:49.815492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:49.815719 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:49.815650    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:49.815790 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:49.815725    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs podName:03c2b116-1d0c-4b5a-ab9f-0c601e7236dc nodeName:}" failed. No retries permitted until 2026-07-02 19:03:21.815706326 +0000 UTC m=+66.187461026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs") pod "network-metrics-daemon-24bgr" (UID: "03c2b116-1d0c-4b5a-ab9f-0c601e7236dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:02:49.915863 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:49.915834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:49.916012 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:49.915951    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:49.916012 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:49.916000    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret podName:d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:21.915987717 +0000 UTC m=+66.287742416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret") pod "global-pull-secret-syncer-jc67t" (UID: "d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:02:50.016818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:50.016764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:50.016976 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.016959    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:02:50.017027 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.016984    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:02:50.017027 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.016998    2572 projected.go:196] Error preparing data for projected volume kube-api-access-mn7xs for pod openshift-network-diagnostics/network-check-target-cd9wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:50.017106 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.017062    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs podName:42ea740d-3c4e-4852-b934-3ea52c5fdf05 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:22.01704421 +0000 UTC m=+66.388798925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn7xs" (UniqueName: "kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs") pod "network-check-target-cd9wj" (UID: "42ea740d-3c4e-4852-b934-3ea52c5fdf05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:02:50.156782 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:50.156749    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:50.156970 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:50.156749    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:50.156970 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:50.156896    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:50.156970 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.156910    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:50.157138 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.156994    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:50.157138 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:50.157083    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:52.158784 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.158698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:52.159133 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.158816    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:52.159133 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.158828    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jc67t" podUID="d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19"
Jul 02 19:02:52.159133 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.158841    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:52.159133 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.158904    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd9wj" podUID="42ea740d-3c4e-4852-b934-3ea52c5fdf05"
Jul 02 19:02:52.159133 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.158971    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-24bgr" podUID="03c2b116-1d0c-4b5a-ab9f-0c601e7236dc"
Jul 02 19:02:52.401882 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.401843    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeReady"
Jul 02 19:02:52.402036 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.402008    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:02:52.436682 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.436600    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-5dhf8"]
Jul 02 19:02:52.438891 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.438871    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.441829 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.441722    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 19:02:52.441829 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.441785    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 19:02:52.441829 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.441822    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.442075 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.441959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58bdcd677c-j6jt7"]
Jul 02 19:02:52.442075 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.441988    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-n8kdn\""
Jul 02 19:02:52.442174 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.442109    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.444457 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.444384    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.450006 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.449981    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 19:02:52.453364 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.450227    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 19:02:52.453364 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.450537    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 19:02:52.453364 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.450595    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 19:02:52.453364 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.451553    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-5dhf8"]
Jul 02 19:02:52.454155 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.454123    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k9mwx\""
Jul 02 19:02:52.456916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.456896    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"]
Jul 02 19:02:52.458878 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.458856    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 19:02:52.459589 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.459561    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"]
Jul 02 19:02:52.459701 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.459682    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.462072 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.462031    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"
Jul 02 19:02:52.462668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.462651    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.463000 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.462959    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wtwcl\""
Jul 02 19:02:52.463000 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.462974    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 19:02:52.463201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.463034    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 19:02:52.463280 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.463241    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.463710 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.463691    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58bdcd677c-j6jt7"]
Jul 02 19:02:52.464092 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.464073    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.464206 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.464192    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-j5xgn\""
Jul 02 19:02:52.464370 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.464350    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.469860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.469790    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"]
Jul 02 19:02:52.472932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.472910    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"]
Jul 02 19:02:52.475689 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.475671    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"]
Jul 02 19:02:52.480739 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.480720    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5db59696f7-89w6b"]
Jul 02 19:02:52.480868 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.480851    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.482976 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.482960    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-78fgq\""
Jul 02 19:02:52.483105 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.483084    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 19:02:52.483383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.483365    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tkh4n"]
Jul 02 19:02:52.483467 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.483396    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 19:02:52.483467 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.483458    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.483648 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.483632    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.484212 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.484191    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.486148 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486101    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 19:02:52.486284 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486133    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.486284 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486281    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bxd4g"]
Jul 02 19:02:52.486405 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486175    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 19:02:52.486456 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486217    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 19:02:52.486565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486549    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-44fkl\""
Jul 02 19:02:52.486620 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486610    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.486982 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486675    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.486982 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.486176    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 19:02:52.488971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.488947    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:02:52.488971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.488958    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:02:52.489225 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.489210    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g97vz\""
Jul 02 19:02:52.489632 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.489614    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"]
Jul 02 19:02:52.489744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.489727    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.491814 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.491787    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 19:02:52.492043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.492023    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 19:02:52.492224 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.492191    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p6pxx"]
Jul 02 19:02:52.492308 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.492267    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.492308 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.492269    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.492432 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.492416    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fxpdx\""
Jul 02 19:02:52.493694 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.493512    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.495577 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.495555    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"]
Jul 02 19:02:52.497313 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.497296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.501343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.499419    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sgk4h\""
Jul 02 19:02:52.501439 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.501424    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 19:02:52.502826 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.501874    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 19:02:52.502826 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.502524    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.502826 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.502632    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:02:52.504004 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.503162    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.504004 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.503261    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.504004 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.503373    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.504004 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.503733    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cf2kh\""
Jul 02 19:02:52.506546 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.506528    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"]
Jul 02 19:02:52.506748 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.506645    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:52.506927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.506904    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 19:02:52.508878 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.508825    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.509130 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.509099    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wwr8p\""
Jul 02 19:02:52.509343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.509325    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.509502 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.509484    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 19:02:52.510748 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.510728    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"]
Jul 02 19:02:52.510848 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.510763    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkh4n"]
Jul 02 19:02:52.510848 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.510788    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p6pxx"]
Jul 02 19:02:52.510980 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.510841    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bxd4g"]
Jul 02 19:02:52.511029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.511009    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"]
Jul 02 19:02:52.511029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.510955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"
Jul 02 19:02:52.511487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.511191    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"]
Jul 02 19:02:52.513018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.513002    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"]
Jul 02 19:02:52.514461 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.514441    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:02:52.514673 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.514619    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h8hdc\""
Jul 02 19:02:52.515054 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.515039    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:02:52.517620 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.517600    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5db59696f7-89w6b"]
Jul 02 19:02:52.532042 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-295gl\" (UniqueName: \"kubernetes.io/projected/dd82f036-a46e-4742-9c8d-3defed3cc338-kube-api-access-295gl\") pod \"volume-data-source-validator-5d456fdbcd-x4m7s\" (UID: \"dd82f036-a46e-4742-9c8d-3defed3cc338\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"
Jul 02 19:02:52.532145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-ca-trust-extracted\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532085    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.532145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f1cffd56-8726-47a1-9b35-51d2fa542c69-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.532307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-certificates\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2wjh\" (UniqueName: \"kubernetes.io/projected/f1cffd56-8726-47a1-9b35-51d2fa542c69-kube-api-access-f2wjh\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.532307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-tmp\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.532307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mbjz\" (UniqueName: \"kubernetes.io/projected/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-kube-api-access-5mbjz\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.532307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-trusted-ca\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532330    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532371    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-image-registry-private-configuration\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532424    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-snapshots\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532447    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-installation-pull-secrets\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-bound-sa-token\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532494    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-serving-cert\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.532537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532511    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntlhr\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-kube-api-access-ntlhr\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.532837 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.532561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.633226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.633226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633229    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsk76\" (UniqueName: \"kubernetes.io/projected/9be95b23-1b9e-4618-a1bd-c2e046daeafd-kube-api-access-hsk76\") pod \"ingress-canary-p6pxx\" (UID: \"9be95b23-1b9e-4618-a1bd-c2e046daeafd\") " pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.633474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-default-certificate\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.633474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.633474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvmnt\" (UniqueName: \"kubernetes.io/projected/2cccf563-ab49-48b6-9f72-d9508c8a04ce-kube-api-access-cvmnt\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.633474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/510cc5e4-74d7-4a78-b5ab-000cf3718710-tmp-dir\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.633474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-config\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.633474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4d7\" (UniqueName: \"kubernetes.io/projected/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-kube-api-access-lk4d7\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntlhr\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-kube-api-access-ntlhr\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633567    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633603    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-295gl\" (UniqueName: \"kubernetes.io/projected/dd82f036-a46e-4742-9c8d-3defed3cc338-kube-api-access-295gl\") pod \"volume-data-source-validator-5d456fdbcd-x4m7s\" (UID: \"dd82f036-a46e-4742-9c8d-3defed3cc338\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-ca-trust-extracted\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633657    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.633664    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.633680    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bdcd677c-j6jt7: secret "image-registry-tls" not found
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633684    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cccf563-ab49-48b6-9f72-d9508c8a04ce-serving-cert\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633709    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsghd\" (UniqueName: \"kubernetes.io/projected/45c43a6b-6053-47e2-81c9-4a01e8e22407-kube-api-access-tsghd\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.633731 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.633736    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls podName:22bda52b-381e-46b7-a2f0-52fa6ed85aa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:53.133716606 +0000 UTC m=+37.505471309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls") pod "image-registry-58bdcd677c-j6jt7" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0") : secret "image-registry-tls" not found
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-certificates\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/510cc5e4-74d7-4a78-b5ab-000cf3718710-config-volume\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633925    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-tmp\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.633990    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2cccf563-ab49-48b6-9f72-d9508c8a04ce-trusted-ca\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634061    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-ca-trust-extracted\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.634114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6mr8\" (UniqueName: \"kubernetes.io/projected/d3692552-803f-4f43-9405-4f8cd39fc29a-kube-api-access-k6mr8\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-image-registry-private-configuration\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634168    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cccf563-ab49-48b6-9f72-d9508c8a04ce-config\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45c43a6b-6053-47e2-81c9-4a01e8e22407-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634229    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-snapshots\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-bound-sa-token\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634260    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-tmp\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f1cffd56-8726-47a1-9b35-51d2fa542c69-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634298    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-serving-cert\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634342    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-installation-pull-secrets\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.634365 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634381    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-certificates\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45c43a6b-6053-47e2-81c9-4a01e8e22407-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.634487    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.634545    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls podName:f1cffd56-8726-47a1-9b35-51d2fa542c69 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:53.13452857 +0000 UTC m=+37.506283274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vtqvj" (UID: "f1cffd56-8726-47a1-9b35-51d2fa542c69") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634603    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9be95b23-1b9e-4618-a1bd-c2e046daeafd-cert\") pod \"ingress-canary-p6pxx\" (UID: \"9be95b23-1b9e-4618-a1bd-c2e046daeafd\") " pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2wjh\" (UniqueName: \"kubernetes.io/projected/f1cffd56-8726-47a1-9b35-51d2fa542c69-kube-api-access-f2wjh\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634673    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfcc\" (UniqueName: \"kubernetes.io/projected/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-kube-api-access-rmfcc\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.634722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634702    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mbjz\" (UniqueName: \"kubernetes.io/projected/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-kube-api-access-5mbjz\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm9rw\" (UniqueName: \"kubernetes.io/projected/510cc5e4-74d7-4a78-b5ab-000cf3718710-kube-api-access-cm9rw\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634780    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bvbl\" (UniqueName: \"kubernetes.io/projected/904a488c-8483-4de9-a9cf-c5209cb7121d-kube-api-access-9bvbl\") pod \"network-check-source-989f8b8dc-sgmv7\" (UID: \"904a488c-8483-4de9-a9cf-c5209cb7121d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634779    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-snapshots\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-trusted-ca\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634928    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-stats-auth\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.634987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.635108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.635009    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f1cffd56-8726-47a1-9b35-51d2fa542c69-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.635674 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.635654    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-trusted-ca\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.638328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.638292    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-serving-cert\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.638423 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.638304    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-installation-pull-secrets\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.638423 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.638382    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-image-registry-private-configuration\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.646783 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.646750    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-bound-sa-token\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.646914 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.646895    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntlhr\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-kube-api-access-ntlhr\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:52.647039 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.647016    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-295gl\" (UniqueName: \"kubernetes.io/projected/dd82f036-a46e-4742-9c8d-3defed3cc338-kube-api-access-295gl\") pod \"volume-data-source-validator-5d456fdbcd-x4m7s\" (UID: \"dd82f036-a46e-4742-9c8d-3defed3cc338\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"
Jul 02 19:02:52.647687 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.647668    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2wjh\" (UniqueName: \"kubernetes.io/projected/f1cffd56-8726-47a1-9b35-51d2fa542c69-kube-api-access-f2wjh\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:52.648180 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.648164    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mbjz\" (UniqueName: \"kubernetes.io/projected/19f2d0ce-1a4a-48e3-b367-5da8db66ed32-kube-api-access-5mbjz\") pod \"insights-operator-5c847dcfc4-5dhf8\" (UID: \"19f2d0ce-1a4a-48e3-b367-5da8db66ed32\") " pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.736168 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45c43a6b-6053-47e2-81c9-4a01e8e22407-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.736343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45c43a6b-6053-47e2-81c9-4a01e8e22407-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.736343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736282    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9be95b23-1b9e-4618-a1bd-c2e046daeafd-cert\") pod \"ingress-canary-p6pxx\" (UID: \"9be95b23-1b9e-4618-a1bd-c2e046daeafd\") " pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.736343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736319    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfcc\" (UniqueName: \"kubernetes.io/projected/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-kube-api-access-rmfcc\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.736503 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:52.736779 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736752    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45c43a6b-6053-47e2-81c9-4a01e8e22407-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.736900 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm9rw\" (UniqueName: \"kubernetes.io/projected/510cc5e4-74d7-4a78-b5ab-000cf3718710-kube-api-access-cm9rw\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.736900 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvbl\" (UniqueName: \"kubernetes.io/projected/904a488c-8483-4de9-a9cf-c5209cb7121d-kube-api-access-9bvbl\") pod \"network-check-source-989f8b8dc-sgmv7\" (UID: \"904a488c-8483-4de9-a9cf-c5209cb7121d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"
Jul 02 19:02:52.736900 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.736900 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.736887    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:02:52.736900 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-stats-auth\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.736942    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls podName:3a6bbd49-d234-4bfe-9439-dc21f9e01ff8 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:53.236926415 +0000 UTC m=+37.608681129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-22nf9" (UID: "3a6bbd49-d234-4bfe-9439-dc21f9e01ff8") : secret "samples-operator-tls" not found
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.736974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsk76\" (UniqueName: \"kubernetes.io/projected/9be95b23-1b9e-4618-a1bd-c2e046daeafd-kube-api-access-hsk76\") pod \"ingress-canary-p6pxx\" (UID: \"9be95b23-1b9e-4618-a1bd-c2e046daeafd\") " pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-default-certificate\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvmnt\" (UniqueName: \"kubernetes.io/projected/2cccf563-ab49-48b6-9f72-d9508c8a04ce-kube-api-access-cvmnt\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/510cc5e4-74d7-4a78-b5ab-000cf3718710-tmp-dir\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.737139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-config\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4d7\" (UniqueName: \"kubernetes.io/projected/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-kube-api-access-lk4d7\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737249    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cccf563-ab49-48b6-9f72-d9508c8a04ce-serving-cert\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsghd\" (UniqueName: \"kubernetes.io/projected/45c43a6b-6053-47e2-81c9-4a01e8e22407-kube-api-access-tsghd\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737362    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/510cc5e4-74d7-4a78-b5ab-000cf3718710-config-volume\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.737387    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:02:53.237372195 +0000 UTC m=+37.609126914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2cccf563-ab49-48b6-9f72-d9508c8a04ce-trusted-ca\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6mr8\" (UniqueName: \"kubernetes.io/projected/d3692552-803f-4f43-9405-4f8cd39fc29a-kube-api-access-k6mr8\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.737480 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cccf563-ab49-48b6-9f72-d9508c8a04ce-config\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.737969 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.737863    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/510cc5e4-74d7-4a78-b5ab-000cf3718710-config-volume\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.738163    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cccf563-ab49-48b6-9f72-d9508c8a04ce-config\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.738352    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/510cc5e4-74d7-4a78-b5ab-000cf3718710-tmp-dir\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.738897    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-config\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.738914    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2cccf563-ab49-48b6-9f72-d9508c8a04ce-trusted-ca\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.739013    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.739104    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:02:53.239089122 +0000 UTC m=+37.610843828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : secret "router-metrics-certs-default" not found
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.739133    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45c43a6b-6053-47e2-81c9-4a01e8e22407-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.739228    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:52.739328 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:52.739273    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls podName:510cc5e4-74d7-4a78-b5ab-000cf3718710 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:53.239257916 +0000 UTC m=+37.611012617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls") pod "dns-default-tkh4n" (UID: "510cc5e4-74d7-4a78-b5ab-000cf3718710") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:52.740064 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.740004    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-default-certificate\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.740064 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.740035    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9be95b23-1b9e-4618-a1bd-c2e046daeafd-cert\") pod \"ingress-canary-p6pxx\" (UID: \"9be95b23-1b9e-4618-a1bd-c2e046daeafd\") " pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.740856 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.740828    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.741448 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.741423    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-stats-auth\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.742238 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.742199    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cccf563-ab49-48b6-9f72-d9508c8a04ce-serving-cert\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.749760 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.749719    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsk76\" (UniqueName: \"kubernetes.io/projected/9be95b23-1b9e-4618-a1bd-c2e046daeafd-kube-api-access-hsk76\") pod \"ingress-canary-p6pxx\" (UID: \"9be95b23-1b9e-4618-a1bd-c2e046daeafd\") " pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.750298 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.750275    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm9rw\" (UniqueName: \"kubernetes.io/projected/510cc5e4-74d7-4a78-b5ab-000cf3718710-kube-api-access-cm9rw\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:52.750862 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.750665    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvmnt\" (UniqueName: \"kubernetes.io/projected/2cccf563-ab49-48b6-9f72-d9508c8a04ce-kube-api-access-cvmnt\") pod \"console-operator-68b757fb67-bxd4g\" (UID: \"2cccf563-ab49-48b6-9f72-d9508c8a04ce\") " pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.750862 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.750822    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsghd\" (UniqueName: \"kubernetes.io/projected/45c43a6b-6053-47e2-81c9-4a01e8e22407-kube-api-access-tsghd\") pod \"kube-storage-version-migrator-operator-846bf668f7-ms56h\" (UID: \"45c43a6b-6053-47e2-81c9-4a01e8e22407\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.751358 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.751330    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6mr8\" (UniqueName: \"kubernetes.io/projected/d3692552-803f-4f43-9405-4f8cd39fc29a-kube-api-access-k6mr8\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:52.751455 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.751354    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfcc\" (UniqueName: \"kubernetes.io/projected/c178c7b7-d1e3-41b3-ae86-be8335b2c5c6-kube-api-access-rmfcc\") pod \"service-ca-operator-5d46d9ffd4-8xlfn\" (UID: \"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.751920 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.751886    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvbl\" (UniqueName: \"kubernetes.io/projected/904a488c-8483-4de9-a9cf-c5209cb7121d-kube-api-access-9bvbl\") pod \"network-check-source-989f8b8dc-sgmv7\" (UID: \"904a488c-8483-4de9-a9cf-c5209cb7121d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"
Jul 02 19:02:52.752564 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.752540    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4d7\" (UniqueName: \"kubernetes.io/projected/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-kube-api-access-lk4d7\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:52.752661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.752649    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8"
Jul 02 19:02:52.781714 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.781687    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"
Jul 02 19:02:52.791883 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.791861    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"
Jul 02 19:02:52.825449 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.825397    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:02:52.832509 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.832455    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"
Jul 02 19:02:52.838765 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.838695    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p6pxx"
Jul 02 19:02:52.850136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:52.850080    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"
Jul 02 19:02:53.024967 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.020073    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s"]
Jul 02 19:02:53.034202 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.032150    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-5dhf8"]
Jul 02 19:02:53.065672 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.064214    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn"]
Jul 02 19:02:53.065672 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.065208    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:53.066933 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:53.066905    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc178c7b7_d1e3_41b3_ae86_be8335b2c5c6.slice/crio-a80e1b91cdcd9a144983025554c8e28b90257c0bf0e4719d3da8aaad2a0f73ab WatchSource:0}: Error finding container a80e1b91cdcd9a144983025554c8e28b90257c0bf0e4719d3da8aaad2a0f73ab: Status 404 returned error can't find the container with id a80e1b91cdcd9a144983025554c8e28b90257c0bf0e4719d3da8aaad2a0f73ab
Jul 02 19:02:53.110863 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.110830    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bxd4g"]
Jul 02 19:02:53.114064 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:53.114032    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cccf563_ab49_48b6_9f72_d9508c8a04ce.slice/crio-a1818229ea9241e59a49763c75c1445f1b396e336b19caa72e6f7845bf13614c WatchSource:0}: Error finding container a1818229ea9241e59a49763c75c1445f1b396e336b19caa72e6f7845bf13614c: Status 404 returned error can't find the container with id a1818229ea9241e59a49763c75c1445f1b396e336b19caa72e6f7845bf13614c
Jul 02 19:02:53.120246 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.120171    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h"]
Jul 02 19:02:53.123081 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:53.123056    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c43a6b_6053_47e2_81c9_4a01e8e22407.slice/crio-32f1dca1f0fb255d9d544b014ddebf5978bb53b01c4b4a253cc01e386766492a WatchSource:0}: Error finding container 32f1dca1f0fb255d9d544b014ddebf5978bb53b01c4b4a253cc01e386766492a: Status 404 returned error can't find the container with id 32f1dca1f0fb255d9d544b014ddebf5978bb53b01c4b4a253cc01e386766492a
Jul 02 19:02:53.125421 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.125397    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p6pxx"]
Jul 02 19:02:53.126275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.126223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7"]
Jul 02 19:02:53.128955 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:53.128934    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be95b23_1b9e_4618_a1bd_c2e046daeafd.slice/crio-303f2a7ad237961f2aa8607c46978fcc42736d5e3056862521e56065e2befc32 WatchSource:0}: Error finding container 303f2a7ad237961f2aa8607c46978fcc42736d5e3056862521e56065e2befc32: Status 404 returned error can't find the container with id 303f2a7ad237961f2aa8607c46978fcc42736d5e3056862521e56065e2befc32
Jul 02 19:02:53.129994 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:02:53.129969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904a488c_8483_4de9_a9cf_c5209cb7121d.slice/crio-7d123f552e7f1129ba121acc28edc2977f6818776aedf3422ad69fc84a32574b WatchSource:0}: Error finding container 7d123f552e7f1129ba121acc28edc2977f6818776aedf3422ad69fc84a32574b: Status 404 returned error can't find the container with id 7d123f552e7f1129ba121acc28edc2977f6818776aedf3422ad69fc84a32574b
Jul 02 19:02:53.143407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.143382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:53.143523 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.143479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:53.143587 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.143542    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:02:53.143587 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.143560    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bdcd677c-j6jt7: secret "image-registry-tls" not found
Jul 02 19:02:53.143682 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.143589    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:53.143682 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.143612    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls podName:22bda52b-381e-46b7-a2f0-52fa6ed85aa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:54.143593583 +0000 UTC m=+38.515348296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls") pod "image-registry-58bdcd677c-j6jt7" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0") : secret "image-registry-tls" not found
Jul 02 19:02:53.143682 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.143631    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls podName:f1cffd56-8726-47a1-9b35-51d2fa542c69 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:54.143619696 +0000 UTC m=+38.515374397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vtqvj" (UID: "f1cffd56-8726-47a1-9b35-51d2fa542c69") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:53.158205 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.158168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:53.244351 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.244284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:53.244351 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.244322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.244369    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.244404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244446    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244464    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244510    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244512    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls podName:510cc5e4-74d7-4a78-b5ab-000cf3718710 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:54.244494976 +0000 UTC m=+38.616249695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls") pod "dns-default-tkh4n" (UID: "510cc5e4-74d7-4a78-b5ab-000cf3718710") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244556    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:02:54.244545147 +0000 UTC m=+38.616299850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : secret "router-metrics-certs-default" not found
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244571    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:02:54.24456267 +0000 UTC m=+38.616317370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:02:53.244903 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:53.244591    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls podName:3a6bbd49-d234-4bfe-9439-dc21f9e01ff8 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:54.244583218 +0000 UTC m=+38.616337918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-22nf9" (UID: "3a6bbd49-d234-4bfe-9439-dc21f9e01ff8") : secret "samples-operator-tls" not found
Jul 02 19:02:53.326278 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.326219    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7" event={"ID":"904a488c-8483-4de9-a9cf-c5209cb7121d","Type":"ContainerStarted","Data":"7d123f552e7f1129ba121acc28edc2977f6818776aedf3422ad69fc84a32574b"}
Jul 02 19:02:53.327607 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.327577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s" event={"ID":"dd82f036-a46e-4742-9c8d-3defed3cc338","Type":"ContainerStarted","Data":"9efffa5b5e181fd32d36ed195e0aeb48a22f85f846ce5f9a9fd4f231f7a8d16d"}
Jul 02 19:02:53.328853 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.328825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8" event={"ID":"19f2d0ce-1a4a-48e3-b367-5da8db66ed32","Type":"ContainerStarted","Data":"345a7974e06d88682dbbe3d514c5bdce6a3304b2562d70c80f4c99fb82403ccd"}
Jul 02 19:02:53.330072 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.330044    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p6pxx" event={"ID":"9be95b23-1b9e-4618-a1bd-c2e046daeafd","Type":"ContainerStarted","Data":"303f2a7ad237961f2aa8607c46978fcc42736d5e3056862521e56065e2befc32"}
Jul 02 19:02:53.331265 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.331244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" event={"ID":"2cccf563-ab49-48b6-9f72-d9508c8a04ce","Type":"ContainerStarted","Data":"a1818229ea9241e59a49763c75c1445f1b396e336b19caa72e6f7845bf13614c"}
Jul 02 19:02:53.332406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.332385    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn" event={"ID":"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6","Type":"ContainerStarted","Data":"a80e1b91cdcd9a144983025554c8e28b90257c0bf0e4719d3da8aaad2a0f73ab"}
Jul 02 19:02:53.333503 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.333482    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h" event={"ID":"45c43a6b-6053-47e2-81c9-4a01e8e22407","Type":"ContainerStarted","Data":"32f1dca1f0fb255d9d544b014ddebf5978bb53b01c4b4a253cc01e386766492a"}
Jul 02 19:02:53.439970 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.439934    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:53.539433 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:53.539336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:54.153260 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.153222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:54.153464 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.153406    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:54.153535 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.153487    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls podName:f1cffd56-8726-47a1-9b35-51d2fa542c69 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:56.153465717 +0000 UTC m=+40.525220421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vtqvj" (UID: "f1cffd56-8726-47a1-9b35-51d2fa542c69") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:54.153535 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.153527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:54.153709 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.153691    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:02:54.153759 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.153711    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bdcd677c-j6jt7: secret "image-registry-tls" not found
Jul 02 19:02:54.153834 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.153768    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls podName:22bda52b-381e-46b7-a2f0-52fa6ed85aa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:56.153751936 +0000 UTC m=+40.525506652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls") pod "image-registry-58bdcd677c-j6jt7" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0") : secret "image-registry-tls" not found
Jul 02 19:02:54.156298 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.156272    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:02:54.156419 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.156279    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:02:54.156419 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.156404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:02:54.159799 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.159779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:02:54.160066 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.160045    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bswjt\""
Jul 02 19:02:54.160353 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.160327    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:02:54.160618 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.160601    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xfkkw\""
Jul 02 19:02:54.254627 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.254582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.254727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.254753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.254791    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:02:56.254764279 +0000 UTC m=+40.626518992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.254884    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:54.254927    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.254935    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls podName:510cc5e4-74d7-4a78-b5ab-000cf3718710 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:56.254920264 +0000 UTC m=+40.626674974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls") pod "dns-default-tkh4n" (UID: "510cc5e4-74d7-4a78-b5ab-000cf3718710") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.255047    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.255056    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.255089    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls podName:3a6bbd49-d234-4bfe-9439-dc21f9e01ff8 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:56.255075562 +0000 UTC m=+40.626830276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-22nf9" (UID: "3a6bbd49-d234-4bfe-9439-dc21f9e01ff8") : secret "samples-operator-tls" not found
Jul 02 19:02:54.255461 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:54.255110    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:02:56.255098126 +0000 UTC m=+40.626852827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : secret "router-metrics-certs-default" not found
Jul 02 19:02:55.343692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:55.343647    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerStarted","Data":"477c925abb9dbbb5569e99b67ec420f7e9178764a0f5fe70e4631049d78fc205"}
Jul 02 19:02:56.172161 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.172076    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:02:56.172325 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.172188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:02:56.172383 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.172326    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:02:56.172383 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.172348    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bdcd677c-j6jt7: secret "image-registry-tls" not found
Jul 02 19:02:56.172482 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.172407    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls podName:22bda52b-381e-46b7-a2f0-52fa6ed85aa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:00.172387634 +0000 UTC m=+44.544142340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls") pod "image-registry-58bdcd677c-j6jt7" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0") : secret "image-registry-tls" not found
Jul 02 19:02:56.172482 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.172461    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:56.172639 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.172518    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls podName:f1cffd56-8726-47a1-9b35-51d2fa542c69 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:00.172502114 +0000 UTC m=+44.544256837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vtqvj" (UID: "f1cffd56-8726-47a1-9b35-51d2fa542c69") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:02:56.273123 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.273087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:56.273302 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.273185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:02:56.273302 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.273233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:02:56.273419 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.273318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:02:56.273518 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.273502    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:56.273597 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.273570    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls podName:510cc5e4-74d7-4a78-b5ab-000cf3718710 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:00.27355127 +0000 UTC m=+44.645305989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls") pod "dns-default-tkh4n" (UID: "510cc5e4-74d7-4a78-b5ab-000cf3718710") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:56.274142 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.273959    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:02:56.274142 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.274010    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:00.273996328 +0000 UTC m=+44.645751034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : secret "router-metrics-certs-default" not found
Jul 02 19:02:56.274142 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.274102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:00.274064139 +0000 UTC m=+44.645818844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:02:56.274513 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.274426    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:02:56.274513 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:02:56.274488    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls podName:3a6bbd49-d234-4bfe-9439-dc21f9e01ff8 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:00.274474294 +0000 UTC m=+44.646229007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-22nf9" (UID: "3a6bbd49-d234-4bfe-9439-dc21f9e01ff8") : secret "samples-operator-tls" not found
Jul 02 19:02:56.352300 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.351453    2572 generic.go:356] "Generic (PLEG): container finished" podID="4aedc5c1-65fc-44b6-bb08-5f72641fed58" containerID="477c925abb9dbbb5569e99b67ec420f7e9178764a0f5fe70e4631049d78fc205" exitCode=0
Jul 02 19:02:56.352300 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:56.351529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerDied","Data":"477c925abb9dbbb5569e99b67ec420f7e9178764a0f5fe70e4631049d78fc205"}
Jul 02 19:02:57.359559 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:57.359248    2572 generic.go:356] "Generic (PLEG): container finished" podID="4aedc5c1-65fc-44b6-bb08-5f72641fed58" containerID="1971e480ddb030f3b54480d827164f8c843c428ce021e9b81fb1186f2fb53c88" exitCode=0
Jul 02 19:02:57.359559 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:57.359334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerDied","Data":"1971e480ddb030f3b54480d827164f8c843c428ce021e9b81fb1186f2fb53c88"}
Jul 02 19:02:58.472543 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:58.472509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:58.531488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:58.531457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:59.590169 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:59.590131    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:02:59.639333 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:02:59.639296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:00.212832 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:00.211670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:00.212832 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:00.211822    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:03:00.212832 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.212110    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:03:00.212832 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.212206    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls podName:f1cffd56-8726-47a1-9b35-51d2fa542c69 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.212185881 +0000 UTC m=+52.583940603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vtqvj" (UID: "f1cffd56-8726-47a1-9b35-51d2fa542c69") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:03:00.212832 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.212784    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:00.213831 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.213227    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bdcd677c-j6jt7: secret "image-registry-tls" not found
Jul 02 19:03:00.213831 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.213300    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls podName:22bda52b-381e-46b7-a2f0-52fa6ed85aa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.213273968 +0000 UTC m=+52.585028680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls") pod "image-registry-58bdcd677c-j6jt7" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0") : secret "image-registry-tls" not found
Jul 02 19:03:00.313120 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:00.313078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:03:00.313307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:00.313145    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:00.313307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:00.313230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:00.313307 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:00.313262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:00.313307 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313280    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:03:00.313467 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313347    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.313319994 +0000 UTC m=+52.685074702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:03:00.313467 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313375    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls podName:3a6bbd49-d234-4bfe-9439-dc21f9e01ff8 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.313365132 +0000 UTC m=+52.685119835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-22nf9" (UID: "3a6bbd49-d234-4bfe-9439-dc21f9e01ff8") : secret "samples-operator-tls" not found
Jul 02 19:03:00.313467 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313390    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:00.313467 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313442    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls podName:510cc5e4-74d7-4a78-b5ab-000cf3718710 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.313424595 +0000 UTC m=+52.685179309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls") pod "dns-default-tkh4n" (UID: "510cc5e4-74d7-4a78-b5ab-000cf3718710") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:00.313467 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313443    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:03:00.313632 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:00.313492    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.313481306 +0000 UTC m=+52.685236011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : secret "router-metrics-certs-default" not found
Jul 02 19:03:03.386554 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.386291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p6pxx" event={"ID":"9be95b23-1b9e-4618-a1bd-c2e046daeafd","Type":"ContainerStarted","Data":"8a289af041fa59f4da2cae9ef82034fb148e878ccbf47f957e449eebee865055"}
Jul 02 19:03:03.388094 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.388075    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/0.log"
Jul 02 19:03:03.388176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.388107    2572 generic.go:356] "Generic (PLEG): container finished" podID="2cccf563-ab49-48b6-9f72-d9508c8a04ce" containerID="7cbc9160cd94c22ab9e0e880867e7ddb81cb0c1d9c209bfc4fb7b62c15457b55" exitCode=255
Jul 02 19:03:03.388176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.388140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" event={"ID":"2cccf563-ab49-48b6-9f72-d9508c8a04ce","Type":"ContainerDied","Data":"7cbc9160cd94c22ab9e0e880867e7ddb81cb0c1d9c209bfc4fb7b62c15457b55"}
Jul 02 19:03:03.388385 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.388365    2572 scope.go:117] "RemoveContainer" containerID="7cbc9160cd94c22ab9e0e880867e7ddb81cb0c1d9c209bfc4fb7b62c15457b55"
Jul 02 19:03:03.389733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.389711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn" event={"ID":"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6","Type":"ContainerStarted","Data":"084971b4b6000522240c6fbcc5645a098d9d22247a1e50ce77134e967de0fb20"}
Jul 02 19:03:03.391764 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.391740    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h" event={"ID":"45c43a6b-6053-47e2-81c9-4a01e8e22407","Type":"ContainerStarted","Data":"4ec9a61898c8dff982a5a8638a9a26cb3e940d3b2ff8df4bd445fe4b40ae55f8"}
Jul 02 19:03:03.393345 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.393325    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7" event={"ID":"904a488c-8483-4de9-a9cf-c5209cb7121d","Type":"ContainerStarted","Data":"23b0cf415f048661688c5fa50a3d83fc9228535ca5dbc4f2fb3e24f4647fb135"}
Jul 02 19:03:03.396965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.396943    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" event={"ID":"4aedc5c1-65fc-44b6-bb08-5f72641fed58","Type":"ContainerStarted","Data":"3fd367bfc01756a5a5b674deae6665e69a78d88c0022383205cbea8aba24b7bf"}
Jul 02 19:03:03.398561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.398542    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s" event={"ID":"dd82f036-a46e-4742-9c8d-3defed3cc338","Type":"ContainerStarted","Data":"b34c8bf5d82fb402a3095c6b0f7ac3093e658482bed5b35bad875aa4e6cd3464"}
Jul 02 19:03:03.400093 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.400070    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8" event={"ID":"19f2d0ce-1a4a-48e3-b367-5da8db66ed32","Type":"ContainerStarted","Data":"bbba07b46de00c7b65def7a36f0180a601153bba0eda7bdd989fa6b0fc47f9d8"}
Jul 02 19:03:03.402301 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.402257    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p6pxx" podStartSLOduration=2.129956895 podStartE2EDuration="11.4022409s" totalImagesPullingTime="9.272284005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.401044845 +0000 UTC m=+47.772799569" watchObservedRunningTime="2026-07-02 19:03:03.4022409 +0000 UTC m=+47.773995621"
Jul 02 19:03:03.419444 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.415302    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-x4m7s" podStartSLOduration=11.149746892 podStartE2EDuration="20.415285559s" totalImagesPullingTime="9.265538667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.414630859 +0000 UTC m=+47.786385580" watchObservedRunningTime="2026-07-02 19:03:03.415285559 +0000 UTC m=+47.787040282"
Jul 02 19:03:03.437269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.437227    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j6dzp" podStartSLOduration=14.538740827 podStartE2EDuration="47.4372098s" totalImagesPullingTime="32.898468973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.435681899 +0000 UTC m=+47.807436659" watchObservedRunningTime="2026-07-02 19:03:03.4372098 +0000 UTC m=+47.808964523"
Jul 02 19:03:03.453385 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.453276    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn" podStartSLOduration=11.128053885 podStartE2EDuration="20.453258045s" totalImagesPullingTime="9.32520416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.45316955 +0000 UTC m=+47.824924273" watchObservedRunningTime="2026-07-02 19:03:03.453258045 +0000 UTC m=+47.825012748"
Jul 02 19:03:03.472176 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.472111    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h" podStartSLOduration=11.200776982 podStartE2EDuration="20.472097116s" totalImagesPullingTime="9.271320134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.47138765 +0000 UTC m=+47.843142373" watchObservedRunningTime="2026-07-02 19:03:03.472097116 +0000 UTC m=+47.843851839"
Jul 02 19:03:03.487244 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.487193    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sgmv7" podStartSLOduration=11.221960338 podStartE2EDuration="20.487174252s" totalImagesPullingTime="9.265213914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.485450122 +0000 UTC m=+47.857204845" watchObservedRunningTime="2026-07-02 19:03:03.487174252 +0000 UTC m=+47.858928955"
Jul 02 19:03:03.507706 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.507228    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8" podStartSLOduration=11.162604426 podStartE2EDuration="20.507212082s" totalImagesPullingTime="9.344607656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:03.506798518 +0000 UTC m=+47.878553241" watchObservedRunningTime="2026-07-02 19:03:03.507212082 +0000 UTC m=+47.878966805"
Jul 02 19:03:03.535431 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.535401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:03.601159 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.601127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:03.695797 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.695714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:03.796520 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.796473    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:03.851575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:03.851541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:04.185452 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.185409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:04.214330 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.214301    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"]
Jul 02 19:03:04.228117 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.228083    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"]
Jul 02 19:03:04.228268 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.228199    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"
Jul 02 19:03:04.231284 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.230836    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 19:03:04.231284 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.231118    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 19:03:04.231798 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.231773    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-trhkn\""
Jul 02 19:03:04.276467 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.276361    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:04.350316 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.350281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p5vt\" (UniqueName: \"kubernetes.io/projected/ffdbba89-a540-4450-93eb-1f28f7d01f71-kube-api-access-5p5vt\") pod \"migrator-d57d58cc9-llsfn\" (UID: \"ffdbba89-a540-4450-93eb-1f28f7d01f71\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"
Jul 02 19:03:04.376561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.376526    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:04.406712 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.406677    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:03:04.407322 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.407296    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/0.log"
Jul 02 19:03:04.407429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.407341    2572 generic.go:356] "Generic (PLEG): container finished" podID="2cccf563-ab49-48b6-9f72-d9508c8a04ce" containerID="f3dd1eb29c59df39d20805977d42921eec905a157af689c85aa47be727bc7948" exitCode=255
Jul 02 19:03:04.408297 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.408264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" event={"ID":"2cccf563-ab49-48b6-9f72-d9508c8a04ce","Type":"ContainerDied","Data":"f3dd1eb29c59df39d20805977d42921eec905a157af689c85aa47be727bc7948"}
Jul 02 19:03:04.408408 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.408330    2572 scope.go:117] "RemoveContainer" containerID="7cbc9160cd94c22ab9e0e880867e7ddb81cb0c1d9c209bfc4fb7b62c15457b55"
Jul 02 19:03:04.409139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.408469    2572 scope.go:117] "RemoveContainer" containerID="f3dd1eb29c59df39d20805977d42921eec905a157af689c85aa47be727bc7948"
Jul 02 19:03:04.409139 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:04.408654    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bxd4g_openshift-console-operator(2cccf563-ab49-48b6-9f72-d9508c8a04ce)\"" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" podUID="2cccf563-ab49-48b6-9f72-d9508c8a04ce"
Jul 02 19:03:04.429820 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.429773    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-98hmj"]
Jul 02 19:03:04.440193 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.440135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.443580 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.443377    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:03:04.444153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.444134    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:03:04.445218 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.445193    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-psrnn\""
Jul 02 19:03:04.451163 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.451008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p5vt\" (UniqueName: \"kubernetes.io/projected/ffdbba89-a540-4450-93eb-1f28f7d01f71-kube-api-access-5p5vt\") pod \"migrator-d57d58cc9-llsfn\" (UID: \"ffdbba89-a540-4450-93eb-1f28f7d01f71\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"
Jul 02 19:03:04.455791 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.455763    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98hmj"]
Jul 02 19:03:04.473213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.473186    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p5vt\" (UniqueName: \"kubernetes.io/projected/ffdbba89-a540-4450-93eb-1f28f7d01f71-kube-api-access-5p5vt\") pod \"migrator-d57d58cc9-llsfn\" (UID: \"ffdbba89-a540-4450-93eb-1f28f7d01f71\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"
Jul 02 19:03:04.483437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.483413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:04.540404 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.540376    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"
Jul 02 19:03:04.550169 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.550143    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:04.552343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.552317    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdqps\" (UniqueName: \"kubernetes.io/projected/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-api-access-qdqps\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.552454 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.552409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99fc9be5-dcf9-420d-84d1-84d98b65f980-data-volume\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.552513 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.552483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.552727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.552705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99fc9be5-dcf9-420d-84d1-84d98b65f980-crio-socket\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.553144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.553121    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.654395 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.654364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.654501 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.654467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99fc9be5-dcf9-420d-84d1-84d98b65f980-crio-socket\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.654538 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:04.654508    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:03:04.654573 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.654536    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.654844 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:04.654604    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:05.154580253 +0000 UTC m=+49.526334955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : configmap "kube-rbac-proxy" not found
Jul 02 19:03:04.654844 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:04.654692    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:04.654844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.654694    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdqps\" (UniqueName: \"kubernetes.io/projected/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-api-access-qdqps\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.654844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.654719    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99fc9be5-dcf9-420d-84d1-84d98b65f980-crio-socket\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.654844 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:04.654746    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:05.154733822 +0000 UTC m=+49.526488526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:04.654844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.654799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99fc9be5-dcf9-420d-84d1-84d98b65f980-data-volume\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.655184 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.655166    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99fc9be5-dcf9-420d-84d1-84d98b65f980-data-volume\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.664093 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.664064    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdqps\" (UniqueName: \"kubernetes.io/projected/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-api-access-qdqps\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:04.698343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:04.698142    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn"]
Jul 02 19:03:04.700674 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:04.700649    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdbba89_a540_4450_93eb_1f28f7d01f71.slice/crio-48d43d0d7fe3401bee6463d6e2069610717e3ad3d96e23e533c6b55cb660c4a3 WatchSource:0}: Error finding container 48d43d0d7fe3401bee6463d6e2069610717e3ad3d96e23e533c6b55cb660c4a3: Status 404 returned error can't find the container with id 48d43d0d7fe3401bee6463d6e2069610717e3ad3d96e23e533c6b55cb660c4a3
Jul 02 19:03:05.159872 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:05.159827    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:05.160092 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:05.159884    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:03:05.160092 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:05.159954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:05.160092 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:05.159976    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:06.159956097 +0000 UTC m=+50.531710812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : configmap "kube-rbac-proxy" not found
Jul 02 19:03:05.160092 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:05.160036    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:05.160092 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:05.160086    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:06.160072309 +0000 UTC m=+50.531827008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:05.412896 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:05.412829    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:03:05.413285 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:05.413197    2572 scope.go:117] "RemoveContainer" containerID="f3dd1eb29c59df39d20805977d42921eec905a157af689c85aa47be727bc7948"
Jul 02 19:03:05.413422 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:05.413398    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bxd4g_openshift-console-operator(2cccf563-ab49-48b6-9f72-d9508c8a04ce)\"" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" podUID="2cccf563-ab49-48b6-9f72-d9508c8a04ce"
Jul 02 19:03:05.414115 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:05.414090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn" event={"ID":"ffdbba89-a540-4450-93eb-1f28f7d01f71","Type":"ContainerStarted","Data":"48d43d0d7fe3401bee6463d6e2069610717e3ad3d96e23e533c6b55cb660c4a3"}
Jul 02 19:03:06.101460 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.101422    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-727lt"]
Jul 02 19:03:06.115296 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.115273    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-727lt"]
Jul 02 19:03:06.115462 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.115385    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.118218 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.117991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 19:03:06.118218 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.118045    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 19:03:06.118218 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.118052    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 19:03:06.118218 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.118066    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 19:03:06.119860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.119648    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8gjms\""
Jul 02 19:03:06.138064 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.138035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:06.170402 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.170375    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b6f4ccc-7827-4963-aea6-7371500ec1fc-signing-key\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.170543 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.170467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:06.170543 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.170518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b6f4ccc-7827-4963-aea6-7371500ec1fc-signing-cabundle\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.170617 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:06.170554    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:06.170617 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.170561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/8b6f4ccc-7827-4963-aea6-7371500ec1fc-kube-api-access-hbthk\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.170617 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:06.170600    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.170583099 +0000 UTC m=+52.542337815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:06.170739 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.170722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:06.170855 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:06.170841    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:03:06.170909 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:06.170898    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:08.170882567 +0000 UTC m=+52.542637277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : configmap "kube-rbac-proxy" not found
Jul 02 19:03:06.210609 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.210576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:06.271575 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.271546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b6f4ccc-7827-4963-aea6-7371500ec1fc-signing-cabundle\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.271737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.271597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/8b6f4ccc-7827-4963-aea6-7371500ec1fc-kube-api-access-hbthk\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.271737 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.271724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b6f4ccc-7827-4963-aea6-7371500ec1fc-signing-key\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.272345 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.272327    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b6f4ccc-7827-4963-aea6-7371500ec1fc-signing-cabundle\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.274058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.274041    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b6f4ccc-7827-4963-aea6-7371500ec1fc-signing-key\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.286944 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.286917    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbthk\" (UniqueName: \"kubernetes.io/projected/8b6f4ccc-7827-4963-aea6-7371500ec1fc-kube-api-access-hbthk\") pod \"service-ca-758f599c5-727lt\" (UID: \"8b6f4ccc-7827-4963-aea6-7371500ec1fc\") " pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.316390 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.316367    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jghjq_000b8b07-ebc7-466c-a66a-41d4d57fbc90/dns-node-resolver/0.log"
Jul 02 19:03:06.426910 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.426887    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-727lt"
Jul 02 19:03:06.491915 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.491881    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:06.561146 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.561121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-727lt"]
Jul 02 19:03:06.563866 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:06.563838    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6f4ccc_7827_4963_aea6_7371500ec1fc.slice/crio-39bac7635cb92cfb9d6889732bef18155e7e32a53b37ec5a6d0b235e3b814230 WatchSource:0}: Error finding container 39bac7635cb92cfb9d6889732bef18155e7e32a53b37ec5a6d0b235e3b814230: Status 404 returned error can't find the container with id 39bac7635cb92cfb9d6889732bef18155e7e32a53b37ec5a6d0b235e3b814230
Jul 02 19:03:06.567549 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:06.567379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:07.065177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.065147    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:07.423688 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.423604    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn" event={"ID":"ffdbba89-a540-4450-93eb-1f28f7d01f71","Type":"ContainerStarted","Data":"9f6b46dd0ef8aee66c499967b3a96c0eaf43891275a9cb4a20959920fcf32aa4"}
Jul 02 19:03:07.423960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.423941    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn" event={"ID":"ffdbba89-a540-4450-93eb-1f28f7d01f71","Type":"ContainerStarted","Data":"ba73d1256379bd9130f602774c487f18883e503288488b6f063bb49722af47ff"}
Jul 02 19:03:07.425484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.425456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-727lt" event={"ID":"8b6f4ccc-7827-4963-aea6-7371500ec1fc","Type":"ContainerStarted","Data":"4bc13eaad62d649e70dabf551ebb0689cfe70b3da932758583be9aa83f7137a4"}
Jul 02 19:03:07.425615 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.425501    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-727lt" event={"ID":"8b6f4ccc-7827-4963-aea6-7371500ec1fc","Type":"ContainerStarted","Data":"39bac7635cb92cfb9d6889732bef18155e7e32a53b37ec5a6d0b235e3b814230"}
Jul 02 19:03:07.473584 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.473523    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-llsfn" podStartSLOduration=1.750869868 podStartE2EDuration="3.473501237s" totalImagesPullingTime="1.722631369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:07.453642646 +0000 UTC m=+51.825397369" watchObservedRunningTime="2026-07-02 19:03:07.473501237 +0000 UTC m=+51.845255960"
Jul 02 19:03:07.474604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.474557    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-727lt" podStartSLOduration=1.474544566 podStartE2EDuration="1.474544566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:07.472914137 +0000 UTC m=+51.844668861" watchObservedRunningTime="2026-07-02 19:03:07.474544566 +0000 UTC m=+51.846299288"
Jul 02 19:03:07.476630 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.476596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:07.717019 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.716935    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8k6f_f6b9268f-a010-415e-8c68-964fed87830f/node-ca/0.log"
Jul 02 19:03:07.764658 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.764626    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:07.863989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:07.863952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:08.007640 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.007607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:08.123127 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.123092    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p6pxx_9be95b23-1b9e-4618-a1bd-c2e046daeafd/serve-healthcheck-canary/0.log"
Jul 02 19:03:08.164818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.164761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:08.188073 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.188035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:08.188201 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.188163    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:03:08.188260 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.188254    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:12.188236221 +0000 UTC m=+56.559990934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : configmap "kube-rbac-proxy" not found
Jul 02 19:03:08.188320 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.188267    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:08.188320 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.188189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:08.188320 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.188310    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:12.188299382 +0000 UTC m=+56.560054085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:08.275638 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.275552    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:08.288912 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.288883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:08.289064 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.288980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:03:08.289064 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.289035    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:08.289064 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.289052    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bdcd677c-j6jt7: secret "image-registry-tls" not found
Jul 02 19:03:08.289212 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.289102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls podName:22bda52b-381e-46b7-a2f0-52fa6ed85aa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.289088591 +0000 UTC m=+68.660843290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls") pod "image-registry-58bdcd677c-j6jt7" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0") : secret "image-registry-tls" not found
Jul 02 19:03:08.289212 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.289109    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:03:08.289212 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.289153    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls podName:f1cffd56-8726-47a1-9b35-51d2fa542c69 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.289140449 +0000 UTC m=+68.660895148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vtqvj" (UID: "f1cffd56-8726-47a1-9b35-51d2fa542c69") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:03:08.316912 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.316884    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-llsfn_ffdbba89-a540-4450-93eb-1f28f7d01f71/migrator/0.log"
Jul 02 19:03:08.390256 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.390224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:08.390448 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.390318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:03:08.390448 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.390368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:08.390558 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.390463    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:08.390558 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.390371    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:03:08.390558 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.390536    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:08.390558 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.390476    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.390458243 +0000 UTC m=+68.762212942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:03:08.390729 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.390570    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs podName:d3692552-803f-4f43-9405-4f8cd39fc29a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.390558929 +0000 UTC m=+68.762313629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs") pod "router-default-5db59696f7-89w6b" (UID: "d3692552-803f-4f43-9405-4f8cd39fc29a") : secret "router-metrics-certs-default" not found
Jul 02 19:03:08.390729 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:08.390637    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls podName:510cc5e4-74d7-4a78-b5ab-000cf3718710 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.390628538 +0000 UTC m=+68.762383238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls") pod "dns-default-tkh4n" (UID: "510cc5e4-74d7-4a78-b5ab-000cf3718710") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:08.392663 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.392643    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a6bbd49-d234-4bfe-9439-dc21f9e01ff8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-22nf9\" (UID: \"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:03:08.445098 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.445066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"
Jul 02 19:03:08.534629 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.534553    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-llsfn_ffdbba89-a540-4450-93eb-1f28f7d01f71/graceful-termination/0.log"
Jul 02 19:03:08.590795 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.590703    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9"]
Jul 02 19:03:08.718424 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:08.718397    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ms56h_45c43a6b-6053-47e2-81c9-4a01e8e22407/kube-storage-version-migrator-operator/0.log"
Jul 02 19:03:09.103195 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:09.103147    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:09.435136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:09.433851    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9" event={"ID":"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8","Type":"ContainerStarted","Data":"07ae9efd315f0183cb29f692a3cf79eda122bb83ec9bd23c65f6f9fbeaee5044"}
Jul 02 19:03:09.546024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:09.545973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:09.733884 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:09.733849    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:09.897528 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:09.897490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:09.954249 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:09.954210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:10.296044 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:10.296011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:10.917639 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:10.917599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.091064 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.091028    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.191082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.190985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.442235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.442140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9" event={"ID":"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8","Type":"ContainerStarted","Data":"a4dc918b0879f6445c3e224b3898d0aac1b2e799577aeee1c61a2de1d3e52680"}
Jul 02 19:03:11.442235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.442190    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9" event={"ID":"3a6bbd49-d234-4bfe-9439-dc21f9e01ff8","Type":"ContainerStarted","Data":"92d6d48d4b85b99f22377294d610731b5f818dfe1da90c518f9670b287afae35"}
Jul 02 19:03:11.461204 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.461153    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-22nf9" podStartSLOduration=25.910990526 podStartE2EDuration="28.461136925s" totalImagesPullingTime="2.550146399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:11.460289657 +0000 UTC m=+55.832044381" watchObservedRunningTime="2026-07-02 19:03:11.461136925 +0000 UTC m=+55.832891647"
Jul 02 19:03:11.464374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.464337    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.534179 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.534149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.708118 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.708024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.768148 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.768106    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.899523 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.899488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:11.999780 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:11.999746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:12.103694 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:12.103661    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:12.225758 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:12.225720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:12.225967 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:12.225832    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:12.225967 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:12.225866    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:03:12.225967 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:12.225925    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:20.225911312 +0000 UTC m=+64.597666012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : configmap "kube-rbac-proxy" not found
Jul 02 19:03:12.226133 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:12.225996    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:12.226133 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:12.226060    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls podName:99fc9be5-dcf9-420d-84d1-84d98b65f980 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:20.226042907 +0000 UTC m=+64.597797623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98hmj" (UID: "99fc9be5-dcf9-420d-84d1-84d98b65f980") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:03:12.826356 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:12.826318    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:03:12.826544 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:12.826382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:03:12.826768 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:12.826756    2572 scope.go:117] "RemoveContainer" containerID="f3dd1eb29c59df39d20805977d42921eec905a157af689c85aa47be727bc7948"
Jul 02 19:03:12.826950 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:12.826929    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bxd4g_openshift-console-operator(2cccf563-ab49-48b6-9f72-d9508c8a04ce)\"" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" podUID="2cccf563-ab49-48b6-9f72-d9508c8a04ce"
Jul 02 19:03:17.327116 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:17.327090    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lklf2"
Jul 02 19:03:20.299179 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.299137    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:20.299582 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.299241    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:20.299672 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.299650    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99fc9be5-dcf9-420d-84d1-84d98b65f980-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:20.301407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.301376    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99fc9be5-dcf9-420d-84d1-84d98b65f980-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98hmj\" (UID: \"99fc9be5-dcf9-420d-84d1-84d98b65f980\") " pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:20.356881 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.356853    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-psrnn\""
Jul 02 19:03:20.365076 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.365057    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98hmj"
Jul 02 19:03:20.487713 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:20.487685    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98hmj"]
Jul 02 19:03:20.491155 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:20.491130    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99fc9be5_dcf9_420d_84d1_84d98b65f980.slice/crio-e5f3b73d591814d429db4ad7e1ffa0f0aa2f18d6187bb90ec17d2295d574a86e WatchSource:0}: Error finding container e5f3b73d591814d429db4ad7e1ffa0f0aa2f18d6187bb90ec17d2295d574a86e: Status 404 returned error can't find the container with id e5f3b73d591814d429db4ad7e1ffa0f0aa2f18d6187bb90ec17d2295d574a86e
Jul 02 19:03:21.475297 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:21.475260    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98hmj" event={"ID":"99fc9be5-dcf9-420d-84d1-84d98b65f980","Type":"ContainerStarted","Data":"e5f3b73d591814d429db4ad7e1ffa0f0aa2f18d6187bb90ec17d2295d574a86e"}
Jul 02 19:03:21.914020 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:21.913935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:03:21.916430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:21.916402    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:03:21.927677 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:21.927652    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c2b116-1d0c-4b5a-ab9f-0c601e7236dc-metrics-certs\") pod \"network-metrics-daemon-24bgr\" (UID: \"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc\") " pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:03:22.014946 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.014906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:03:22.017743 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.017721    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:03:22.027747 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.027715    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19-original-pull-secret\") pod \"global-pull-secret-syncer-jc67t\" (UID: \"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19\") " pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:03:22.081424 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.081394    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xfkkw\""
Jul 02 19:03:22.085163 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.085139    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jc67t"
Jul 02 19:03:22.089421 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.089397    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-24bgr"
Jul 02 19:03:22.116150 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.116114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:03:22.118946 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.118915    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn7xs\" (UniqueName: \"kubernetes.io/projected/42ea740d-3c4e-4852-b934-3ea52c5fdf05-kube-api-access-mn7xs\") pod \"network-check-target-cd9wj\" (UID: \"42ea740d-3c4e-4852-b934-3ea52c5fdf05\") " pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:03:22.374499 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.374465    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bswjt\""
Jul 02 19:03:22.382675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:22.382647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:03:24.321640 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.321613    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cd9wj"]
Jul 02 19:03:24.325198 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.324780    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ea740d_3c4e_4852_b934_3ea52c5fdf05.slice/crio-d7a4195322f940f807f0e17a70ae907aac339157c4f9a7db1fab2306e7128a27 WatchSource:0}: Error finding container d7a4195322f940f807f0e17a70ae907aac339157c4f9a7db1fab2306e7128a27: Status 404 returned error can't find the container with id d7a4195322f940f807f0e17a70ae907aac339157c4f9a7db1fab2306e7128a27
Jul 02 19:03:24.338230 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.338203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:03:24.338341 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.338325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:24.340961 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.340935    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"image-registry-58bdcd677c-j6jt7\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") " pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:24.341051 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.340958    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1cffd56-8726-47a1-9b35-51d2fa542c69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vtqvj\" (UID: \"f1cffd56-8726-47a1-9b35-51d2fa542c69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:03:24.346103 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.346078    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-24bgr"]
Jul 02 19:03:24.351415 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.351388    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c2b116_1d0c_4b5a_ab9f_0c601e7236dc.slice/crio-883c0a8bc47e6b19fd7d6014792462f876a0f914c8053ba144ef8729c2d1f070 WatchSource:0}: Error finding container 883c0a8bc47e6b19fd7d6014792462f876a0f914c8053ba144ef8729c2d1f070: Status 404 returned error can't find the container with id 883c0a8bc47e6b19fd7d6014792462f876a0f914c8053ba144ef8729c2d1f070
Jul 02 19:03:24.439298 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.439215    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:24.439298 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.439271    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:24.439298 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.439294    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:24.439935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.439912    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3692552-803f-4f43-9405-4f8cd39fc29a-service-ca-bundle\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:24.441485 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.441464    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/510cc5e4-74d7-4a78-b5ab-000cf3718710-metrics-tls\") pod \"dns-default-tkh4n\" (UID: \"510cc5e4-74d7-4a78-b5ab-000cf3718710\") " pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:24.441599 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.441582    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3692552-803f-4f43-9405-4f8cd39fc29a-metrics-certs\") pod \"router-default-5db59696f7-89w6b\" (UID: \"d3692552-803f-4f43-9405-4f8cd39fc29a\") " pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:24.488856 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.488798    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cd9wj" event={"ID":"42ea740d-3c4e-4852-b934-3ea52c5fdf05","Type":"ContainerStarted","Data":"faf52df41f88361c41da8c04415f3e3ec400145dce0c166a6827bd2542fb6a50"}
Jul 02 19:03:24.489017 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.488875    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cd9wj" event={"ID":"42ea740d-3c4e-4852-b934-3ea52c5fdf05","Type":"ContainerStarted","Data":"d7a4195322f940f807f0e17a70ae907aac339157c4f9a7db1fab2306e7128a27"}
Jul 02 19:03:24.489017 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.489008    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:03:24.490229 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.490196    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98hmj" event={"ID":"99fc9be5-dcf9-420d-84d1-84d98b65f980","Type":"ContainerStarted","Data":"3561ef423e50214dc61dbeba0e718ff6babb532c1873dbbdbf231a4805f3c6ba"}
Jul 02 19:03:24.491169 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.491149    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-24bgr" event={"ID":"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc","Type":"ContainerStarted","Data":"883c0a8bc47e6b19fd7d6014792462f876a0f914c8053ba144ef8729c2d1f070"}
Jul 02 19:03:24.504438 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.504393    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cd9wj" podStartSLOduration=67.504379834 podStartE2EDuration="1m7.504379834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:24.503841278 +0000 UTC m=+68.875595991" watchObservedRunningTime="2026-07-02 19:03:24.504379834 +0000 UTC m=+68.876134533"
Jul 02 19:03:24.548056 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.548029    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jc67t"]
Jul 02 19:03:24.551010 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.550980    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ef9e2e_6ff3_49fe_8d4d_72b495cafc19.slice/crio-acd19321871ac01bc1b7b7785fef1ba9a401d89685bf9df468e1d10c4c550229 WatchSource:0}: Error finding container acd19321871ac01bc1b7b7785fef1ba9a401d89685bf9df468e1d10c4c550229: Status 404 returned error can't find the container with id acd19321871ac01bc1b7b7785fef1ba9a401d89685bf9df468e1d10c4c550229
Jul 02 19:03:24.563024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.563004    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k9mwx\""
Jul 02 19:03:24.570844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.570823    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:24.575295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.575276    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wtwcl\""
Jul 02 19:03:24.583326 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.583295    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"
Jul 02 19:03:24.611151 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.611126    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-44fkl\""
Jul 02 19:03:24.619273 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.619246    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:24.619742 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.619616    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g97vz\""
Jul 02 19:03:24.628066 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.628030    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:24.757049 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.757013    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58bdcd677c-j6jt7"]
Jul 02 19:03:24.761783 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.761481    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bda52b_381e_46b7_a2f0_52fa6ed85aa0.slice/crio-f86e7f0e02cef4009c2914683fd66b671c0dc10d17d434191175a7697b20611b WatchSource:0}: Error finding container f86e7f0e02cef4009c2914683fd66b671c0dc10d17d434191175a7697b20611b: Status 404 returned error can't find the container with id f86e7f0e02cef4009c2914683fd66b671c0dc10d17d434191175a7697b20611b
Jul 02 19:03:24.775543 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.775517    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj"]
Jul 02 19:03:24.780339 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.780309    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cffd56_8726_47a1_9b35_51d2fa542c69.slice/crio-695bf9b90b67dec7f12c7adf4255e2d123411cecf86b8bfa57875b00bfa6fd5a WatchSource:0}: Error finding container 695bf9b90b67dec7f12c7adf4255e2d123411cecf86b8bfa57875b00bfa6fd5a: Status 404 returned error can't find the container with id 695bf9b90b67dec7f12c7adf4255e2d123411cecf86b8bfa57875b00bfa6fd5a
Jul 02 19:03:24.814664 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.814611    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5db59696f7-89w6b"]
Jul 02 19:03:24.829686 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:24.829661    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkh4n"]
Jul 02 19:03:24.911437 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.911346    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3692552_803f_4f43_9405_4f8cd39fc29a.slice/crio-c208a6406b646727212c2d4618cd8e9979e92cf324c3e1919e9dd67d690454d1 WatchSource:0}: Error finding container c208a6406b646727212c2d4618cd8e9979e92cf324c3e1919e9dd67d690454d1: Status 404 returned error can't find the container with id c208a6406b646727212c2d4618cd8e9979e92cf324c3e1919e9dd67d690454d1
Jul 02 19:03:24.911837 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:24.911790    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod510cc5e4_74d7_4a78_b5ab_000cf3718710.slice/crio-b945d404cc83b46485ee6c4c6e87358508e1516f5827be9cd8b598db8bc1969c WatchSource:0}: Error finding container b945d404cc83b46485ee6c4c6e87358508e1516f5827be9cd8b598db8bc1969c: Status 404 returned error can't find the container with id b945d404cc83b46485ee6c4c6e87358508e1516f5827be9cd8b598db8bc1969c
Jul 02 19:03:25.497017 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.496980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5db59696f7-89w6b" event={"ID":"d3692552-803f-4f43-9405-4f8cd39fc29a","Type":"ContainerStarted","Data":"3f69d720c913367b5c4c434ae9567d47aca59620f9bc6c6d3d08049cf6960648"}
Jul 02 19:03:25.497490 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.497040    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5db59696f7-89w6b" event={"ID":"d3692552-803f-4f43-9405-4f8cd39fc29a","Type":"ContainerStarted","Data":"c208a6406b646727212c2d4618cd8e9979e92cf324c3e1919e9dd67d690454d1"}
Jul 02 19:03:25.498380 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.498344    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj" event={"ID":"f1cffd56-8726-47a1-9b35-51d2fa542c69","Type":"ContainerStarted","Data":"695bf9b90b67dec7f12c7adf4255e2d123411cecf86b8bfa57875b00bfa6fd5a"}
Jul 02 19:03:25.500443 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.500414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" event={"ID":"22bda52b-381e-46b7-a2f0-52fa6ed85aa0","Type":"ContainerStarted","Data":"d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a"}
Jul 02 19:03:25.500560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.500465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" event={"ID":"22bda52b-381e-46b7-a2f0-52fa6ed85aa0","Type":"ContainerStarted","Data":"f86e7f0e02cef4009c2914683fd66b671c0dc10d17d434191175a7697b20611b"}
Jul 02 19:03:25.500560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.500492    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:25.502558 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.502528    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98hmj" event={"ID":"99fc9be5-dcf9-420d-84d1-84d98b65f980","Type":"ContainerStarted","Data":"83c55c83711d475b309b5d22db7bb2b8f4680323828ce03d38e19a9ad6fde2c3"}
Jul 02 19:03:25.503861 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.503840    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkh4n" event={"ID":"510cc5e4-74d7-4a78-b5ab-000cf3718710","Type":"ContainerStarted","Data":"b945d404cc83b46485ee6c4c6e87358508e1516f5827be9cd8b598db8bc1969c"}
Jul 02 19:03:25.505114 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.505090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jc67t" event={"ID":"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19","Type":"ContainerStarted","Data":"acd19321871ac01bc1b7b7785fef1ba9a401d89685bf9df468e1d10c4c550229"}
Jul 02 19:03:25.520718 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.520607    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5db59696f7-89w6b" podStartSLOduration=42.520587984 podStartE2EDuration="42.520587984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.519409138 +0000 UTC m=+69.891163862" watchObservedRunningTime="2026-07-02 19:03:25.520587984 +0000 UTC m=+69.892342707"
Jul 02 19:03:25.547428 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.547363    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" podStartSLOduration=68.547338095 podStartE2EDuration="1m8.547338095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.545871265 +0000 UTC m=+69.917625986" watchObservedRunningTime="2026-07-02 19:03:25.547338095 +0000 UTC m=+69.919092817"
Jul 02 19:03:25.620448 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.620376    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:25.623551 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:25.623501    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:26.114211 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.112612    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"]
Jul 02 19:03:26.131739 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.130406    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"]
Jul 02 19:03:26.131739 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.131204    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.134887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.133741    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"]
Jul 02 19:03:26.134887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.134060    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:03:26.134887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.134276    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:03:26.134887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.134659    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 19:03:26.135171 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.134967    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-snchv\""
Jul 02 19:03:26.135171 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.135156    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:03:26.135471 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.135451    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.137777 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.137734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"]
Jul 02 19:03:26.137777 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.137762    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"]
Jul 02 19:03:26.137969 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.137875    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.141869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.141842    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"]
Jul 02 19:03:26.144226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.143156    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 19:03:26.144226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.143439    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 19:03:26.144226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.143669    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 19:03:26.144226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.143879    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 19:03:26.144226 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.144096    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 19:03:26.158189 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.157706    2572 scope.go:117] "RemoveContainer" containerID="f3dd1eb29c59df39d20805977d42921eec905a157af689c85aa47be727bc7948"
Jul 02 19:03:26.206112 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.205240    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"]
Jul 02 19:03:26.210977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.210955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.213677 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.213654    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 19:03:26.214071 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.214051    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jd95m\""
Jul 02 19:03:26.216039 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.216027    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 19:03:26.232241 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.232174    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"]
Jul 02 19:03:26.258532 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-hub\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.258697 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sv9v\" (UniqueName: \"kubernetes.io/projected/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-kube-api-access-4sv9v\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.258697 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258591    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.258697 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.258697 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258676    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7caea9d-5107-4430-b9e6-8de750e4c9db-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67df85c7cb-4mmj4\" (UID: \"e7caea9d-5107-4430-b9e6-8de750e4c9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.258959 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258724    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-ca\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.258959 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kszt4\" (UniqueName: \"kubernetes.io/projected/e7caea9d-5107-4430-b9e6-8de750e4c9db-kube-api-access-kszt4\") pod \"managed-serviceaccount-addon-agent-67df85c7cb-4mmj4\" (UID: \"e7caea9d-5107-4430-b9e6-8de750e4c9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.258959 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.258949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.259109 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.259030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e2aee0b-6d06-414f-9d63-d97d057a8954-klusterlet-config\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.259109 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.259060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvdsd\" (UniqueName: \"kubernetes.io/projected/3e2aee0b-6d06-414f-9d63-d97d057a8954-kube-api-access-gvdsd\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.259207 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.259123    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e2aee0b-6d06-414f-9d63-d97d057a8954-tmp\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.259207 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.259176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d3802f7-7635-420a-a1c1-d3b47cfdf88a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j2khf\" (UID: \"7d3802f7-7635-420a-a1c1-d3b47cfdf88a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.261408 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.259221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d3802f7-7635-420a-a1c1-d3b47cfdf88a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j2khf\" (UID: \"7d3802f7-7635-420a-a1c1-d3b47cfdf88a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.359818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.359768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kszt4\" (UniqueName: \"kubernetes.io/projected/e7caea9d-5107-4430-b9e6-8de750e4c9db-kube-api-access-kszt4\") pod \"managed-serviceaccount-addon-agent-67df85c7cb-4mmj4\" (UID: \"e7caea9d-5107-4430-b9e6-8de750e4c9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.360015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.359842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.360015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.359885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e2aee0b-6d06-414f-9d63-d97d057a8954-klusterlet-config\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.360015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.359914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvdsd\" (UniqueName: \"kubernetes.io/projected/3e2aee0b-6d06-414f-9d63-d97d057a8954-kube-api-access-gvdsd\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.360015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.359939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e2aee0b-6d06-414f-9d63-d97d057a8954-tmp\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.360015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.359966    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d3802f7-7635-420a-a1c1-d3b47cfdf88a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j2khf\" (UID: \"7d3802f7-7635-420a-a1c1-d3b47cfdf88a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.360269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.360015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d3802f7-7635-420a-a1c1-d3b47cfdf88a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j2khf\" (UID: \"7d3802f7-7635-420a-a1c1-d3b47cfdf88a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.360269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.360042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-hub\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.360269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.360068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sv9v\" (UniqueName: \"kubernetes.io/projected/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-kube-api-access-4sv9v\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.360269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.360094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.360269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.360143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.361274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.360956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7caea9d-5107-4430-b9e6-8de750e4c9db-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67df85c7cb-4mmj4\" (UID: \"e7caea9d-5107-4430-b9e6-8de750e4c9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.361274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.361013    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-ca\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.361274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.361073    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e2aee0b-6d06-414f-9d63-d97d057a8954-tmp\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.361493 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.361359    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.361564 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.361543    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d3802f7-7635-420a-a1c1-d3b47cfdf88a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j2khf\" (UID: \"7d3802f7-7635-420a-a1c1-d3b47cfdf88a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.366761 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.366679    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e2aee0b-6d06-414f-9d63-d97d057a8954-klusterlet-config\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.367337 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.367290    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.368179 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.368139    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d3802f7-7635-420a-a1c1-d3b47cfdf88a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j2khf\" (UID: \"7d3802f7-7635-420a-a1c1-d3b47cfdf88a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.368277 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.368258    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-hub\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.369566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.369450    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.369712 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.369688    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7caea9d-5107-4430-b9e6-8de750e4c9db-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67df85c7cb-4mmj4\" (UID: \"e7caea9d-5107-4430-b9e6-8de750e4c9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.372291 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.372266    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-ca\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.375623 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.375596    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sv9v\" (UniqueName: \"kubernetes.io/projected/6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a-kube-api-access-4sv9v\") pod \"cluster-proxy-proxy-agent-5d676f77b-82pln\" (UID: \"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.378931 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.378893    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kszt4\" (UniqueName: \"kubernetes.io/projected/e7caea9d-5107-4430-b9e6-8de750e4c9db-kube-api-access-kszt4\") pod \"managed-serviceaccount-addon-agent-67df85c7cb-4mmj4\" (UID: \"e7caea9d-5107-4430-b9e6-8de750e4c9db\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.379188 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.379145    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvdsd\" (UniqueName: \"kubernetes.io/projected/3e2aee0b-6d06-414f-9d63-d97d057a8954-kube-api-access-gvdsd\") pod \"klusterlet-addon-workmgr-86c9679797-n7vtg\" (UID: \"3e2aee0b-6d06-414f-9d63-d97d057a8954\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.462514 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.462473    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"
Jul 02 19:03:26.474034 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.474004    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:26.506965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.506573    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"
Jul 02 19:03:26.524548 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.523259    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:03:26.524548 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.523370    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" event={"ID":"2cccf563-ab49-48b6-9f72-d9508c8a04ce","Type":"ContainerStarted","Data":"19afe35800e9b006ba4cc6c3c5baa1cec4070cc4bad1ddd0af804e36de7b3f6b"}
Jul 02 19:03:26.524548 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.524483    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:03:26.529786 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.529407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-24bgr" event={"ID":"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc","Type":"ContainerStarted","Data":"cb87f9970f51dbc97c97bd95be564d0124d740d701125f518d3ee816b9c40bbc"}
Jul 02 19:03:26.529786 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.529472    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:26.529786 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.529493    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-24bgr" event={"ID":"03c2b116-1d0c-4b5a-ab9f-0c601e7236dc","Type":"ContainerStarted","Data":"a2797d5ea74cbed639c5c81ab3f5a89ad1a845fd88106df29f30b4da32e14b4e"}
Jul 02 19:03:26.531612 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.531570    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5db59696f7-89w6b"
Jul 02 19:03:26.539719 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.539490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"
Jul 02 19:03:26.612851 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.607821    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-24bgr" podStartSLOduration=69.373456369 podStartE2EDuration="1m10.607782437s" totalImagesPullingTime="1.234326068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:26.605833831 +0000 UTC m=+70.977588552" watchObservedRunningTime="2026-07-02 19:03:26.607782437 +0000 UTC m=+70.979537160"
Jul 02 19:03:26.612851 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.608036    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g" podStartSLOduration=34.327272726 podStartE2EDuration="43.608025692s" totalImagesPullingTime="9.280752966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:26.576666427 +0000 UTC m=+70.948421148" watchObservedRunningTime="2026-07-02 19:03:26.608025692 +0000 UTC m=+70.979780413"
Jul 02 19:03:26.697608 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.697572    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4"]
Jul 02 19:03:26.709517 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:26.709462    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7caea9d_5107_4430_b9e6_8de750e4c9db.slice/crio-8a35b8ca887c6d9ba6b20e0d396727cc72a31a1dc2a6a09486144c4068f909df WatchSource:0}: Error finding container 8a35b8ca887c6d9ba6b20e0d396727cc72a31a1dc2a6a09486144c4068f909df: Status 404 returned error can't find the container with id 8a35b8ca887c6d9ba6b20e0d396727cc72a31a1dc2a6a09486144c4068f909df
Jul 02 19:03:26.739173 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.739135    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"]
Jul 02 19:03:26.796493 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.796046    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln"]
Jul 02 19:03:26.812252 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:26.812200    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6df8b55a_fc5a_4100_b4d6_48fd6bd8a88a.slice/crio-81f3e2a800097c41dfe52d93d3aac7d74e4ac9fbc871b77f5a0abad2e927c769 WatchSource:0}: Error finding container 81f3e2a800097c41dfe52d93d3aac7d74e4ac9fbc871b77f5a0abad2e927c769: Status 404 returned error can't find the container with id 81f3e2a800097c41dfe52d93d3aac7d74e4ac9fbc871b77f5a0abad2e927c769
Jul 02 19:03:26.882366 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:26.882203    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j2khf"]
Jul 02 19:03:26.886886 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:26.886847    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3802f7_7635_420a_a1c1_d3b47cfdf88a.slice/crio-fb197ca70de15c5ce54eacd36d0790d092c81ee2da1cfa79ad55251f42e92241 WatchSource:0}: Error finding container fb197ca70de15c5ce54eacd36d0790d092c81ee2da1cfa79ad55251f42e92241: Status 404 returned error can't find the container with id fb197ca70de15c5ce54eacd36d0790d092c81ee2da1cfa79ad55251f42e92241
Jul 02 19:03:27.058593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.058305    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-bxd4g"
Jul 02 19:03:27.239935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.239701    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-6rntt"]
Jul 02 19:03:27.244822 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.244784    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:03:27.249476 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.249453    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vmfc5\""
Jul 02 19:03:27.249749 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.249730    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:03:27.249994 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.249976    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:03:27.255397 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.255339    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6rntt"]
Jul 02 19:03:27.411086 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.410999    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24zp\" (UniqueName: \"kubernetes.io/projected/531354b8-bd16-4540-aa87-dc7b1f59732f-kube-api-access-c24zp\") pod \"downloads-685bfb5f64-6rntt\" (UID: \"531354b8-bd16-4540-aa87-dc7b1f59732f\") " pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:03:27.512699 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.512589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24zp\" (UniqueName: \"kubernetes.io/projected/531354b8-bd16-4540-aa87-dc7b1f59732f-kube-api-access-c24zp\") pod \"downloads-685bfb5f64-6rntt\" (UID: \"531354b8-bd16-4540-aa87-dc7b1f59732f\") " pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:03:27.521429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.521396    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24zp\" (UniqueName: \"kubernetes.io/projected/531354b8-bd16-4540-aa87-dc7b1f59732f-kube-api-access-c24zp\") pod \"downloads-685bfb5f64-6rntt\" (UID: \"531354b8-bd16-4540-aa87-dc7b1f59732f\") " pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:03:27.536419 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.536382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf" event={"ID":"7d3802f7-7635-420a-a1c1-d3b47cfdf88a","Type":"ContainerStarted","Data":"fb197ca70de15c5ce54eacd36d0790d092c81ee2da1cfa79ad55251f42e92241"}
Jul 02 19:03:27.538450 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.538414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg" event={"ID":"3e2aee0b-6d06-414f-9d63-d97d057a8954","Type":"ContainerStarted","Data":"9c7d0a09f52952ed7e09ebe3c4b98b20889ee2a2d06837cea7122997b0934551"}
Jul 02 19:03:27.540043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.540013    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4" event={"ID":"e7caea9d-5107-4430-b9e6-8de750e4c9db","Type":"ContainerStarted","Data":"8a35b8ca887c6d9ba6b20e0d396727cc72a31a1dc2a6a09486144c4068f909df"}
Jul 02 19:03:27.542217 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.541859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln" event={"ID":"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a","Type":"ContainerStarted","Data":"81f3e2a800097c41dfe52d93d3aac7d74e4ac9fbc871b77f5a0abad2e927c769"}
Jul 02 19:03:27.560636 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:27.560604    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:03:34.356948 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:34.356920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6rntt"]
Jul 02 19:03:37.196750 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:37.196717    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531354b8_bd16_4540_aa87_dc7b1f59732f.slice/crio-3e7e42100db1aeb28ee80ca8358bd9264e95e7f7867f19b450b4cc955263779d WatchSource:0}: Error finding container 3e7e42100db1aeb28ee80ca8358bd9264e95e7f7867f19b450b4cc955263779d: Status 404 returned error can't find the container with id 3e7e42100db1aeb28ee80ca8358bd9264e95e7f7867f19b450b4cc955263779d
Jul 02 19:03:37.588714 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:37.588671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6rntt" event={"ID":"531354b8-bd16-4540-aa87-dc7b1f59732f","Type":"ContainerStarted","Data":"3e7e42100db1aeb28ee80ca8358bd9264e95e7f7867f19b450b4cc955263779d"}
Jul 02 19:03:38.597078 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.597012    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98hmj" event={"ID":"99fc9be5-dcf9-420d-84d1-84d98b65f980","Type":"ContainerStarted","Data":"8709790f2cd76608173cd455874970a295966bff1d35b1c5fd3eea7d042ee184"}
Jul 02 19:03:38.599464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.599260    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkh4n" event={"ID":"510cc5e4-74d7-4a78-b5ab-000cf3718710","Type":"ContainerStarted","Data":"fa02a8bdd5b02807f660067beee8844dda63d500fc218f52713b8087ea30dfb7"}
Jul 02 19:03:38.599464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.599315    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:38.599464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.599336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkh4n" event={"ID":"510cc5e4-74d7-4a78-b5ab-000cf3718710","Type":"ContainerStarted","Data":"aea5d79c90dbd8188162605455408d5ff5ac59d567ba8e648ae5b325992d70f5"}
Jul 02 19:03:38.601252 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.601207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jc67t" event={"ID":"d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19","Type":"ContainerStarted","Data":"f8b8e77c9c73b72fb7206a8518bed56a0ffb64f6f42b5061e7b5547923e5f425"}
Jul 02 19:03:38.603454 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.603423    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf" event={"ID":"7d3802f7-7635-420a-a1c1-d3b47cfdf88a","Type":"ContainerStarted","Data":"0eccb7a69ad7033c32d2f9f3fbdd5501022110e0ed03e8d0e78779954604afb6"}
Jul 02 19:03:38.605091 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.605067    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg" event={"ID":"3e2aee0b-6d06-414f-9d63-d97d057a8954","Type":"ContainerStarted","Data":"16ff240c2fae8cc9f5ad761804833057693f27a781846977d35efe9d8e6a074a"}
Jul 02 19:03:38.605246 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.605229    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:38.606869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.606844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4" event={"ID":"e7caea9d-5107-4430-b9e6-8de750e4c9db","Type":"ContainerStarted","Data":"09adff3cde224b5a9b45992f240144d4f80c0e4ac747a44bd105ce1dbc7d771c"}
Jul 02 19:03:38.607170 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.607152    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg"
Jul 02 19:03:38.608989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.608960    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj" event={"ID":"f1cffd56-8726-47a1-9b35-51d2fa542c69","Type":"ContainerStarted","Data":"654a20033fd2011d9b8ce391444dd77c1b0190d28b5f22d7eb36923d5cd2459f"}
Jul 02 19:03:38.611272 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.611245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln" event={"ID":"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a","Type":"ContainerStarted","Data":"60526eb881d16572e5062bf37044093020f2f53f192532a6251c7f683b83fd5e"}
Jul 02 19:03:38.611367 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.611279    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln" event={"ID":"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a","Type":"ContainerStarted","Data":"021d718d01665488505b14aed987aa8b7c464470e8be43a63a7e1e96c5297887"}
Jul 02 19:03:38.611367 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.611301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln" event={"ID":"6df8b55a-fc5a-4100-b4d6-48fd6bd8a88a","Type":"ContainerStarted","Data":"29441f70dfd69085881e1dd1345387ee520907c81e1cd02ecb8111758be5c8f9"}
Jul 02 19:03:38.625009 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.624955    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-98hmj" podStartSLOduration=19.8464396 podStartE2EDuration="34.624939066s" totalImagesPullingTime="14.778499466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.623045537 +0000 UTC m=+82.994800262" watchObservedRunningTime="2026-07-02 19:03:38.624939066 +0000 UTC m=+82.996693786"
Jul 02 19:03:38.648240 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.648172    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67df85c7cb-4mmj4" podStartSLOduration=1.4188394610000001 podStartE2EDuration="12.648151348s" totalImagesPullingTime="11.229311887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.646655525 +0000 UTC m=+83.018410248" watchObservedRunningTime="2026-07-02 19:03:38.648151348 +0000 UTC m=+83.019906070"
Jul 02 19:03:38.671567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.671514    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d676f77b-82pln" podStartSLOduration=1.547417023 podStartE2EDuration="12.671498053s" totalImagesPullingTime="11.12408103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.670638729 +0000 UTC m=+83.042393464" watchObservedRunningTime="2026-07-02 19:03:38.671498053 +0000 UTC m=+83.043252769"
Jul 02 19:03:38.688934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.688875    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vtqvj" podStartSLOduration=42.561275342 podStartE2EDuration="55.688857979s" totalImagesPullingTime="13.127582637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.688077006 +0000 UTC m=+83.059831739" watchObservedRunningTime="2026-07-02 19:03:38.688857979 +0000 UTC m=+83.060612698"
Jul 02 19:03:38.706795 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.706741    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j2khf" podStartSLOduration=1.6569551420000002 podStartE2EDuration="12.706724802s" totalImagesPullingTime="11.04976966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.705200635 +0000 UTC m=+83.076955355" watchObservedRunningTime="2026-07-02 19:03:38.706724802 +0000 UTC m=+83.078479572"
Jul 02 19:03:38.725717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.725664    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jc67t" podStartSLOduration=68.367771404 podStartE2EDuration="1m21.725647483s" totalImagesPullingTime="13.357876079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.724357333 +0000 UTC m=+83.096112054" watchObservedRunningTime="2026-07-02 19:03:38.725647483 +0000 UTC m=+83.097402195"
Jul 02 19:03:38.749234 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.749173    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tkh4n" podStartSLOduration=36.229393182 podStartE2EDuration="46.749157761s" totalImagesPullingTime="10.519764579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.747755765 +0000 UTC m=+83.119510490" watchObservedRunningTime="2026-07-02 19:03:38.749157761 +0000 UTC m=+83.120912481"
Jul 02 19:03:38.766382 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:38.766328    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86c9679797-n7vtg" podStartSLOduration=1.575002876 podStartE2EDuration="12.76630909s" totalImagesPullingTime="11.191306214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:38.765344263 +0000 UTC m=+83.137098986" watchObservedRunningTime="2026-07-02 19:03:38.76630909 +0000 UTC m=+83.138063810"
Jul 02 19:03:44.576048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:44.576007    2572 patch_prober.go:28] interesting pod/image-registry-58bdcd677c-j6jt7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 19:03:44.576463 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:44.576066    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:03:46.536332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:46.536296    2572 patch_prober.go:28] interesting pod/image-registry-58bdcd677c-j6jt7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 19:03:46.536756 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:46.536349    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:03:48.135171 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.135140    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k4n8j"]
Jul 02 19:03:48.142531 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.142506    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.146141 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.146112    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:03:48.146560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.146408    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:03:48.146671 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.146575    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:03:48.146948 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.146925    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2g2r7\""
Jul 02 19:03:48.147076 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.147058    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:03:48.184733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.184733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966xd\" (UniqueName: \"kubernetes.io/projected/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-kube-api-access-966xd\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.184733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.184733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-metrics-client-ca\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.185099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-textfile\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.185099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184921    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-wtmp\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.185099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-tls\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.185099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.184981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-sys\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.185099 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.185005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-root\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.285760 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.285955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966xd\" (UniqueName: \"kubernetes.io/projected/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-kube-api-access-966xd\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.285955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.285955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-metrics-client-ca\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.285955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285927    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-textfile\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.285955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-wtmp\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.285977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-tls\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286006    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-sys\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-root\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286107    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-root\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286411 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286237    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-wtmp\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286411 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:48.286324    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 19:03:48.286411 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:03:48.286399    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-tls podName:0d129a21-a3b5-4c42-b05b-0b1c98fec73f nodeName:}" failed. No retries permitted until 2026-07-02 19:03:48.786381064 +0000 UTC m=+93.158135770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-tls") pod "node-exporter-k4n8j" (UID: "0d129a21-a3b5-4c42-b05b-0b1c98fec73f") : secret "node-exporter-tls" not found
Jul 02 19:03:48.286411 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-textfile\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286605 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286406    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286660 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286618    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-sys\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.286921 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.286899    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-metrics-client-ca\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.289045 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.289022    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.296918 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.296838    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966xd\" (UniqueName: \"kubernetes.io/projected/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-kube-api-access-966xd\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.617838 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.617629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tkh4n"
Jul 02 19:03:48.790192 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.790149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-tls\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:48.792413 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:48.792388    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d129a21-a3b5-4c42-b05b-0b1c98fec73f-node-exporter-tls\") pod \"node-exporter-k4n8j\" (UID: \"0d129a21-a3b5-4c42-b05b-0b1c98fec73f\") " pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:49.055752 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:49.055715    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k4n8j"
Jul 02 19:03:49.070529 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:03:49.070495    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d129a21_a3b5_4c42_b05b_0b1c98fec73f.slice/crio-b1292d9d0d06c0826666e98228003b1d782817005687a3e29e2ec1608900232b WatchSource:0}: Error finding container b1292d9d0d06c0826666e98228003b1d782817005687a3e29e2ec1608900232b: Status 404 returned error can't find the container with id b1292d9d0d06c0826666e98228003b1d782817005687a3e29e2ec1608900232b
Jul 02 19:03:49.671157 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:49.671114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4n8j" event={"ID":"0d129a21-a3b5-4c42-b05b-0b1c98fec73f","Type":"ContainerStarted","Data":"b1292d9d0d06c0826666e98228003b1d782817005687a3e29e2ec1608900232b"}
Jul 02 19:03:50.676825 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:50.676770    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d129a21-a3b5-4c42-b05b-0b1c98fec73f" containerID="d413b5f4cdd862754e757ecc493ae47f8b5f8d1b39658e0f30251bd2eb7f2aeb" exitCode=0
Jul 02 19:03:50.677220 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:50.676836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4n8j" event={"ID":"0d129a21-a3b5-4c42-b05b-0b1c98fec73f","Type":"ContainerDied","Data":"d413b5f4cdd862754e757ecc493ae47f8b5f8d1b39658e0f30251bd2eb7f2aeb"}
Jul 02 19:03:51.682425 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:51.682388    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4n8j" event={"ID":"0d129a21-a3b5-4c42-b05b-0b1c98fec73f","Type":"ContainerStarted","Data":"a9aea07e8f6427a7f2d58e7592cc28446ad4220d91accb5c597764e5cfb19602"}
Jul 02 19:03:51.682839 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:51.682448    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4n8j" event={"ID":"0d129a21-a3b5-4c42-b05b-0b1c98fec73f","Type":"ContainerStarted","Data":"7ef3ea4db7722e029c069560303bcd924413fe852ad28dcb2259cf35ff906654"}
Jul 02 19:03:51.705321 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:51.705267    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k4n8j" podStartSLOduration=2.721412035 podStartE2EDuration="3.70524694s" totalImagesPullingTime="910.960956ms" totalInitContainerRuntime="72.873949ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:51.704160251 +0000 UTC m=+96.075914973" watchObservedRunningTime="2026-07-02 19:03:51.70524694 +0000 UTC m=+96.077001678"
Jul 02 19:03:54.577611 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:54.577526    2572 patch_prober.go:28] interesting pod/image-registry-58bdcd677c-j6jt7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 19:03:54.578494 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:54.577862    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:03:55.486645 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:55.486607    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58bdcd677c-j6jt7"]
Jul 02 19:03:55.491777 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:55.491734    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:03:55.508447 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:55.508410    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cd9wj"
Jul 02 19:03:59.721626 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:59.721124    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6rntt" event={"ID":"531354b8-bd16-4540-aa87-dc7b1f59732f","Type":"ContainerStarted","Data":"0b88415b59d88b2a77b7ca7c8196cc72197277aeeb2ad117f8d3a75f178a6d84"}
Jul 02 19:03:59.721626 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:59.721586    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:03:59.723406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:59.723373    2572 patch_prober.go:28] interesting pod/downloads-685bfb5f64-6rntt container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body=
Jul 02 19:03:59.723528 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:59.723430    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-6rntt" podUID="531354b8-bd16-4540-aa87-dc7b1f59732f" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 19:03:59.758465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:03:59.758369    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-6rntt" podStartSLOduration=10.922123361 podStartE2EDuration="32.758352451s" totalImagesPullingTime="21.83622909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:59.758262161 +0000 UTC m=+104.130016883" watchObservedRunningTime="2026-07-02 19:03:59.758352451 +0000 UTC m=+104.130107214"
Jul 02 19:04:00.741181 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:00.741149    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-6rntt"
Jul 02 19:04:13.780791 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:13.780738    2572 generic.go:356] "Generic (PLEG): container finished" podID="45c43a6b-6053-47e2-81c9-4a01e8e22407" containerID="4ec9a61898c8dff982a5a8638a9a26cb3e940d3b2ff8df4bd445fe4b40ae55f8" exitCode=0
Jul 02 19:04:13.781327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:13.780828    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h" event={"ID":"45c43a6b-6053-47e2-81c9-4a01e8e22407","Type":"ContainerDied","Data":"4ec9a61898c8dff982a5a8638a9a26cb3e940d3b2ff8df4bd445fe4b40ae55f8"}
Jul 02 19:04:13.781327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:13.781216    2572 scope.go:117] "RemoveContainer" containerID="4ec9a61898c8dff982a5a8638a9a26cb3e940d3b2ff8df4bd445fe4b40ae55f8"
Jul 02 19:04:13.782363 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:13.782344    2572 generic.go:356] "Generic (PLEG): container finished" podID="c178c7b7-d1e3-41b3-ae86-be8335b2c5c6" containerID="084971b4b6000522240c6fbcc5645a098d9d22247a1e50ce77134e967de0fb20" exitCode=0
Jul 02 19:04:13.782442 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:13.782393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn" event={"ID":"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6","Type":"ContainerDied","Data":"084971b4b6000522240c6fbcc5645a098d9d22247a1e50ce77134e967de0fb20"}
Jul 02 19:04:13.782665 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:13.782653    2572 scope.go:117] "RemoveContainer" containerID="084971b4b6000522240c6fbcc5645a098d9d22247a1e50ce77134e967de0fb20"
Jul 02 19:04:14.787764 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:14.787724    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ms56h" event={"ID":"45c43a6b-6053-47e2-81c9-4a01e8e22407","Type":"ContainerStarted","Data":"03f0fc2d187f970ca805f84a89e39a387ea0577e394aedeff989db28be9af0fc"}
Jul 02 19:04:14.789489 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:14.789468    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8xlfn" event={"ID":"c178c7b7-d1e3-41b3-ae86-be8335b2c5c6","Type":"ContainerStarted","Data":"cb1348834909e47e9d5cece3813df474f578999ca39b06f9e7ee5a31865aba7e"}
Jul 02 19:04:20.511169 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.511104    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry" containerID="cri-o://d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a" gracePeriod=30
Jul 02 19:04:20.784373 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.784296    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:04:20.813274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.813243    2572 generic.go:356] "Generic (PLEG): container finished" podID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerID="d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a" exitCode=0
Jul 02 19:04:20.813442 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.813281    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7"
Jul 02 19:04:20.813442 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.813290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" event={"ID":"22bda52b-381e-46b7-a2f0-52fa6ed85aa0","Type":"ContainerDied","Data":"d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a"}
Jul 02 19:04:20.813442 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.813334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bdcd677c-j6jt7" event={"ID":"22bda52b-381e-46b7-a2f0-52fa6ed85aa0","Type":"ContainerDied","Data":"f86e7f0e02cef4009c2914683fd66b671c0dc10d17d434191175a7697b20611b"}
Jul 02 19:04:20.813442 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.813359    2572 scope.go:117] "RemoveContainer" containerID="d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a"
Jul 02 19:04:20.821697 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.821679    2572 scope.go:117] "RemoveContainer" containerID="d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a"
Jul 02 19:04:20.822002 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:04:20.821980    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a\": container with ID starting with d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a not found: ID does not exist" containerID="d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a"
Jul 02 19:04:20.822074 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.822011    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a"} err="failed to get container status \"d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a\": rpc error: code = NotFound desc = could not find container \"d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a\": container with ID starting with d8c26f932847c311a9ac3b73b216bbe4eab241a7ae5099f7fcc99ddad0d6069a not found: ID does not exist"
Jul 02 19:04:20.884488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884460    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-ca-trust-extracted\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.884676 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884504    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-image-registry-private-configuration\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.884676 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884574    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-trusted-ca\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.884676 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884607    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-installation-pull-secrets\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.884676 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-bound-sa-token\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.884902 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884828    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-certificates\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.885017 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.884997    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.885375 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.885166    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntlhr\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-kube-api-access-ntlhr\") pod \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\" (UID: \"22bda52b-381e-46b7-a2f0-52fa6ed85aa0\") "
Jul 02 19:04:20.885375 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.885181    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:04:20.885375 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.885274    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:04:20.885564 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.885475    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-trusted-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.885564 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.885495    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-certificates\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.887412 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.887383    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:04:20.887600 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.887580    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:04:20.887682 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.887587    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:04:20.887682 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.887653    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-kube-api-access-ntlhr" (OuterVolumeSpecName: "kube-api-access-ntlhr") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "kube-api-access-ntlhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:04:20.887836 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.887817    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:04:20.893213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.893169    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "22bda52b-381e-46b7-a2f0-52fa6ed85aa0" (UID: "22bda52b-381e-46b7-a2f0-52fa6ed85aa0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:04:20.986800 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.986764    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-ca-trust-extracted\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.986800 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.986794    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-image-registry-private-configuration\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.986800 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.986817    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-installation-pull-secrets\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.987037 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.986838    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-bound-sa-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.987037 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.986846    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-registry-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:20.987037 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:20.986855    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntlhr\" (UniqueName: \"kubernetes.io/projected/22bda52b-381e-46b7-a2f0-52fa6ed85aa0-kube-api-access-ntlhr\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:04:21.137312 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:21.137278    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58bdcd677c-j6jt7"]
Jul 02 19:04:21.144422 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:21.144392    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58bdcd677c-j6jt7"]
Jul 02 19:04:22.161922 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:22.161889    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" path="/var/lib/kubelet/pods/22bda52b-381e-46b7-a2f0-52fa6ed85aa0/volumes"
Jul 02 19:04:28.848996 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:28.848905    2572 generic.go:356] "Generic (PLEG): container finished" podID="19f2d0ce-1a4a-48e3-b367-5da8db66ed32" containerID="bbba07b46de00c7b65def7a36f0180a601153bba0eda7bdd989fa6b0fc47f9d8" exitCode=0
Jul 02 19:04:28.848996 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:28.848976    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8" event={"ID":"19f2d0ce-1a4a-48e3-b367-5da8db66ed32","Type":"ContainerDied","Data":"bbba07b46de00c7b65def7a36f0180a601153bba0eda7bdd989fa6b0fc47f9d8"}
Jul 02 19:04:28.849483 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:28.849333    2572 scope.go:117] "RemoveContainer" containerID="bbba07b46de00c7b65def7a36f0180a601153bba0eda7bdd989fa6b0fc47f9d8"
Jul 02 19:04:29.859893 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:04:29.859860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5dhf8" event={"ID":"19f2d0ce-1a4a-48e3-b367-5da8db66ed32","Type":"ContainerStarted","Data":"071e9c2731aa1952b769c016ee037786320730d2f276e40fb52d13d766e570ab"}
Jul 02 19:07:16.058469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:16.058438    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:07:16.065772 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:16.065748    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:07:16.069869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:16.069845    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:07:47.460238 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.460203    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"]
Jul 02 19:07:47.462024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.460625    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry"
Jul 02 19:07:47.462024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.460645    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry"
Jul 02 19:07:47.462024 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.460735    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="22bda52b-381e-46b7-a2f0-52fa6ed85aa0" containerName="registry"
Jul 02 19:07:47.462468 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.462450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.465248 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.465222    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:07:47.465362 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.465289    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:07:47.465362 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.465293    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hgcj5\""
Jul 02 19:07:47.465362 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.465340    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:07:47.465654 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.465639    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:07:47.502146 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.502115    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"]
Jul 02 19:07:47.549770 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.549740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd895\" (UniqueName: \"kubernetes.io/projected/36ce6334-3cef-4a1d-8c35-bd4e98419017-kube-api-access-hd895\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.549928 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.549778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36ce6334-3cef-4a1d-8c35-bd4e98419017-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.549928 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.549824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36ce6334-3cef-4a1d-8c35-bd4e98419017-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.549928 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.549863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36ce6334-3cef-4a1d-8c35-bd4e98419017-manifests\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.549928 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.549893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ce6334-3cef-4a1d-8c35-bd4e98419017-tmp\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.651082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.651046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ce6334-3cef-4a1d-8c35-bd4e98419017-tmp\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.651259 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.651101    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd895\" (UniqueName: \"kubernetes.io/projected/36ce6334-3cef-4a1d-8c35-bd4e98419017-kube-api-access-hd895\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.651259 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.651128    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36ce6334-3cef-4a1d-8c35-bd4e98419017-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.651259 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.651150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36ce6334-3cef-4a1d-8c35-bd4e98419017-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.651259 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.651171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36ce6334-3cef-4a1d-8c35-bd4e98419017-manifests\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.651589 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.651556    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36ce6334-3cef-4a1d-8c35-bd4e98419017-manifests\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.653366 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.653339    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ce6334-3cef-4a1d-8c35-bd4e98419017-tmp\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.653561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.653543    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36ce6334-3cef-4a1d-8c35-bd4e98419017-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.653601 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.653569    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36ce6334-3cef-4a1d-8c35-bd4e98419017-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.663720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.663697    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd895\" (UniqueName: \"kubernetes.io/projected/36ce6334-3cef-4a1d-8c35-bd4e98419017-kube-api-access-hd895\") pod \"opendatahub-operator-controller-manager-6cd5847cc4-6hf84\" (UID: \"36ce6334-3cef-4a1d-8c35-bd4e98419017\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.773012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.772975    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:07:47.932403 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.928429    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"]
Jul 02 19:07:47.934143 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:47.934122    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:07:48.604166 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:48.604121    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84" event={"ID":"36ce6334-3cef-4a1d-8c35-bd4e98419017","Type":"ContainerStarted","Data":"733a1b75e5bb83c1eb294e0de5ec20a33d0de7f72ea0a5a233ccfe2c6dd5c9e0"}
Jul 02 19:07:51.620922 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:51.620886    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84" event={"ID":"36ce6334-3cef-4a1d-8c35-bd4e98419017","Type":"ContainerStarted","Data":"11466e84cb0745d171c8e0e533036f1ee3bdeb7cc71bf1f37cd2b32dc4f693e0"}
Jul 02 19:07:52.626937 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:52.626837    2572 generic.go:356] "Generic (PLEG): container finished" podID="36ce6334-3cef-4a1d-8c35-bd4e98419017" containerID="11466e84cb0745d171c8e0e533036f1ee3bdeb7cc71bf1f37cd2b32dc4f693e0" exitCode=0
Jul 02 19:07:52.626937 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:52.626914    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84" event={"ID":"36ce6334-3cef-4a1d-8c35-bd4e98419017","Type":"ContainerDied","Data":"11466e84cb0745d171c8e0e533036f1ee3bdeb7cc71bf1f37cd2b32dc4f693e0"}
Jul 02 19:07:53.633119 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:53.633077    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84" event={"ID":"36ce6334-3cef-4a1d-8c35-bd4e98419017","Type":"ContainerStarted","Data":"76c319e32c8ee73ef32b7cb556c130288f6e70fe6d64c0fdae52bcebe3b2e3ad"}
Jul 02 19:07:53.633602 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:07:53.633210    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:08:04.641989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:04.641951    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84"
Jul 02 19:08:04.681983 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:04.681928    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cd5847cc4-6hf84" podStartSLOduration=13.139002937 podStartE2EDuration="17.681912844s" totalImagesPullingTime="3.536633735s" totalInitContainerRuntime="1.006276172s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:07:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:53.658394542 +0000 UTC m=+338.030149264" watchObservedRunningTime="2026-07-02 19:08:04.681912844 +0000 UTC m=+349.053667566"
Jul 02 19:08:20.200521 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.200487    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"]
Jul 02 19:08:20.206237 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.206210    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.208698 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.208669    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 19:08:20.208851 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.208682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nwzwr\""
Jul 02 19:08:20.209849 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.209827    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:08:20.209932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.209859    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 19:08:20.210741 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.210726    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 19:08:20.211089 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.211075    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:08:20.216068 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.216045    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"]
Jul 02 19:08:20.322500 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.322470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f38e3fe3-75c9-42c1-b214-d6d54414794c-cert\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.322675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.322519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f38e3fe3-75c9-42c1-b214-d6d54414794c-manager-config\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.322675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.322574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f38e3fe3-75c9-42c1-b214-d6d54414794c-metrics-cert\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.322675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.322615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svfnk\" (UniqueName: \"kubernetes.io/projected/f38e3fe3-75c9-42c1-b214-d6d54414794c-kube-api-access-svfnk\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.423505 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.423471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f38e3fe3-75c9-42c1-b214-d6d54414794c-manager-config\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.423694 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.423519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f38e3fe3-75c9-42c1-b214-d6d54414794c-metrics-cert\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.423694 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.423551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svfnk\" (UniqueName: \"kubernetes.io/projected/f38e3fe3-75c9-42c1-b214-d6d54414794c-kube-api-access-svfnk\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.423694 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.423620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f38e3fe3-75c9-42c1-b214-d6d54414794c-cert\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.424235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.424214    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f38e3fe3-75c9-42c1-b214-d6d54414794c-manager-config\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.425981 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.425952    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f38e3fe3-75c9-42c1-b214-d6d54414794c-cert\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.426055 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.426013    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f38e3fe3-75c9-42c1-b214-d6d54414794c-metrics-cert\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.432621 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.432600    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svfnk\" (UniqueName: \"kubernetes.io/projected/f38e3fe3-75c9-42c1-b214-d6d54414794c-kube-api-access-svfnk\") pod \"lws-controller-manager-6d578bc98c-j6lh7\" (UID: \"f38e3fe3-75c9-42c1-b214-d6d54414794c\") " pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.515853 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.515783    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:20.665605 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.665565    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"]
Jul 02 19:08:20.669162 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:08:20.669135    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38e3fe3_75c9_42c1_b214_d6d54414794c.slice/crio-da9e4d025d87a96683af21318bbeb3cf7c720d4fe80f07cd27460d9672376576 WatchSource:0}: Error finding container da9e4d025d87a96683af21318bbeb3cf7c720d4fe80f07cd27460d9672376576: Status 404 returned error can't find the container with id da9e4d025d87a96683af21318bbeb3cf7c720d4fe80f07cd27460d9672376576
Jul 02 19:08:20.747296 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:20.747262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7" event={"ID":"f38e3fe3-75c9-42c1-b214-d6d54414794c","Type":"ContainerStarted","Data":"da9e4d025d87a96683af21318bbeb3cf7c720d4fe80f07cd27460d9672376576"}
Jul 02 19:08:23.768036 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:23.768001    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7" event={"ID":"f38e3fe3-75c9-42c1-b214-d6d54414794c","Type":"ContainerStarted","Data":"e73b7f4a700e690acce3b70f3454d0e140d735a2d7aa5919a9dea62a266651bf"}
Jul 02 19:08:23.768434 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:23.768069    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:08:23.785222 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:23.785176    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7" podStartSLOduration=1.240219979 podStartE2EDuration="3.785158903s" totalImagesPullingTime="2.544938924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:23.784250675 +0000 UTC m=+368.156005408" watchObservedRunningTime="2026-07-02 19:08:23.785158903 +0000 UTC m=+368.156913623"
Jul 02 19:08:24.696442 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.696412    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"]
Jul 02 19:08:24.699666 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.699643    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.703864 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.703838    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 19:08:24.704136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.704119    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8cl9n\""
Jul 02 19:08:24.724130 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.724106    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"]
Jul 02 19:08:24.863844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.863797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.863874    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjllt\" (UniqueName: \"kubernetes.io/projected/a535b9c8-dc0a-49a9-8cf8-65462d007696-kube-api-access-fjllt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.863904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.864084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.864133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.864170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.864203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.864256    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.864324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.864280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a535b9c8-dc0a-49a9-8cf8-65462d007696-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965185 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965185 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965185 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965185 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965183    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965503 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a535b9c8-dc0a-49a9-8cf8-65462d007696-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965503 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965503 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjllt\" (UniqueName: \"kubernetes.io/projected/a535b9c8-dc0a-49a9-8cf8-65462d007696-kube-api-access-fjllt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965503 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965698 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965531    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965698 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965536    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965698 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965589    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965886 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965794    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.965926 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.965879    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.966048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.966032    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a535b9c8-dc0a-49a9-8cf8-65462d007696-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.967563 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.967537    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.967670 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.967634    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.973353 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.973331    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a535b9c8-dc0a-49a9-8cf8-65462d007696-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:24.973659 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:24.973638    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjllt\" (UniqueName: \"kubernetes.io/projected/a535b9c8-dc0a-49a9-8cf8-65462d007696-kube-api-access-fjllt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf485mnr\" (UID: \"a535b9c8-dc0a-49a9-8cf8-65462d007696\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:25.010861 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:25.010797    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:25.146548 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:25.146506    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"]
Jul 02 19:08:25.149155 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:08:25.149126    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda535b9c8_dc0a_49a9_8cf8_65462d007696.slice/crio-e68b253f370c8f8ff24d71135e791f19ccea5727b092a482955c1a36e468f1a4 WatchSource:0}: Error finding container e68b253f370c8f8ff24d71135e791f19ccea5727b092a482955c1a36e468f1a4: Status 404 returned error can't find the container with id e68b253f370c8f8ff24d71135e791f19ccea5727b092a482955c1a36e468f1a4
Jul 02 19:08:25.777650 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:25.777609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr" event={"ID":"a535b9c8-dc0a-49a9-8cf8-65462d007696","Type":"ContainerStarted","Data":"e68b253f370c8f8ff24d71135e791f19ccea5727b092a482955c1a36e468f1a4"}
Jul 02 19:08:28.718890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:28.718849    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:08:28.719199 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:28.718929    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:08:28.719199 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:28.718960    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:08:28.794112 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:28.794076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr" event={"ID":"a535b9c8-dc0a-49a9-8cf8-65462d007696","Type":"ContainerStarted","Data":"641d8f59730e456b5c99483eea391a483a3577bcbcbef49d7012bc8aaf9a96cd"}
Jul 02 19:08:28.814102 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:28.814057    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr" podStartSLOduration=1.246991265 podStartE2EDuration="4.814042528s" totalImagesPullingTime="3.567051263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:28.812562552 +0000 UTC m=+373.184317275" watchObservedRunningTime="2026-07-02 19:08:28.814042528 +0000 UTC m=+373.185797249"
Jul 02 19:08:29.011822 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:29.011778    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:29.012972 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:29.012946    2572 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf485mnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 02 19:08:29.013092 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:29.012996    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr" podUID="a535b9c8-dc0a-49a9-8cf8-65462d007696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 02 19:08:30.015165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:30.015133    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:30.804380 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:30.804351    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:30.805518 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:30.805499    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf485mnr"
Jul 02 19:08:34.775472 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:08:34.775442    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d578bc98c-j6lh7"
Jul 02 19:10:16.053465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.053427    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"]
Jul 02 19:10:16.056882 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.056858    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.060121 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.060097    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z4p6g\""
Jul 02 19:10:16.060246 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.060135    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:10:16.060436 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.060423    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:10:16.086080 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.086034    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"]
Jul 02 19:10:16.104189 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.104158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed400b4d-f7da-4aee-8359-4eeefe89f40e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-82zhx\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.104189 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.104191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5skg\" (UniqueName: \"kubernetes.io/projected/ed400b4d-f7da-4aee-8359-4eeefe89f40e-kube-api-access-m5skg\") pod \"kuadrant-operator-controller-manager-86878c769f-82zhx\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.205155 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.205117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5skg\" (UniqueName: \"kubernetes.io/projected/ed400b4d-f7da-4aee-8359-4eeefe89f40e-kube-api-access-m5skg\") pod \"kuadrant-operator-controller-manager-86878c769f-82zhx\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.205435 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.205409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed400b4d-f7da-4aee-8359-4eeefe89f40e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-82zhx\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.205758 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.205739    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed400b4d-f7da-4aee-8359-4eeefe89f40e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-82zhx\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.239079 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.239053    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5skg\" (UniqueName: \"kubernetes.io/projected/ed400b4d-f7da-4aee-8359-4eeefe89f40e-kube-api-access-m5skg\") pod \"kuadrant-operator-controller-manager-86878c769f-82zhx\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.367469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.367363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:16.515985 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:16.515962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"]
Jul 02 19:10:16.518562 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:10:16.518531    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded400b4d_f7da_4aee_8359_4eeefe89f40e.slice/crio-bc5b891b6c055a20c87da1f6d954273b9730f7ee2a3500cfbdd9d99a732631cf WatchSource:0}: Error finding container bc5b891b6c055a20c87da1f6d954273b9730f7ee2a3500cfbdd9d99a732631cf: Status 404 returned error can't find the container with id bc5b891b6c055a20c87da1f6d954273b9730f7ee2a3500cfbdd9d99a732631cf
Jul 02 19:10:17.249917 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:17.249876    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx" event={"ID":"ed400b4d-f7da-4aee-8359-4eeefe89f40e","Type":"ContainerStarted","Data":"bc5b891b6c055a20c87da1f6d954273b9730f7ee2a3500cfbdd9d99a732631cf"}
Jul 02 19:10:22.274197 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:22.274159    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx" event={"ID":"ed400b4d-f7da-4aee-8359-4eeefe89f40e","Type":"ContainerStarted","Data":"f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a"}
Jul 02 19:10:22.274673 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:22.274243    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:22.325258 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:22.325209    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx" podStartSLOduration=0.741344503 podStartE2EDuration="6.325194019s" totalImagesPullingTime="5.583849516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:22.324584501 +0000 UTC m=+486.696339222" watchObservedRunningTime="2026-07-02 19:10:22.325194019 +0000 UTC m=+486.696948789"
Jul 02 19:10:33.281051 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:33.281020    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:10:56.099074 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.099029    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:10:56.101591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.101570    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.104593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.104572    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 19:10:56.104829 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.104798    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s9r5w\""
Jul 02 19:10:56.111183 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.111160    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:10:56.149218 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.149175    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:10:56.249848 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.249789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5-config-file\") pod \"limitador-limitador-54d6d988d5-knjk8\" (UID: \"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.250046 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.249923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhpc5\" (UniqueName: \"kubernetes.io/projected/7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5-kube-api-access-hhpc5\") pod \"limitador-limitador-54d6d988d5-knjk8\" (UID: \"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.351018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.350915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5-config-file\") pod \"limitador-limitador-54d6d988d5-knjk8\" (UID: \"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.351018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.350977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhpc5\" (UniqueName: \"kubernetes.io/projected/7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5-kube-api-access-hhpc5\") pod \"limitador-limitador-54d6d988d5-knjk8\" (UID: \"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.351582 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.351559    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5-config-file\") pod \"limitador-limitador-54d6d988d5-knjk8\" (UID: \"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.359609 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.359577    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhpc5\" (UniqueName: \"kubernetes.io/projected/7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5-kube-api-access-hhpc5\") pod \"limitador-limitador-54d6d988d5-knjk8\" (UID: \"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.413320 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.413280    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:56.555693 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:56.555479    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:10:56.558130 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:10:56.558104    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ceb1c07_14fd_4afa_ae27_6d4e25d4f7e5.slice/crio-b2001c5f201fa83b0954705285cf69941238728c3b8ad220453ba6f7300530af WatchSource:0}: Error finding container b2001c5f201fa83b0954705285cf69941238728c3b8ad220453ba6f7300530af: Status 404 returned error can't find the container with id b2001c5f201fa83b0954705285cf69941238728c3b8ad220453ba6f7300530af
Jul 02 19:10:57.431127 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:57.431096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8" event={"ID":"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5","Type":"ContainerStarted","Data":"b2001c5f201fa83b0954705285cf69941238728c3b8ad220453ba6f7300530af"}
Jul 02 19:10:59.441497 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:59.441401    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8" event={"ID":"7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5","Type":"ContainerStarted","Data":"4a994d1fdbe819640e67dc348e36f96fef50ea1d05af1a6f49c825e6ab7d69ee"}
Jul 02 19:10:59.441497 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:59.441488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:10:59.462184 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:10:59.462134    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8" podStartSLOduration=0.832026221 podStartE2EDuration="3.462120518s" totalImagesPullingTime="2.630094297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:59.460944527 +0000 UTC m=+523.832699248" watchObservedRunningTime="2026-07-02 19:10:59.462120518 +0000 UTC m=+523.833875239"
Jul 02 19:11:10.447482 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:11:10.447396    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-knjk8"
Jul 02 19:12:08.304885 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:08.304852    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:12:16.097877 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:16.097851    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:12:16.104219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:16.104195    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:12:27.241862 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:27.241823    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:12:35.385402 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:35.385365    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:12:47.790943 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.790904    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"]
Jul 02 19:12:47.794414 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.794392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.797941 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.797918    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 19:12:47.798059 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.797917    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 19:12:47.798059 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.797918    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwzqz\""
Jul 02 19:12:47.798059 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.797918    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 19:12:47.806384 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.806357    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"]
Jul 02 19:12:47.884032 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.884001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.884032 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.884050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f949cbb-a58c-4df0-8d0e-6256d20f9436-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.884269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.884088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.884269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.884127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.884269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.884144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff6fv\" (UniqueName: \"kubernetes.io/projected/7f949cbb-a58c-4df0-8d0e-6256d20f9436-kube-api-access-ff6fv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.884269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.884199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985094 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985094 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f949cbb-a58c-4df0-8d0e-6256d20f9436-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985350 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985132    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985350 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985350 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985172    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff6fv\" (UniqueName: \"kubernetes.io/projected/7f949cbb-a58c-4df0-8d0e-6256d20f9436-kube-api-access-ff6fv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985350 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985571 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985547    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985614 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985589    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.985614 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.985599    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.987416 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.987395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f949cbb-a58c-4df0-8d0e-6256d20f9436-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.987695 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.987676    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f949cbb-a58c-4df0-8d0e-6256d20f9436-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:47.992819 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:47.992780    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff6fv\" (UniqueName: \"kubernetes.io/projected/7f949cbb-a58c-4df0-8d0e-6256d20f9436-kube-api-access-ff6fv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x54k6\" (UID: \"7f949cbb-a58c-4df0-8d0e-6256d20f9436\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:48.108715 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:48.108624    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:48.240437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:48.240396    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"]
Jul 02 19:12:48.243989 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:12:48.243956    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f949cbb_a58c_4df0_8d0e_6256d20f9436.slice/crio-d7d2cbd94ab45101747052861adc6f1be2b7032f1188d7168eee4f8162c53f07 WatchSource:0}: Error finding container d7d2cbd94ab45101747052861adc6f1be2b7032f1188d7168eee4f8162c53f07: Status 404 returned error can't find the container with id d7d2cbd94ab45101747052861adc6f1be2b7032f1188d7168eee4f8162c53f07
Jul 02 19:12:48.245264 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:48.245238    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:12:48.947292 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:48.947257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6" event={"ID":"7f949cbb-a58c-4df0-8d0e-6256d20f9436","Type":"ContainerStarted","Data":"d7d2cbd94ab45101747052861adc6f1be2b7032f1188d7168eee4f8162c53f07"}
Jul 02 19:12:49.090716 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:49.090676    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:12:49.954340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:49.954302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6" event={"ID":"7f949cbb-a58c-4df0-8d0e-6256d20f9436","Type":"ContainerStarted","Data":"ff2274ac83d244a8e46a7da653cc73617be65b3fec221d8a7698abb500dd544e"}
Jul 02 19:12:49.973205 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:49.973157    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6" podStartSLOduration=1.859013543 podStartE2EDuration="2.973141836s" totalImagesPullingTime="1.114128293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:49.971561344 +0000 UTC m=+634.343316067" watchObservedRunningTime="2026-07-02 19:12:49.973141836 +0000 UTC m=+634.344896558"
Jul 02 19:12:53.316778 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:53.316745    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:12:58.109787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:58.109745    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:58.110217 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:58.109838    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:58.122186 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:58.122163    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:12:59.008498 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:12:59.008463    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x54k6"
Jul 02 19:13:02.494668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.494632    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"]
Jul 02 19:13:02.498281 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.498262    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.501014 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.500998    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 19:13:02.509364 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.509342    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"]
Jul 02 19:13:02.613170 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.613141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.613170 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.613170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.613387 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.613226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.613387 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.613253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cee73c-7181-495c-bf71-2cfe9b38c328-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.613387 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.613284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wkk7\" (UniqueName: \"kubernetes.io/projected/74cee73c-7181-495c-bf71-2cfe9b38c328-kube-api-access-9wkk7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.613387 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.613336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714241 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714206    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cee73c-7181-495c-bf71-2cfe9b38c328-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714257    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wkk7\" (UniqueName: \"kubernetes.io/projected/74cee73c-7181-495c-bf71-2cfe9b38c328-kube-api-access-9wkk7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714287    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714367    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714767 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714744    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714769    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.714890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.714866    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.716617 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.716596    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cee73c-7181-495c-bf71-2cfe9b38c328-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.716934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.716913    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cee73c-7181-495c-bf71-2cfe9b38c328-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.722671 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.722652    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wkk7\" (UniqueName: \"kubernetes.io/projected/74cee73c-7181-495c-bf71-2cfe9b38c328-kube-api-access-9wkk7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gt4pk\" (UID: \"74cee73c-7181-495c-bf71-2cfe9b38c328\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.808883 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.808772    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:02.945964 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:02.945939    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"]
Jul 02 19:13:02.948180 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:13:02.948144    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74cee73c_7181_495c_bf71_2cfe9b38c328.slice/crio-4d53b6cdfcec38d9cec82b616d9e20eb59a532533473862741a0023747c44783 WatchSource:0}: Error finding container 4d53b6cdfcec38d9cec82b616d9e20eb59a532533473862741a0023747c44783: Status 404 returned error can't find the container with id 4d53b6cdfcec38d9cec82b616d9e20eb59a532533473862741a0023747c44783
Jul 02 19:13:03.015660 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:03.015625    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk" event={"ID":"74cee73c-7181-495c-bf71-2cfe9b38c328","Type":"ContainerStarted","Data":"4d53b6cdfcec38d9cec82b616d9e20eb59a532533473862741a0023747c44783"}
Jul 02 19:13:04.022505 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:04.022465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk" event={"ID":"74cee73c-7181-495c-bf71-2cfe9b38c328","Type":"ContainerStarted","Data":"cd07a07bdbdc33b1efc6cae9737efe2cf6cdb21b1c5e4b0c884cfbb0c5c7a6f0"}
Jul 02 19:13:04.044490 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:04.044424    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk" podStartSLOduration=1.8328430660000001 podStartE2EDuration="2.044403645s" totalImagesPullingTime="211.560579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:04.043575868 +0000 UTC m=+648.415330605" watchObservedRunningTime="2026-07-02 19:13:04.044403645 +0000 UTC m=+648.416158368"
Jul 02 19:13:04.089282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:04.089249    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:13:12.809457 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:12.809414    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:12.809885 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:12.809498    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:12.821984 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:12.821956    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:13.081604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:13.081520    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gt4pk"
Jul 02 19:13:14.245945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:13:14.245906    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:15:00.161857 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.161796    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29716995-trh7t"]
Jul 02 19:15:00.165065 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.165048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:00.167721 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.167703    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hxm9f\""
Jul 02 19:15:00.178025 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.178000    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716995-trh7t"]
Jul 02 19:15:00.231180 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.231146    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss4wm\" (UniqueName: \"kubernetes.io/projected/c8f87c78-8a70-409c-8d4e-aa9ba1025b7b-kube-api-access-ss4wm\") pod \"maas-api-key-cleanup-29716995-trh7t\" (UID: \"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b\") " pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:00.331823 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.331763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss4wm\" (UniqueName: \"kubernetes.io/projected/c8f87c78-8a70-409c-8d4e-aa9ba1025b7b-kube-api-access-ss4wm\") pod \"maas-api-key-cleanup-29716995-trh7t\" (UID: \"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b\") " pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:00.373927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.373901    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss4wm\" (UniqueName: \"kubernetes.io/projected/c8f87c78-8a70-409c-8d4e-aa9ba1025b7b-kube-api-access-ss4wm\") pod \"maas-api-key-cleanup-29716995-trh7t\" (UID: \"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b\") " pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:00.474760 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.474729    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:00.643095 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:15:00.643053    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f87c78_8a70_409c_8d4e_aa9ba1025b7b.slice/crio-5740e5eda23ce7b19d6bed57e4c57ce51bd77962080cd3021b7a992c6bbbed49 WatchSource:0}: Error finding container 5740e5eda23ce7b19d6bed57e4c57ce51bd77962080cd3021b7a992c6bbbed49: Status 404 returned error can't find the container with id 5740e5eda23ce7b19d6bed57e4c57ce51bd77962080cd3021b7a992c6bbbed49
Jul 02 19:15:00.655639 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:00.655618    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716995-trh7t"]
Jul 02 19:15:01.566123 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:01.566085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t" event={"ID":"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b","Type":"ContainerStarted","Data":"5740e5eda23ce7b19d6bed57e4c57ce51bd77962080cd3021b7a992c6bbbed49"}
Jul 02 19:15:03.579892 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:03.579852    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t" event={"ID":"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b","Type":"ContainerStarted","Data":"5046e0acf5af301b9ad797f04500ec9815d84b6d09ec373346a4ca9f851fa17d"}
Jul 02 19:15:04.585800 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:04.585766    2572 generic.go:356] "Generic (PLEG): container finished" podID="c8f87c78-8a70-409c-8d4e-aa9ba1025b7b" containerID="5046e0acf5af301b9ad797f04500ec9815d84b6d09ec373346a4ca9f851fa17d" exitCode=0
Jul 02 19:15:04.586269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:04.585832    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t" event={"ID":"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b","Type":"ContainerDied","Data":"5046e0acf5af301b9ad797f04500ec9815d84b6d09ec373346a4ca9f851fa17d"}
Jul 02 19:15:04.874869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:04.874759    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:15:05.722478 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:05.722451    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:05.774979 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:05.774944    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss4wm\" (UniqueName: \"kubernetes.io/projected/c8f87c78-8a70-409c-8d4e-aa9ba1025b7b-kube-api-access-ss4wm\") pod \"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b\" (UID: \"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b\") "
Jul 02 19:15:05.777189 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:05.777163    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f87c78-8a70-409c-8d4e-aa9ba1025b7b-kube-api-access-ss4wm" (OuterVolumeSpecName: "kube-api-access-ss4wm") pod "c8f87c78-8a70-409c-8d4e-aa9ba1025b7b" (UID: "c8f87c78-8a70-409c-8d4e-aa9ba1025b7b"). InnerVolumeSpecName "kube-api-access-ss4wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:15:05.875688 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:05.875604    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss4wm\" (UniqueName: \"kubernetes.io/projected/c8f87c78-8a70-409c-8d4e-aa9ba1025b7b-kube-api-access-ss4wm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:15:06.595909 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:06.595874    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t"
Jul 02 19:15:06.595909 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:06.595903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-trh7t" event={"ID":"c8f87c78-8a70-409c-8d4e-aa9ba1025b7b","Type":"ContainerDied","Data":"5740e5eda23ce7b19d6bed57e4c57ce51bd77962080cd3021b7a992c6bbbed49"}
Jul 02 19:15:06.596143 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:06.595957    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5740e5eda23ce7b19d6bed57e4c57ce51bd77962080cd3021b7a992c6bbbed49"
Jul 02 19:15:15.593243 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:15.593209    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:15:26.198264 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:26.198232    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:15:34.696100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:34.696063    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:15:45.386142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:15:45.386048    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:16:52.001739 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:16:52.001705    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:01.397089 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:01.397049    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:09.089482 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:09.089385    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:15.698372 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:15.698338    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:16.129161 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:16.129132    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:17:16.131107 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:16.131081    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:17:26.996956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:26.996921    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:36.485058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:36.485030    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:47.589224 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:47.589187    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:17:57.788524 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:17:57.788487    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:18:20.499405 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:18:20.499370    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:18:32.297392 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:18:32.297357    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:18:54.888860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:18:54.888823    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:19:05.602038 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:19:05.602002    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:19:22.196646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:19:22.196610    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:19:31.891816 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:19:31.891762    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:19:41.482922 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:19:41.482886    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:19:50.593566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:19:50.593528    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:19:59.684699 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:19:59.684663    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:20:27.071552 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:27.071519    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"]
Jul 02 19:20:27.071977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:27.071743    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx" podUID="ed400b4d-f7da-4aee-8359-4eeefe89f40e" containerName="manager" containerID="cri-o://f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a" gracePeriod=10
Jul 02 19:20:29.830295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.830269    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:20:29.893709 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.893628    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5skg\" (UniqueName: \"kubernetes.io/projected/ed400b4d-f7da-4aee-8359-4eeefe89f40e-kube-api-access-m5skg\") pod \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") "
Jul 02 19:20:29.893883 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.893772    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed400b4d-f7da-4aee-8359-4eeefe89f40e-extensions-socket-volume\") pod \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\" (UID: \"ed400b4d-f7da-4aee-8359-4eeefe89f40e\") "
Jul 02 19:20:29.894137 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.894112    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed400b4d-f7da-4aee-8359-4eeefe89f40e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed400b4d-f7da-4aee-8359-4eeefe89f40e" (UID: "ed400b4d-f7da-4aee-8359-4eeefe89f40e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:20:29.895853 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.895831    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed400b4d-f7da-4aee-8359-4eeefe89f40e-kube-api-access-m5skg" (OuterVolumeSpecName: "kube-api-access-m5skg") pod "ed400b4d-f7da-4aee-8359-4eeefe89f40e" (UID: "ed400b4d-f7da-4aee-8359-4eeefe89f40e"). InnerVolumeSpecName "kube-api-access-m5skg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:20:29.994966 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.994931    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed400b4d-f7da-4aee-8359-4eeefe89f40e-extensions-socket-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:20:29.994966 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:29.994960    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5skg\" (UniqueName: \"kubernetes.io/projected/ed400b4d-f7da-4aee-8359-4eeefe89f40e-kube-api-access-m5skg\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:20:30.069433 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.069400    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed400b4d-f7da-4aee-8359-4eeefe89f40e" containerID="f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a" exitCode=0
Jul 02 19:20:30.069586 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.069449    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx" event={"ID":"ed400b4d-f7da-4aee-8359-4eeefe89f40e","Type":"ContainerDied","Data":"f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a"}
Jul 02 19:20:30.069586 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.069451    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"
Jul 02 19:20:30.069586 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.069490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx" event={"ID":"ed400b4d-f7da-4aee-8359-4eeefe89f40e","Type":"ContainerDied","Data":"bc5b891b6c055a20c87da1f6d954273b9730f7ee2a3500cfbdd9d99a732631cf"}
Jul 02 19:20:30.069586 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.069514    2572 scope.go:117] "RemoveContainer" containerID="f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a"
Jul 02 19:20:30.078677 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.078659    2572 scope.go:117] "RemoveContainer" containerID="f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a"
Jul 02 19:20:30.078979 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:20:30.078959    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a\": container with ID starting with f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a not found: ID does not exist" containerID="f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a"
Jul 02 19:20:30.079034 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.078990    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a"} err="failed to get container status \"f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a\": rpc error: code = NotFound desc = could not find container \"f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a\": container with ID starting with f02fe58be41354297270cc62ea6ff76b6adef5787dc8a0df04a7fc28352bfb5a not found: ID does not exist"
Jul 02 19:20:30.094495 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.094474    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"]
Jul 02 19:20:30.097623 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.097598    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82zhx"]
Jul 02 19:20:30.161935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:20:30.161859    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed400b4d-f7da-4aee-8359-4eeefe89f40e" path="/var/lib/kubelet/pods/ed400b4d-f7da-4aee-8359-4eeefe89f40e/volumes"
Jul 02 19:21:28.287315 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287287    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"]
Jul 02 19:21:28.287720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287615    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed400b4d-f7da-4aee-8359-4eeefe89f40e" containerName="manager"
Jul 02 19:21:28.287720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287626    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed400b4d-f7da-4aee-8359-4eeefe89f40e" containerName="manager"
Jul 02 19:21:28.287720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287651    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f87c78-8a70-409c-8d4e-aa9ba1025b7b" containerName="cleanup"
Jul 02 19:21:28.287720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287656    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f87c78-8a70-409c-8d4e-aa9ba1025b7b" containerName="cleanup"
Jul 02 19:21:28.287720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287705    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f87c78-8a70-409c-8d4e-aa9ba1025b7b" containerName="cleanup"
Jul 02 19:21:28.287720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.287716    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed400b4d-f7da-4aee-8359-4eeefe89f40e" containerName="manager"
Jul 02 19:21:28.291031 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.291015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.293454 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.293412    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z4p6g\""
Jul 02 19:21:28.319566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.319544    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"]
Jul 02 19:21:28.382520 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.382492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxkq5\" (UniqueName: \"kubernetes.io/projected/cdfd2ce8-988c-4b90-b20a-06df800639b6-kube-api-access-kxkq5\") pod \"kuadrant-operator-controller-manager-86878c769f-mt2b6\" (UID: \"cdfd2ce8-988c-4b90-b20a-06df800639b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.382656 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.382543    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfd2ce8-988c-4b90-b20a-06df800639b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mt2b6\" (UID: \"cdfd2ce8-988c-4b90-b20a-06df800639b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.483258 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.483209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxkq5\" (UniqueName: \"kubernetes.io/projected/cdfd2ce8-988c-4b90-b20a-06df800639b6-kube-api-access-kxkq5\") pod \"kuadrant-operator-controller-manager-86878c769f-mt2b6\" (UID: \"cdfd2ce8-988c-4b90-b20a-06df800639b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.483450 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.483307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfd2ce8-988c-4b90-b20a-06df800639b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mt2b6\" (UID: \"cdfd2ce8-988c-4b90-b20a-06df800639b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.483674 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.483652    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfd2ce8-988c-4b90-b20a-06df800639b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mt2b6\" (UID: \"cdfd2ce8-988c-4b90-b20a-06df800639b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.492021 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.491993    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxkq5\" (UniqueName: \"kubernetes.io/projected/cdfd2ce8-988c-4b90-b20a-06df800639b6-kube-api-access-kxkq5\") pod \"kuadrant-operator-controller-manager-86878c769f-mt2b6\" (UID: \"cdfd2ce8-988c-4b90-b20a-06df800639b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.601235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.601149    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:28.749998 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:28.749972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"]
Jul 02 19:21:28.750604 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:21:28.750573    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfd2ce8_988c_4b90_b20a_06df800639b6.slice/crio-3e4a5228f1e8ecd7234f16cec0b81bdf61dfeba41df6345def3ea82b597d2fd9 WatchSource:0}: Error finding container 3e4a5228f1e8ecd7234f16cec0b81bdf61dfeba41df6345def3ea82b597d2fd9: Status 404 returned error can't find the container with id 3e4a5228f1e8ecd7234f16cec0b81bdf61dfeba41df6345def3ea82b597d2fd9
Jul 02 19:21:29.335201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:29.335166    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6" event={"ID":"cdfd2ce8-988c-4b90-b20a-06df800639b6","Type":"ContainerStarted","Data":"c02b76885b0bdf9339466cfaa1e9b878ff5f7624bb7b3d5b02ad65a6a7cf3e80"}
Jul 02 19:21:29.335551 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:29.335220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6" event={"ID":"cdfd2ce8-988c-4b90-b20a-06df800639b6","Type":"ContainerStarted","Data":"3e4a5228f1e8ecd7234f16cec0b81bdf61dfeba41df6345def3ea82b597d2fd9"}
Jul 02 19:21:29.335551 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:29.335295    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:29.357012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:29.356968    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6" podStartSLOduration=1.356955418 podStartE2EDuration="1.356955418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:21:29.356008899 +0000 UTC m=+1153.727763644" watchObservedRunningTime="2026-07-02 19:21:29.356955418 +0000 UTC m=+1153.728710138"
Jul 02 19:21:40.342747 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:40.342720    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt2b6"
Jul 02 19:21:47.805427 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:47.805390    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:21:59.987703 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:21:59.987665    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:22:08.588058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:08.588004    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:22:16.165488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:16.165458    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:22:16.165945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:16.165513    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:22:19.998571 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:19.998535    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:22:29.485210 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:29.485174    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:22:41.188529 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:41.188498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:22:49.685753 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:22:49.685717    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:23:00.289137 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:23:00.289099    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:23:12.009992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:23:12.009913    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:23:20.811835 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:23:20.811784    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:23:31.081751 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:23:31.081715    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:23:55.387405 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:23:55.387373    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:24:02.495331 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:24:02.495295    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:24:11.982706 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:24:11.982667    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:24:24.086414 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:24:24.086378    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:24:41.389573 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:24:41.389494    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:24:54.398413 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:24:54.398374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:25:03.584819 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:25:03.584772    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:25:08.998292 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:25:08.998254    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:25:18.193546 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:25:18.193514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:25:27.686705 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:25:27.686666    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:25:40.694758 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:25:40.694717    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:25:51.886150 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:25:51.886117    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:26:01.284671 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:26:01.284632    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:26:11.581593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:26:11.581498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:26:23.089636 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:26:23.089602    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:26:32.881771 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:26:32.881733    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:26:44.896835 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:26:44.896784    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:26:55.989314 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:26:55.989283    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:27:06.783510 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:06.783475    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:27:16.191607 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:16.191579    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:27:16.193691 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:16.193668    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:27:20.390510 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:20.390481    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:27:29.480038 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:29.480001    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:27:39.688060 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.687967    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:27:39.874896 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.874870    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"]
Jul 02 19:27:39.878482 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.878464    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.880891 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.880870    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b0830766-openshift-default-dockercfg-mlxxp\""
Jul 02 19:27:39.885755 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885737    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-credential-socket\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.885869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-token\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.885869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-socket\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.885955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-envoy\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.885955 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885897    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-podinfo\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.886029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-certs\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.886029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.885985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istiod-ca-cert\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.886106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.886047    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc4m6\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-kube-api-access-xc4m6\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.886106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.886080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-data\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.905551 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.905523    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"]
Jul 02 19:27:39.987212 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-credential-socket\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987212 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987214    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-token\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-socket\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-envoy\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987295    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-podinfo\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-certs\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istiod-ca-cert\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987465 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc4m6\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-kube-api-access-xc4m6\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987603    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-credential-socket\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.987844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.987662    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-data\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.988091 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.988048    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-socket\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.988256 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.988238    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istiod-ca-cert\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.988398 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.988368    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-certs\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.988624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.988600    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-data\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.990209 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.990184    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-podinfo\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.990420 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.990398    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-envoy\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.997372 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.997329    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc4m6\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-kube-api-access-xc4m6\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:39.997481 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:39.997452    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-token\") pod \"e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") " pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:40.189108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:40.189077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:40.325377 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:40.325355    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"]
Jul 02 19:27:40.327281 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:27:40.327251    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f90c3e3_8bda_4cd0_8498_1f1633b5d647.slice/crio-cf6374e1875e8abd001e9f1468d5779e60fc63291c3f32f9d7774e4eb63091e3 WatchSource:0}: Error finding container cf6374e1875e8abd001e9f1468d5779e60fc63291c3f32f9d7774e4eb63091e3: Status 404 returned error can't find the container with id cf6374e1875e8abd001e9f1468d5779e60fc63291c3f32f9d7774e4eb63091e3
Jul 02 19:27:40.329532 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:40.329500    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:27:40.329640 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:40.329575    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:27:40.329640 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:40.329617    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:27:41.008460 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:41.008419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq" event={"ID":"7f90c3e3-8bda-4cd0-8498-1f1633b5d647","Type":"ContainerStarted","Data":"f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f"}
Jul 02 19:27:41.008876 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:41.008510    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq" event={"ID":"7f90c3e3-8bda-4cd0-8498-1f1633b5d647","Type":"ContainerStarted","Data":"cf6374e1875e8abd001e9f1468d5779e60fc63291c3f32f9d7774e4eb63091e3"}
Jul 02 19:27:41.030156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:41.030106    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq" podStartSLOduration=2.030090573 podStartE2EDuration="2.030090573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:27:41.02823752 +0000 UTC m=+1525.399992243" watchObservedRunningTime="2026-07-02 19:27:41.030090573 +0000 UTC m=+1525.401845349"
Jul 02 19:27:41.190066 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:41.190027    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:41.196476 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:41.196452    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:42.012770 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:42.012738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:42.013623 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:42.013600    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:46.503626 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:46.503593    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"]
Jul 02 19:27:46.504089 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:46.503829    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq" podUID="7f90c3e3-8bda-4cd0-8498-1f1633b5d647" containerName="istio-proxy" containerID="cri-o://f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f" gracePeriod=30
Jul 02 19:27:52.451539 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.451499    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"]
Jul 02 19:27:52.456159 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.456132    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.459416 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.459394    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-74a34470-openshift-default-dockercfg-44qc5\""
Jul 02 19:27:52.469153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.469128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"]
Jul 02 19:27:52.502242 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-certs\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502248    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-envoy\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-socket\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-data\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-istio-token\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822311aa-9637-474b-abdd-ea680e9d00a4-istiod-ca-cert\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-credential-socket\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502757 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502517    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822311aa-9637-474b-abdd-ea680e9d00a4-istio-podinfo\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.502757 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.502564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6jb\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-kube-api-access-ck6jb\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.603296 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-certs\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-envoy\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-socket\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-data\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603391    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-istio-token\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822311aa-9637-474b-abdd-ea680e9d00a4-istiod-ca-cert\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-credential-socket\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603556    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822311aa-9637-474b-abdd-ea680e9d00a4-istio-podinfo\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6jb\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-kube-api-access-ck6jb\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603717    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-certs\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603740    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-socket\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.603833    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-data\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.604108    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-credential-socket\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.604112    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822311aa-9637-474b-abdd-ea680e9d00a4-istiod-ca-cert\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.605574    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-envoy\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.611668 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.605942    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822311aa-9637-474b-abdd-ea680e9d00a4-istio-podinfo\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.612193 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.611149    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-istio-token\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.612193 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.611278    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6jb\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-kube-api-access-ck6jb\") pod \"e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") " pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.771956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.771912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:52.856206 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.856178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:52.905336 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905310    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-socket\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905336 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905341    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istiod-ca-cert\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905374    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-podinfo\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905402    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-token\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905442    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc4m6\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-kube-api-access-xc4m6\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905475    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-envoy\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905506    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-credential-socket\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905538    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-certs\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905571    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-data\") pod \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\" (UID: \"7f90c3e3-8bda-4cd0-8498-1f1633b5d647\") "
Jul 02 19:27:52.905590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905581    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:27:52.905940 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905763    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:27:52.905940 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905909    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:52.906045 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905914    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:27:52.906045 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.905928    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:52.906158 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.906132    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:27:52.906631 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.906601    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:27:52.908015 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.907986    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:27:52.908231 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.908064    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:27:52.908312 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.908274    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:27:52.908312 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.908291    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-kube-api-access-xc4m6" (OuterVolumeSpecName: "kube-api-access-xc4m6") pod "7f90c3e3-8bda-4cd0-8498-1f1633b5d647" (UID: "7f90c3e3-8bda-4cd0-8498-1f1633b5d647"). InnerVolumeSpecName "kube-api-access-xc4m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:27:52.918350 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.918329    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"]
Jul 02 19:27:52.920291 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:27:52.920269    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822311aa_9637_474b_abdd_ea680e9d00a4.slice/crio-13a15ea8b774931695f5aeb9613d00cd551e8d03bd03d10edaea26adfa056101 WatchSource:0}: Error finding container 13a15ea8b774931695f5aeb9613d00cd551e8d03bd03d10edaea26adfa056101: Status 404 returned error can't find the container with id 13a15ea8b774931695f5aeb9613d00cd551e8d03bd03d10edaea26adfa056101
Jul 02 19:27:52.922367 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.922337    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:27:52.922440 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.922400    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:27:52.922440 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:52.922426    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:27:53.007274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007229    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.007274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007266    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.007274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007280    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.007560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007294    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc4m6\" (UniqueName: \"kubernetes.io/projected/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-kube-api-access-xc4m6\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.007560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007309    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.007560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007324    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.007560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.007337    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f90c3e3-8bda-4cd0-8498-1f1633b5d647-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:27:53.076407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.076356    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" event={"ID":"822311aa-9637-474b-abdd-ea680e9d00a4","Type":"ContainerStarted","Data":"ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"}
Jul 02 19:27:53.076594 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.076436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" event={"ID":"822311aa-9637-474b-abdd-ea680e9d00a4","Type":"ContainerStarted","Data":"13a15ea8b774931695f5aeb9613d00cd551e8d03bd03d10edaea26adfa056101"}
Jul 02 19:27:53.078043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.078013    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f90c3e3-8bda-4cd0-8498-1f1633b5d647" containerID="f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f" exitCode=0
Jul 02 19:27:53.078172 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.078060    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"
Jul 02 19:27:53.078172 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.078074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq" event={"ID":"7f90c3e3-8bda-4cd0-8498-1f1633b5d647","Type":"ContainerDied","Data":"f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f"}
Jul 02 19:27:53.078172 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.078123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq" event={"ID":"7f90c3e3-8bda-4cd0-8498-1f1633b5d647","Type":"ContainerDied","Data":"cf6374e1875e8abd001e9f1468d5779e60fc63291c3f32f9d7774e4eb63091e3"}
Jul 02 19:27:53.078172 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.078156    2572 scope.go:117] "RemoveContainer" containerID="f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f"
Jul 02 19:27:53.088194 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.088176    2572 scope.go:117] "RemoveContainer" containerID="f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f"
Jul 02 19:27:53.088486 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:27:53.088442    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f\": container with ID starting with f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f not found: ID does not exist" containerID="f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f"
Jul 02 19:27:53.088486 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.088469    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f"} err="failed to get container status \"f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f\": rpc error: code = NotFound desc = could not find container \"f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f\": container with ID starting with f759901c3e947362df0e5f5f466662b823d29e006f35966a0a7faa1aebb2ed5f not found: ID does not exist"
Jul 02 19:27:53.099152 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.099087    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" podStartSLOduration=1.099072432 podStartE2EDuration="1.099072432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:27:53.098742846 +0000 UTC m=+1537.470497569" watchObservedRunningTime="2026-07-02 19:27:53.099072432 +0000 UTC m=+1537.470827155"
Jul 02 19:27:53.113236 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.113215    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"]
Jul 02 19:27:53.117823 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.117781    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b0830766-openshift-default-549bb9df55-mzzhq"]
Jul 02 19:27:53.772967 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.772925    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:53.777587 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:53.777564    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:54.084528 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:54.084494    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:54.085551 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:54.085531    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:27:54.162768 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:54.162736    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f90c3e3-8bda-4cd0-8498-1f1633b5d647" path="/var/lib/kubelet/pods/7f90c3e3-8bda-4cd0-8498-1f1633b5d647/volumes"
Jul 02 19:27:57.186828 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:27:57.186773    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:28:05.136498 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.136402    2572 generic.go:356] "Generic (PLEG): container finished" podID="822311aa-9637-474b-abdd-ea680e9d00a4" containerID="ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497" exitCode=0
Jul 02 19:28:05.136498 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.136470    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" event={"ID":"822311aa-9637-474b-abdd-ea680e9d00a4","Type":"ContainerDied","Data":"ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"}
Jul 02 19:28:05.137108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.136845    2572 scope.go:117] "RemoveContainer" containerID="ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"
Jul 02 19:28:05.137844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.137813    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:28:05.137945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.137881    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:28:05.137945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.137914    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:28:05.256560 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:05.254968    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"]
Jul 02 19:28:06.143105 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:06.143063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" event={"ID":"822311aa-9637-474b-abdd-ea680e9d00a4","Type":"ContainerStarted","Data":"cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3"}
Jul 02 19:28:06.143562 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:06.143163    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy" containerID="cri-o://cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3" gracePeriod=30
Jul 02 19:28:09.011872 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:09.011838    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:28:09.084823 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:09.084767    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:28:11.400202 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.400177    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:28:11.467282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467200    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck6jb\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-kube-api-access-ck6jb\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467259    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822311aa-9637-474b-abdd-ea680e9d00a4-istiod-ca-cert\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467284    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822311aa-9637-474b-abdd-ea680e9d00a4-istio-podinfo\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467496 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467398    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-data\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467496 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467448    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-envoy\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467496 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467487    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-istio-token\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467521    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-credential-socket\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467554    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-certs\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467583    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-socket\") pod \"822311aa-9637-474b-abdd-ea680e9d00a4\" (UID: \"822311aa-9637-474b-abdd-ea680e9d00a4\") "
Jul 02 19:28:11.467772 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467698    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/822311aa-9637-474b-abdd-ea680e9d00a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:28:11.467945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467896    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:11.468034 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467958    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:11.468034 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.467986    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/822311aa-9637-474b-abdd-ea680e9d00a4-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.468137 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.468085    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:11.468371 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.468347    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:11.469443 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.469421    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/822311aa-9637-474b-abdd-ea680e9d00a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:28:11.469695 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.469671    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:28:11.470012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.469993    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-kube-api-access-ck6jb" (OuterVolumeSpecName: "kube-api-access-ck6jb") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "kube-api-access-ck6jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:28:11.470012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.469997    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "822311aa-9637-474b-abdd-ea680e9d00a4" (UID: "822311aa-9637-474b-abdd-ea680e9d00a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:11.530509 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.530471    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"]
Jul 02 19:28:11.531018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.530992    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f90c3e3-8bda-4cd0-8498-1f1633b5d647" containerName="istio-proxy"
Jul 02 19:28:11.531018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531016    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f90c3e3-8bda-4cd0-8498-1f1633b5d647" containerName="istio-proxy"
Jul 02 19:28:11.531018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531029    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy"
Jul 02 19:28:11.531018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531034    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy"
Jul 02 19:28:11.531317 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531047    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy"
Jul 02 19:28:11.531317 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531052    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy"
Jul 02 19:28:11.531317 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531114    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy"
Jul 02 19:28:11.531317 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531126    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f90c3e3-8bda-4cd0-8498-1f1633b5d647" containerName="istio-proxy"
Jul 02 19:28:11.531317 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.531136    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" containerName="istio-proxy"
Jul 02 19:28:11.534610 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.534589    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.537086 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.537067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-079596c4-openshift-default-dockercfg-4flpp\""
Jul 02 19:28:11.549628 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.549605    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"]
Jul 02 19:28:11.568749 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.568722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-data\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.568865 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.568759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m46\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-kube-api-access-r7m46\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.568865 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.568793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612ff46f-531b-4669-9f56-869d02210116-istiod-ca-cert\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.568865 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.568832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-istio-token\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.568996 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.568888    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612ff46f-531b-4669-9f56-869d02210116-istio-podinfo\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.568996 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.568924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-credential-socket\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.569057 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-socket\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.569057 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-certs\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.569123 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-envoy\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.569156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569125    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569135    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569144    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569152    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569161    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569184    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/822311aa-9637-474b-abdd-ea680e9d00a4-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569194    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck6jb\" (UniqueName: \"kubernetes.io/projected/822311aa-9637-474b-abdd-ea680e9d00a4-kube-api-access-ck6jb\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.569287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.569203    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822311aa-9637-474b-abdd-ea680e9d00a4-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:11.670208 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670177    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-socket\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-certs\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670241    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-envoy\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-data\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m46\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-kube-api-access-r7m46\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670334    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612ff46f-531b-4669-9f56-869d02210116-istiod-ca-cert\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-istio-token\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612ff46f-531b-4669-9f56-869d02210116-istio-podinfo\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-credential-socket\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670681    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-data\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670986 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670774    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-certs\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.670986 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.670952    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-credential-socket\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.671108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.671086    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612ff46f-531b-4669-9f56-869d02210116-istiod-ca-cert\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.671155 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.671101    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-socket\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.673121 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.673103    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-envoy\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.673247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.673231    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612ff46f-531b-4669-9f56-869d02210116-istio-podinfo\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.679409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.679387    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-istio-token\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.679527 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.679511    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m46\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-kube-api-access-r7m46\") pod \"e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") " pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.847908 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.847869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:11.985514 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.985491    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"]
Jul 02 19:28:11.987479 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:28:11.987454    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612ff46f_531b_4669_9f56_869d02210116.slice/crio-01f77b2b61970ccb5c70408e6720ff0d2ecf6b0204a3f94635d3aed462e3a49d WatchSource:0}: Error finding container 01f77b2b61970ccb5c70408e6720ff0d2ecf6b0204a3f94635d3aed462e3a49d: Status 404 returned error can't find the container with id 01f77b2b61970ccb5c70408e6720ff0d2ecf6b0204a3f94635d3aed462e3a49d
Jul 02 19:28:11.989547 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.989517    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:28:11.989597 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.989581    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:28:11.989639 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:11.989608    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:28:12.175111 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.175078    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg" event={"ID":"612ff46f-531b-4669-9f56-869d02210116","Type":"ContainerStarted","Data":"7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab"}
Jul 02 19:28:12.175246 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.175139    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg" event={"ID":"612ff46f-531b-4669-9f56-869d02210116","Type":"ContainerStarted","Data":"01f77b2b61970ccb5c70408e6720ff0d2ecf6b0204a3f94635d3aed462e3a49d"}
Jul 02 19:28:12.176771 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.176747    2572 generic.go:356] "Generic (PLEG): container finished" podID="822311aa-9637-474b-abdd-ea680e9d00a4" containerID="cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3" exitCode=0
Jul 02 19:28:12.176904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.176788    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"
Jul 02 19:28:12.176904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.176877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" event={"ID":"822311aa-9637-474b-abdd-ea680e9d00a4","Type":"ContainerDied","Data":"cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3"}
Jul 02 19:28:12.176981 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.176925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl" event={"ID":"822311aa-9637-474b-abdd-ea680e9d00a4","Type":"ContainerDied","Data":"13a15ea8b774931695f5aeb9613d00cd551e8d03bd03d10edaea26adfa056101"}
Jul 02 19:28:12.176981 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.176955    2572 scope.go:117] "RemoveContainer" containerID="cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3"
Jul 02 19:28:12.185906 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.185884    2572 scope.go:117] "RemoveContainer" containerID="ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"
Jul 02 19:28:12.195448 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.195426    2572 scope.go:117] "RemoveContainer" containerID="cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3"
Jul 02 19:28:12.195768 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:28:12.195742    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3\": container with ID starting with cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3 not found: ID does not exist" containerID="cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3"
Jul 02 19:28:12.195875 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.195828    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3"} err="failed to get container status \"cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3\": rpc error: code = NotFound desc = could not find container \"cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3\": container with ID starting with cbb9ee3c36ce7751ca2d342c7612a9508ae0819f258b6cbd25c7201a268a53e3 not found: ID does not exist"
Jul 02 19:28:12.195875 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.195851    2572 scope.go:117] "RemoveContainer" containerID="ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"
Jul 02 19:28:12.196175 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:28:12.196151    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497\": container with ID starting with ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497 not found: ID does not exist" containerID="ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"
Jul 02 19:28:12.196241 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.196183    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497"} err="failed to get container status \"ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497\": rpc error: code = NotFound desc = could not find container \"ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497\": container with ID starting with ae9bfc71c6820de084aba03a4fa816d3e029e0bc6c79085f197f579cf9105497 not found: ID does not exist"
Jul 02 19:28:12.197330 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.197286    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg" podStartSLOduration=1.197274844 podStartE2EDuration="1.197274844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:28:12.194342822 +0000 UTC m=+1556.566097542" watchObservedRunningTime="2026-07-02 19:28:12.197274844 +0000 UTC m=+1556.569029565"
Jul 02 19:28:12.209611 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.209586    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"]
Jul 02 19:28:12.212409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.212390    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-74a34470-openshift-default-6d4c745ddc-l7vfl"]
Jul 02 19:28:12.848235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:12.848199    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:13.853571 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:13.853542    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:14.162867 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:14.162780    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="822311aa-9637-474b-abdd-ea680e9d00a4" path="/var/lib/kubelet/pods/822311aa-9637-474b-abdd-ea680e9d00a4/volumes"
Jul 02 19:28:14.188969 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:14.188938    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:14.193047 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:14.193026    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:16.590043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:16.589957    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:28:17.420068 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:17.420037    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"]
Jul 02 19:28:17.420328 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:17.420274    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg" podUID="612ff46f-531b-4669-9f56-869d02210116" containerName="istio-proxy" containerID="cri-o://7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab" gracePeriod=30
Jul 02 19:28:22.673184 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.673153    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:22.768137 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768105    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-envoy\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768137 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768143    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-data\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768179    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7m46\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-kube-api-access-r7m46\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768200    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-socket\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768214    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-certs\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768274    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-credential-socket\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768301    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612ff46f-531b-4669-9f56-869d02210116-istio-podinfo\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768347    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612ff46f-531b-4669-9f56-869d02210116-istiod-ca-cert\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768383 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768371    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-istio-token\") pod \"612ff46f-531b-4669-9f56-869d02210116\" (UID: \"612ff46f-531b-4669-9f56-869d02210116\") "
Jul 02 19:28:22.768740 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768544    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:22.768740 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768571    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:22.768740 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768584    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:22.768946 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.768916    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/612ff46f-531b-4669-9f56-869d02210116-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:28:22.769235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.769215    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-data" (OuterVolumeSpecName: "istio-data") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:22.770526 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.770495    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:28:22.770618 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.770524    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-istio-token" (OuterVolumeSpecName: "istio-token") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:28:22.770847 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.770792    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-kube-api-access-r7m46" (OuterVolumeSpecName: "kube-api-access-r7m46") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "kube-api-access-r7m46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:28:22.770847 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.770828    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/612ff46f-531b-4669-9f56-869d02210116-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "612ff46f-531b-4669-9f56-869d02210116" (UID: "612ff46f-531b-4669-9f56-869d02210116"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:28:22.869391 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869351    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869391 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869383    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612ff46f-531b-4669-9f56-869d02210116-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869391 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869393    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612ff46f-531b-4669-9f56-869d02210116-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869391 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869401    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869652 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869409    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869652 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869417    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869652 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869424    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7m46\" (UniqueName: \"kubernetes.io/projected/612ff46f-531b-4669-9f56-869d02210116-kube-api-access-r7m46\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869652 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869433    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:22.869652 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:22.869443    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612ff46f-531b-4669-9f56-869d02210116-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:28:23.230055 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.230022    2572 generic.go:356] "Generic (PLEG): container finished" podID="612ff46f-531b-4669-9f56-869d02210116" containerID="7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab" exitCode=0
Jul 02 19:28:23.230219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.230068    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"
Jul 02 19:28:23.230219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.230077    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg" event={"ID":"612ff46f-531b-4669-9f56-869d02210116","Type":"ContainerDied","Data":"7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab"}
Jul 02 19:28:23.230219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.230118    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg" event={"ID":"612ff46f-531b-4669-9f56-869d02210116","Type":"ContainerDied","Data":"01f77b2b61970ccb5c70408e6720ff0d2ecf6b0204a3f94635d3aed462e3a49d"}
Jul 02 19:28:23.230219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.230139    2572 scope.go:117] "RemoveContainer" containerID="7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab"
Jul 02 19:28:23.239313 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.239296    2572 scope.go:117] "RemoveContainer" containerID="7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab"
Jul 02 19:28:23.239553 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:28:23.239531    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab\": container with ID starting with 7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab not found: ID does not exist" containerID="7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab"
Jul 02 19:28:23.239604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.239562    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab"} err="failed to get container status \"7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab\": rpc error: code = NotFound desc = could not find container \"7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab\": container with ID starting with 7e208dcd0308577a3a8eb4f227a07af68b3f5835da52fee61b91320503528bab not found: ID does not exist"
Jul 02 19:28:23.251968 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.251946    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"]
Jul 02 19:28:23.257507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:23.257484    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-079596c4-openshift-default-d7f8cbf59-jq2jg"]
Jul 02 19:28:24.162177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:24.162145    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="612ff46f-531b-4669-9f56-869d02210116" path="/var/lib/kubelet/pods/612ff46f-531b-4669-9f56-869d02210116/volumes"
Jul 02 19:28:27.589179 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:28:27.589144    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:29:48.985023 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:29:48.984989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:29:58.094945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:29:58.094909    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:30:00.188401 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.188368    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-r9kxs"]
Jul 02 19:30:00.188773 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.188696    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612ff46f-531b-4669-9f56-869d02210116" containerName="istio-proxy"
Jul 02 19:30:00.188773 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.188706    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="612ff46f-531b-4669-9f56-869d02210116" containerName="istio-proxy"
Jul 02 19:30:00.188773 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.188765    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="612ff46f-531b-4669-9f56-869d02210116" containerName="istio-proxy"
Jul 02 19:30:00.191780 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.191761    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:00.196304 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.196286    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hxm9f\""
Jul 02 19:30:00.224962 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.224928    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-r9kxs"]
Jul 02 19:30:00.285477 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.285433    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc5pb\" (UniqueName: \"kubernetes.io/projected/59c03ea4-3971-4673-ab41-9237bedf316a-kube-api-access-nc5pb\") pod \"maas-api-key-cleanup-29717010-r9kxs\" (UID: \"59c03ea4-3971-4673-ab41-9237bedf316a\") " pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:00.385944 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.385905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc5pb\" (UniqueName: \"kubernetes.io/projected/59c03ea4-3971-4673-ab41-9237bedf316a-kube-api-access-nc5pb\") pod \"maas-api-key-cleanup-29717010-r9kxs\" (UID: \"59c03ea4-3971-4673-ab41-9237bedf316a\") " pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:00.402763 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.402735    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc5pb\" (UniqueName: \"kubernetes.io/projected/59c03ea4-3971-4673-ab41-9237bedf316a-kube-api-access-nc5pb\") pod \"maas-api-key-cleanup-29717010-r9kxs\" (UID: \"59c03ea4-3971-4673-ab41-9237bedf316a\") " pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:00.501692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.501651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:00.669275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.669238    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-r9kxs"]
Jul 02 19:30:00.673614 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:30:00.673586    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c03ea4_3971_4673_ab41_9237bedf316a.slice/crio-21fa63675cfab2641e12941bd7781de75f48db75ee6b07b6905e5979a6e8a961 WatchSource:0}: Error finding container 21fa63675cfab2641e12941bd7781de75f48db75ee6b07b6905e5979a6e8a961: Status 404 returned error can't find the container with id 21fa63675cfab2641e12941bd7781de75f48db75ee6b07b6905e5979a6e8a961
Jul 02 19:30:00.764195 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.764107    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"]
Jul 02 19:30:00.768213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.768192    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.771219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.771194    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0d36c06a-openshift-default-dockercfg-kmksn\""
Jul 02 19:30:00.789511 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789476    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5t8\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-kube-api-access-4j5t8\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789667 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-socket\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789667 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-podinfo\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789667 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-envoy\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789667 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-data\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789667 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789659    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-certs\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789880 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-token\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789880 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istiod-ca-cert\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.789880 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.789758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-credential-socket\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.798556 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.798526    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"]
Jul 02 19:30:00.890971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.890933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-certs\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.890971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.890973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-token\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istiod-ca-cert\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-credential-socket\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891081    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5t8\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-kube-api-access-4j5t8\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-socket\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-podinfo\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-envoy\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891219    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-data\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891648 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891434    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-certs\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891648 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891507    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-credential-socket\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891828 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891790    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-data\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891882 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891829    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istiod-ca-cert\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.891882 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.891837    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-socket\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.893609 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.893589    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-envoy\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.893911 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.893892    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-podinfo\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.902911 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.902887    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-token\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:00.906056 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:00.906038    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5t8\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-kube-api-access-4j5t8\") pod \"e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") " pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:01.079252 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.079165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:01.304873 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.304846    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"]
Jul 02 19:30:01.306949 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:30:01.306921    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cc32e7_875b_429f_88f7_e53cac3e2bc7.slice/crio-6320dc1d0d84ebcf7435ddf7de3a1acfb7f8d318a63ce1d3c1acec57a6027a5a WatchSource:0}: Error finding container 6320dc1d0d84ebcf7435ddf7de3a1acfb7f8d318a63ce1d3c1acec57a6027a5a: Status 404 returned error can't find the container with id 6320dc1d0d84ebcf7435ddf7de3a1acfb7f8d318a63ce1d3c1acec57a6027a5a
Jul 02 19:30:01.309181 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.309151    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:01.309248 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.309218    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:01.309284 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.309247    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:01.672227 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.672112    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs" event={"ID":"59c03ea4-3971-4673-ab41-9237bedf316a","Type":"ContainerStarted","Data":"21cf444b27a9aa547773daed8f5ed22ba57023757fcc525c4401adeb3a1096b0"}
Jul 02 19:30:01.672227 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.672177    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs" event={"ID":"59c03ea4-3971-4673-ab41-9237bedf316a","Type":"ContainerStarted","Data":"21fa63675cfab2641e12941bd7781de75f48db75ee6b07b6905e5979a6e8a961"}
Jul 02 19:30:01.673641 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.673610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" event={"ID":"d4cc32e7-875b-429f-88f7-e53cac3e2bc7","Type":"ContainerStarted","Data":"899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"}
Jul 02 19:30:01.673755 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.673668    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" event={"ID":"d4cc32e7-875b-429f-88f7-e53cac3e2bc7","Type":"ContainerStarted","Data":"6320dc1d0d84ebcf7435ddf7de3a1acfb7f8d318a63ce1d3c1acec57a6027a5a"}
Jul 02 19:30:01.697638 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.697579    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs" podStartSLOduration=1.697562235 podStartE2EDuration="1.697562235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:01.696547248 +0000 UTC m=+1666.068301970" watchObservedRunningTime="2026-07-02 19:30:01.697562235 +0000 UTC m=+1666.069316957"
Jul 02 19:30:01.722460 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:01.722404    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podStartSLOduration=1.722372515 podStartE2EDuration="1.722372515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:01.721192246 +0000 UTC m=+1666.092946981" watchObservedRunningTime="2026-07-02 19:30:01.722372515 +0000 UTC m=+1666.094127239"
Jul 02 19:30:02.079669 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:02.079634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:02.084604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:02.084580    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:02.679500 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:02.679466    2572 generic.go:356] "Generic (PLEG): container finished" podID="59c03ea4-3971-4673-ab41-9237bedf316a" containerID="21cf444b27a9aa547773daed8f5ed22ba57023757fcc525c4401adeb3a1096b0" exitCode=0
Jul 02 19:30:02.680000 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:02.679550    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs" event={"ID":"59c03ea4-3971-4673-ab41-9237bedf316a","Type":"ContainerDied","Data":"21cf444b27a9aa547773daed8f5ed22ba57023757fcc525c4401adeb3a1096b0"}
Jul 02 19:30:02.680000 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:02.679865    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:02.680776 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:02.680757    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:03.822199 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:03.822171    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:03.912078 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:03.912050    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc5pb\" (UniqueName: \"kubernetes.io/projected/59c03ea4-3971-4673-ab41-9237bedf316a-kube-api-access-nc5pb\") pod \"59c03ea4-3971-4673-ab41-9237bedf316a\" (UID: \"59c03ea4-3971-4673-ab41-9237bedf316a\") "
Jul 02 19:30:03.914161 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:03.914125    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c03ea4-3971-4673-ab41-9237bedf316a-kube-api-access-nc5pb" (OuterVolumeSpecName: "kube-api-access-nc5pb") pod "59c03ea4-3971-4673-ab41-9237bedf316a" (UID: "59c03ea4-3971-4673-ab41-9237bedf316a"). InnerVolumeSpecName "kube-api-access-nc5pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:04.013671 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:04.013634    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc5pb\" (UniqueName: \"kubernetes.io/projected/59c03ea4-3971-4673-ab41-9237bedf316a-kube-api-access-nc5pb\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:04.690378 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:04.690352    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs"
Jul 02 19:30:04.690562 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:04.690390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-r9kxs" event={"ID":"59c03ea4-3971-4673-ab41-9237bedf316a","Type":"ContainerDied","Data":"21fa63675cfab2641e12941bd7781de75f48db75ee6b07b6905e5979a6e8a961"}
Jul 02 19:30:04.690562 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:04.690433    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21fa63675cfab2641e12941bd7781de75f48db75ee6b07b6905e5979a6e8a961"
Jul 02 19:30:08.786999 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:08.786961    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:30:17.681647 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.681560    2572 patch_prober.go:28] interesting pod/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 02 19:30:17.681647 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.681618    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 02 19:30:17.762582 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.762492    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerID="899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a" exitCode=0
Jul 02 19:30:17.762582 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.762560    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" event={"ID":"d4cc32e7-875b-429f-88f7-e53cac3e2bc7","Type":"ContainerDied","Data":"899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"}
Jul 02 19:30:17.763044 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.763026    2572 scope.go:117] "RemoveContainer" containerID="899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"
Jul 02 19:30:17.764051 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.764027    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:17.764124 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.764093    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:17.764170 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:17.764126    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:18.770018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:18.769984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" event={"ID":"d4cc32e7-875b-429f-88f7-e53cac3e2bc7","Type":"ContainerStarted","Data":"f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114"}
Jul 02 19:30:19.079953 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:19.079855    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:19.080194 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:19.080175    2572 patch_prober.go:28] interesting pod/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 02 19:30:19.080236 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:19.080218    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 02 19:30:19.715764 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:19.715723    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:30:20.079889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:20.079853    2572 patch_prober.go:28] interesting pod/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 02 19:30:20.080357 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:20.079907    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 02 19:30:21.080341 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:21.080303    2572 patch_prober.go:28] interesting pod/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 02 19:30:21.080884 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:21.080374    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 02 19:30:22.080488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:22.080452    2572 patch_prober.go:28] interesting pod/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 02 19:30:22.080910 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:22.080507    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 02 19:30:22.823282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:22.823251    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"]
Jul 02 19:30:22.823486 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:22.823446    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy" containerID="cri-o://f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114" gracePeriod=30
Jul 02 19:30:28.085265 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.085236    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:28.223645 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223611    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-certs\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.223855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223657    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-socket\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.223855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223691    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-podinfo\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.223855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223730    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j5t8\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-kube-api-access-4j5t8\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.223855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223770    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-envoy\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.223855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223838    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istiod-ca-cert\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.224131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223873    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-data\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.224131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223920    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-token\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.224131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223962    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-credential-socket\") pod \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\" (UID: \"d4cc32e7-875b-429f-88f7-e53cac3e2bc7\") "
Jul 02 19:30:28.224131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.223974    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:28.224131 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224017    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:28.224368 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224248    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:30:28.224368 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224318    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.224368 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224340    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.224368 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224358    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.224763 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224736    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:28.224932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.224911    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:28.226211 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.226191    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:28.226288 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.226200    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:30:28.226396 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.226368    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-kube-api-access-4j5t8" (OuterVolumeSpecName: "kube-api-access-4j5t8") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "kube-api-access-4j5t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:28.226468 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.226447    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4cc32e7-875b-429f-88f7-e53cac3e2bc7" (UID: "d4cc32e7-875b-429f-88f7-e53cac3e2bc7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:30:28.325599 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.325541    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j5t8\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-kube-api-access-4j5t8\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.325599 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.325590    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.325599 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.325599    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.325599 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.325608    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.325893 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.325616    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.325893 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.325624    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cc32e7-875b-429f-88f7-e53cac3e2bc7-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:30:28.822451 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.822413    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerID="f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114" exitCode=0
Jul 02 19:30:28.822624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.822468    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"
Jul 02 19:30:28.822624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.822466    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" event={"ID":"d4cc32e7-875b-429f-88f7-e53cac3e2bc7","Type":"ContainerDied","Data":"f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114"}
Jul 02 19:30:28.822624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.822588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd" event={"ID":"d4cc32e7-875b-429f-88f7-e53cac3e2bc7","Type":"ContainerDied","Data":"6320dc1d0d84ebcf7435ddf7de3a1acfb7f8d318a63ce1d3c1acec57a6027a5a"}
Jul 02 19:30:28.822624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.822617    2572 scope.go:117] "RemoveContainer" containerID="f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114"
Jul 02 19:30:28.831999 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.831984    2572 scope.go:117] "RemoveContainer" containerID="899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"
Jul 02 19:30:28.840306 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.840286    2572 scope.go:117] "RemoveContainer" containerID="f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114"
Jul 02 19:30:28.840562 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:30:28.840536    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114\": container with ID starting with f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114 not found: ID does not exist" containerID="f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114"
Jul 02 19:30:28.840620 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.840571    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114"} err="failed to get container status \"f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114\": rpc error: code = NotFound desc = could not find container \"f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114\": container with ID starting with f9d007ffc15c79ed1419d094bbc89181c3f7f916fbbefbbf9fc30b2a0aeae114 not found: ID does not exist"
Jul 02 19:30:28.840620 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.840587    2572 scope.go:117] "RemoveContainer" containerID="899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"
Jul 02 19:30:28.840876 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:30:28.840853    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a\": container with ID starting with 899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a not found: ID does not exist" containerID="899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"
Jul 02 19:30:28.840939 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.840884    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a"} err="failed to get container status \"899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a\": rpc error: code = NotFound desc = could not find container \"899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a\": container with ID starting with 899740fc93e92fcdc9cf29f9dda68e577e64c5bce0776665113e70c07f83214a not found: ID does not exist"
Jul 02 19:30:28.843934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.843911    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"]
Jul 02 19:30:28.849203 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:28.849179    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0d36c06a-openshift-default-fcb779ccf-h54hd"]
Jul 02 19:30:30.162177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:30.162142    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" path="/var/lib/kubelet/pods/d4cc32e7-875b-429f-88f7-e53cac3e2bc7/volumes"
Jul 02 19:30:42.145211 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145134    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"]
Jul 02 19:30:42.145591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145516    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c03ea4-3971-4673-ab41-9237bedf316a" containerName="cleanup"
Jul 02 19:30:42.145591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145528    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c03ea4-3971-4673-ab41-9237bedf316a" containerName="cleanup"
Jul 02 19:30:42.145591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145542    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy"
Jul 02 19:30:42.145591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145550    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy"
Jul 02 19:30:42.145591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145564    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy"
Jul 02 19:30:42.145591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145569    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy"
Jul 02 19:30:42.145783 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145624    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c03ea4-3971-4673-ab41-9237bedf316a" containerName="cleanup"
Jul 02 19:30:42.145783 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.145634    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy"
Jul 02 19:30:42.150377 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.150357    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.152788 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.152770    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ca91d730-openshift-default-dockercfg-bj4vm\""
Jul 02 19:30:42.163423 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.163400    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"]
Jul 02 19:30:42.246747 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.246706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-data\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.246759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-socket\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.246794    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-certs\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.246915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-podinfo\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247018 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.246960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg464\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-kube-api-access-hg464\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247231 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.247055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-credential-socket\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247231 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.247119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-envoy\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247231 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.247205    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-token\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.247347 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.247240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ce1155f-9903-41e9-b380-a6202f18ec77-istiod-ca-cert\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348134 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348099    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-token\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ce1155f-9903-41e9-b380-a6202f18ec77-istiod-ca-cert\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-data\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-socket\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-certs\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-podinfo\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg464\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-kube-api-access-hg464\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.348344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-credential-socket\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.349010 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348370    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-envoy\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.349010 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348645    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-data\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.349010 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348687    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-certs\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.349010 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348840    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-credential-socket\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.349010 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.348909    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ce1155f-9903-41e9-b380-a6202f18ec77-istiod-ca-cert\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.349206 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.349069    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-socket\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.350816 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.350771    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-envoy\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.351000 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.350983    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-podinfo\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.356612 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.356591    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg464\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-kube-api-access-hg464\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.356734 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.356590    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-token\") pod \"e2e-mt-ca91d730-openshift-default-67464f7475-hj27q\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") " pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.462755 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.462672    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:42.609602 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.609575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"]
Jul 02 19:30:42.611454 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:30:42.611415    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce1155f_9903_41e9_b380_a6202f18ec77.slice/crio-81a44ef19c8e615488c9d6067db04533f99d71819cfef2da1a13512f43a68bec WatchSource:0}: Error finding container 81a44ef19c8e615488c9d6067db04533f99d71819cfef2da1a13512f43a68bec: Status 404 returned error can't find the container with id 81a44ef19c8e615488c9d6067db04533f99d71819cfef2da1a13512f43a68bec
Jul 02 19:30:42.613855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.613793    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:42.613942 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.613902    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:42.613987 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.613944    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:42.891401 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.891360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" event={"ID":"7ce1155f-9903-41e9-b380-a6202f18ec77","Type":"ContainerStarted","Data":"e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"}
Jul 02 19:30:42.891581 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.891427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" event={"ID":"7ce1155f-9903-41e9-b380-a6202f18ec77","Type":"ContainerStarted","Data":"81a44ef19c8e615488c9d6067db04533f99d71819cfef2da1a13512f43a68bec"}
Jul 02 19:30:42.919692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:42.919628    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" podStartSLOduration=0.919605774 podStartE2EDuration="919.605774ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:42.917010468 +0000 UTC m=+1707.288765204" watchObservedRunningTime="2026-07-02 19:30:42.919605774 +0000 UTC m=+1707.291360497"
Jul 02 19:30:43.463067 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:43.463033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:43.468290 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:43.468264    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:43.895612 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:43.895580    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:43.896653 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:43.896633    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:47.789001 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:47.788968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:30:55.953736 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:55.953642    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerID="e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d" exitCode=0
Jul 02 19:30:55.953736 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:55.953712    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" event={"ID":"7ce1155f-9903-41e9-b380-a6202f18ec77","Type":"ContainerDied","Data":"e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"}
Jul 02 19:30:55.954164 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:55.954077    2572 scope.go:117] "RemoveContainer" containerID="e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"
Jul 02 19:30:55.955055 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:55.955030    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:55.955106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:55.955092    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:55.955142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:55.955126    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:30:56.960586 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:56.960552    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" event={"ID":"7ce1155f-9903-41e9-b380-a6202f18ec77","Type":"ContainerStarted","Data":"7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92"}
Jul 02 19:30:57.463675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:57.463629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:57.464934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:57.464906    2572 patch_prober.go:28] interesting pod/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:30:57.465058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:57.464969    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:30:58.463714 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:58.463678    2572 patch_prober.go:28] interesting pod/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:30:58.464153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:58.463761    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:30:58.896360 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:58.896315    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:30:59.463711 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.463665    2572 patch_prober.go:28] interesting pod/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:30:59.463945 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.463744    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:30:59.784054 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.784010    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"]
Jul 02 19:30:59.784617 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.784580    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cc32e7-875b-429f-88f7-e53cac3e2bc7" containerName="istio-proxy"
Jul 02 19:30:59.788193 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.788173    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.791409 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.791387    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ca91d730\"/\"openshift-service-ca.crt\""
Jul 02 19:30:59.791542 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.791395    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ca91d730\"/\"default-dockercfg-ftdrs\""
Jul 02 19:30:59.791542 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.791520    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ca91d730\"/\"e2e-lifecycle-model-ca91d730-kserve-self-signed-certs\""
Jul 02 19:30:59.791664 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.791547    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ca91d730\"/\"kube-root-ca.crt\""
Jul 02 19:30:59.796541 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.796500    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"]
Jul 02 19:30:59.811779 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.811753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-model-cache\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.811954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.811799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tmp-dir\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.811954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.811912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-home\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.811954 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.811943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-dshm\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.812102 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.812007    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tls-certs\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.812102 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.812024    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92fm\" (UniqueName: \"kubernetes.io/projected/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-kube-api-access-s92fm\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.912941 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.912902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tmp-dir\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.912966    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-home\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.912990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-dshm\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.913024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tls-certs\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.913047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92fm\" (UniqueName: \"kubernetes.io/projected/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-kube-api-access-s92fm\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913136 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.913115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-model-cache\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913394 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.913358    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tmp-dir\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913450 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.913423    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-home\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.913495 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.913461    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-model-cache\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.915389 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.915364    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-dshm\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.915643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.915627    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tls-certs\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:30:59.920704 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:30:59.920682    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92fm\" (UniqueName: \"kubernetes.io/projected/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-kube-api-access-s92fm\") pod \"e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") " pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:00.099371 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:00.099285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:00.289128 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:00.289104    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"]
Jul 02 19:31:00.290846 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:31:00.290795    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdaad8c7_67cd_4d41_886e_7ede2eecf6d1.slice/crio-40aff74fc41f4dc1a55fa956f2aebf04254d053e6f379bc19e0830a0104d3dae WatchSource:0}: Error finding container 40aff74fc41f4dc1a55fa956f2aebf04254d053e6f379bc19e0830a0104d3dae: Status 404 returned error can't find the container with id 40aff74fc41f4dc1a55fa956f2aebf04254d053e6f379bc19e0830a0104d3dae
Jul 02 19:31:00.463619 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:00.463588    2572 patch_prober.go:28] interesting pod/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:31:00.463787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:00.463650    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:31:00.980622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:00.980589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k" event={"ID":"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1","Type":"ContainerStarted","Data":"c386d7730188fb37818fbba937c02de853fd20a8388a91d6bdfdc47c2fea6851"}
Jul 02 19:31:00.981073 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:00.980634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k" event={"ID":"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1","Type":"ContainerStarted","Data":"40aff74fc41f4dc1a55fa956f2aebf04254d053e6f379bc19e0830a0104d3dae"}
Jul 02 19:31:01.003117 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:01.003055    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k" podStartSLOduration=2.003035226 podStartE2EDuration="2.003035226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:31:01.000419825 +0000 UTC m=+1725.372174583" watchObservedRunningTime="2026-07-02 19:31:01.003035226 +0000 UTC m=+1725.374789949"
Jul 02 19:31:01.468070 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:01.467977    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:31:01.469120 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:01.469099    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:31:02.391914 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:02.391874    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:31:10.099415 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:10.099373    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:10.099935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:10.099460    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:10.111710 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:10.111686    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:11.045140 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:11.045113    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:19.484601 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:19.484563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:31:33.023371 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:33.023333    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"]
Jul 02 19:31:33.889034 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:33.889001    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:31:48.044261 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.044204    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k" podUID="cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" containerName="main" containerID="cri-o://c386d7730188fb37818fbba937c02de853fd20a8388a91d6bdfdc47c2fea6851" gracePeriod=45
Jul 02 19:31:48.199186 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.199155    2572 generic.go:356] "Generic (PLEG): container finished" podID="cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" containerID="c386d7730188fb37818fbba937c02de853fd20a8388a91d6bdfdc47c2fea6851" exitCode=0
Jul 02 19:31:48.199360 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.199246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k" event={"ID":"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1","Type":"ContainerDied","Data":"c386d7730188fb37818fbba937c02de853fd20a8388a91d6bdfdc47c2fea6851"}
Jul 02 19:31:48.295392 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.295329    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:48.339665 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.339636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s92fm\" (UniqueName: \"kubernetes.io/projected/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-kube-api-access-s92fm\") pod \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") "
Jul 02 19:31:48.339858 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.339685    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-model-cache\") pod \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") "
Jul 02 19:31:48.339858 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.339728    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-dshm\") pod \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") "
Jul 02 19:31:48.339858 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.339762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-home\") pod \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") "
Jul 02 19:31:48.339858 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.339784    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tls-certs\") pod \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") "
Jul 02 19:31:48.340091 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.339865    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tmp-dir\") pod \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\" (UID: \"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1\") "
Jul 02 19:31:48.340091 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.340050    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" (UID: "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:48.340204 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.340166    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-model-cache\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:31:48.340257 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.340228    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" (UID: "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:48.340426 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.340384    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-home" (OuterVolumeSpecName: "home") pod "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" (UID: "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:48.342145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.342117    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-dshm" (OuterVolumeSpecName: "dshm") pod "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" (UID: "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:48.342290 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.342256    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" (UID: "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:31:48.342378 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.342296    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-kube-api-access-s92fm" (OuterVolumeSpecName: "kube-api-access-s92fm") pod "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" (UID: "cdaad8c7-67cd-4d41-886e-7ede2eecf6d1"). InnerVolumeSpecName "kube-api-access-s92fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:31:48.440956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.440924    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-home\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:31:48.440956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.440951    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tls-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:31:48.440956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.440962    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-tmp-dir\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:31:48.441191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.440972    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s92fm\" (UniqueName: \"kubernetes.io/projected/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-kube-api-access-s92fm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:31:48.441191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:48.440981    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1-dshm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:31:49.205058 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:49.205033    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"
Jul 02 19:31:49.205511 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:49.205060    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k" event={"ID":"cdaad8c7-67cd-4d41-886e-7ede2eecf6d1","Type":"ContainerDied","Data":"40aff74fc41f4dc1a55fa956f2aebf04254d053e6f379bc19e0830a0104d3dae"}
Jul 02 19:31:49.205511 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:49.205110    2572 scope.go:117] "RemoveContainer" containerID="c386d7730188fb37818fbba937c02de853fd20a8388a91d6bdfdc47c2fea6851"
Jul 02 19:31:49.226448 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:49.226406    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"]
Jul 02 19:31:49.228825 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:49.228787    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ca91d730/e2e-lifecycle-model-ca91d730-kserve-58dd987555-r4z2k"]
Jul 02 19:31:50.161958 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:31:50.161928    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" path="/var/lib/kubelet/pods/cdaad8c7-67cd-4d41-886e-7ede2eecf6d1/volumes"
Jul 02 19:32:13.410156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:13.410119    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:32:16.218669 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:16.218636    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:32:16.222416 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:16.222390    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:32:22.441325 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:22.441288    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"]
Jul 02 19:32:22.441834 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:22.441583    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy" containerID="cri-o://7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92" gracePeriod=30
Jul 02 19:32:26.198527 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:26.198494    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:32:27.686836 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.686781    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:32:27.792678 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792646    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-token\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.792889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792690    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ce1155f-9903-41e9-b380-a6202f18ec77-istiod-ca-cert\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.792889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792712    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-data\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.792889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792744    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-envoy\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.792889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792772    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg464\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-kube-api-access-hg464\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.792889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792825    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-socket\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.792889 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792888    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-podinfo\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.793207 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793125    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:27.793263 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.792978    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-certs\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.793263 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793232    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ce1155f-9903-41e9-b380-a6202f18ec77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:32:27.793347 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793265    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-credential-socket\") pod \"7ce1155f-9903-41e9-b380-a6202f18ec77\" (UID: \"7ce1155f-9903-41e9-b380-a6202f18ec77\") "
Jul 02 19:32:27.793457 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793430    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:27.793586 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793565    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:27.793650 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793630    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.793695 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793650    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ce1155f-9903-41e9-b380-a6202f18ec77-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.793695 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793665    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.793784 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.793709    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:27.794965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.794936    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:32:27.795071 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.795027    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:32:27.795322 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.795283    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:32:27.795433 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.795361    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-kube-api-access-hg464" (OuterVolumeSpecName: "kube-api-access-hg464") pod "7ce1155f-9903-41e9-b380-a6202f18ec77" (UID: "7ce1155f-9903-41e9-b380-a6202f18ec77"). InnerVolumeSpecName "kube-api-access-hg464". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:32:27.894767 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.894729    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.894767 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.894759    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.894767 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.894769    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.894767 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.894777    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.895080 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.894785    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ce1155f-9903-41e9-b380-a6202f18ec77-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:27.895080 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:27.894792    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg464\" (UniqueName: \"kubernetes.io/projected/7ce1155f-9903-41e9-b380-a6202f18ec77-kube-api-access-hg464\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:32:28.396548 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.396510    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerID="7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92" exitCode=0
Jul 02 19:32:28.396717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.396573    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"
Jul 02 19:32:28.396717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.396594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" event={"ID":"7ce1155f-9903-41e9-b380-a6202f18ec77","Type":"ContainerDied","Data":"7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92"}
Jul 02 19:32:28.396717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.396670    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q" event={"ID":"7ce1155f-9903-41e9-b380-a6202f18ec77","Type":"ContainerDied","Data":"81a44ef19c8e615488c9d6067db04533f99d71819cfef2da1a13512f43a68bec"}
Jul 02 19:32:28.396717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.396692    2572 scope.go:117] "RemoveContainer" containerID="7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92"
Jul 02 19:32:28.405487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.405468    2572 scope.go:117] "RemoveContainer" containerID="e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"
Jul 02 19:32:28.413270 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.413252    2572 scope.go:117] "RemoveContainer" containerID="7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92"
Jul 02 19:32:28.413530 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:32:28.413501    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92\": container with ID starting with 7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92 not found: ID does not exist" containerID="7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92"
Jul 02 19:32:28.413583 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.413538    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92"} err="failed to get container status \"7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92\": rpc error: code = NotFound desc = could not find container \"7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92\": container with ID starting with 7f8b10a9c0ce4ea3f1c65548a655d68969631cc4ca2c44912a120f838f3e1b92 not found: ID does not exist"
Jul 02 19:32:28.413583 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.413554    2572 scope.go:117] "RemoveContainer" containerID="e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"
Jul 02 19:32:28.413793 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:32:28.413775    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d\": container with ID starting with e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d not found: ID does not exist" containerID="e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"
Jul 02 19:32:28.413864 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.413816    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d"} err="failed to get container status \"e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d\": rpc error: code = NotFound desc = could not find container \"e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d\": container with ID starting with e64277fd32aac9e4aca0056a0fd8b55925b63df1b1d9c56dad735b7c4bb9859d not found: ID does not exist"
Jul 02 19:32:28.417458 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.417437    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"]
Jul 02 19:32:28.422788 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:28.422767    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ca91d730-openshift-default-67464f7475-hj27q"]
Jul 02 19:32:30.162213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:30.162180    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" path="/var/lib/kubelet/pods/7ce1155f-9903-41e9-b380-a6202f18ec77/volumes"
Jul 02 19:32:37.887488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:32:37.887452    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:33:18.487736 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.487691    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"]
Jul 02 19:33:18.488219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488204    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy"
Jul 02 19:33:18.488275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488223    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy"
Jul 02 19:33:18.488275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488237    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy"
Jul 02 19:33:18.488275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488260    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy"
Jul 02 19:33:18.488275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488269    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" containerName="main"
Jul 02 19:33:18.488399 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488278    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" containerName="main"
Jul 02 19:33:18.488399 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488384    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy"
Jul 02 19:33:18.488399 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488394    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdaad8c7-67cd-4d41-886e-7ede2eecf6d1" containerName="main"
Jul 02 19:33:18.488487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.488406    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ce1155f-9903-41e9-b380-a6202f18ec77" containerName="istio-proxy"
Jul 02 19:33:18.491555 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.491538    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.493944 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.493919    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1980a2-openshift-default-dockercfg-77zsd\""
Jul 02 19:33:18.503965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.503942    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"]
Jul 02 19:33:18.611191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-envoy\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfzz\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-kube-api-access-7tfzz\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611432 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-token\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611432 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611307    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-credential-socket\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611432 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a2a180-c479-4f3f-bcec-f7edd830eb35-istiod-ca-cert\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611432 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611366    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-data\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-podinfo\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-certs\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.611643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.611548    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-socket\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712348 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-credential-socket\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a2a180-c479-4f3f-bcec-f7edd830eb35-istiod-ca-cert\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712411    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-data\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712441    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-podinfo\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-certs\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-socket\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-envoy\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfzz\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-kube-api-access-7tfzz\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712585    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-token\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712848    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-data\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.712977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.712904    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-credential-socket\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.713208 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.713186    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-socket\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.713260 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.713213    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-certs\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.713260 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.713243    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a2a180-c479-4f3f-bcec-f7edd830eb35-istiod-ca-cert\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.714980 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.714943    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-envoy\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.715183 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.715166    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-podinfo\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.720651 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.720629    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-token\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.720651 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.720638    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfzz\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-kube-api-access-7tfzz\") pod \"e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") " pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.804764 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.804664    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:18.949492 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.949466    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"]
Jul 02 19:33:18.951659 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:33:18.951624    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a2a180_c479_4f3f_bcec_f7edd830eb35.slice/crio-7100f9233a37b4082894016da4a2278f353caa21ff06abcf1332070d2e91f45f WatchSource:0}: Error finding container 7100f9233a37b4082894016da4a2278f353caa21ff06abcf1332070d2e91f45f: Status 404 returned error can't find the container with id 7100f9233a37b4082894016da4a2278f353caa21ff06abcf1332070d2e91f45f
Jul 02 19:33:18.953641 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.953614    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:18.953711 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.953679    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:18.953711 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:18.953707    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:19.632531 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:19.632491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" event={"ID":"90a2a180-c479-4f3f-bcec-f7edd830eb35","Type":"ContainerStarted","Data":"e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"}
Jul 02 19:33:19.633084 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:19.632547    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" event={"ID":"90a2a180-c479-4f3f-bcec-f7edd830eb35","Type":"ContainerStarted","Data":"7100f9233a37b4082894016da4a2278f353caa21ff06abcf1332070d2e91f45f"}
Jul 02 19:33:19.653796 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:19.653743    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podStartSLOduration=1.653726538 podStartE2EDuration="1.653726538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:19.652339135 +0000 UTC m=+1864.024093866" watchObservedRunningTime="2026-07-02 19:33:19.653726538 +0000 UTC m=+1864.025481258"
Jul 02 19:33:19.805661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:19.805625    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:20.810127 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:20.810095    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:21.642757 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:21.642723    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:21.643644 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:21.643625    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:26.813926 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.813897    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"]
Jul 02 19:33:26.817700 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.817678    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.822581 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.822562    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-85423d-openshift-default-dockercfg-r2qzb\""
Jul 02 19:33:26.853574 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.853541    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"]
Jul 02 19:33:26.983523 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-certs\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983523 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-data\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983590    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-credential-socket\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-socket\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983665    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-podinfo\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d14b1b41-c496-4c93-8620-3e6e04139acb-istiod-ca-cert\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983917 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhtw7\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-kube-api-access-lhtw7\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983917 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983790    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-envoy\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:26.983917 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:26.983832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-token\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085180 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-credential-socket\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085180 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-socket\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085180 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085164    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-podinfo\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085201    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d14b1b41-c496-4c93-8620-3e6e04139acb-istiod-ca-cert\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtw7\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-kube-api-access-lhtw7\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085242    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-envoy\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-token\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-certs\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-data\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085842 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085567    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-credential-socket\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085842 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085668    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-data\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085842 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085723    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-certs\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.085965 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.085840    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-socket\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.086272 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.086250    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d14b1b41-c496-4c93-8620-3e6e04139acb-istiod-ca-cert\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.087845 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.087821    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-podinfo\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.088053 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.088033    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-envoy\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.093464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.093436    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-token\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.093909 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.093864    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtw7\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-kube-api-access-lhtw7\") pod \"e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") " pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.127906 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.127869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:27.272197 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.272172    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"]
Jul 02 19:33:27.274428 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:33:27.274403    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14b1b41_c496_4c93_8620_3e6e04139acb.slice/crio-f5b81df3486fdbf9a06580fe0afbb2df9c85ca301679c107bbeff6532ba7ad71 WatchSource:0}: Error finding container f5b81df3486fdbf9a06580fe0afbb2df9c85ca301679c107bbeff6532ba7ad71: Status 404 returned error can't find the container with id f5b81df3486fdbf9a06580fe0afbb2df9c85ca301679c107bbeff6532ba7ad71
Jul 02 19:33:27.276725 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.276694    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:27.276826 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.276761    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:27.276826 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.276792    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:27.672982 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.672937    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" event={"ID":"d14b1b41-c496-4c93-8620-3e6e04139acb","Type":"ContainerStarted","Data":"bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"}
Jul 02 19:33:27.673167 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.673008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" event={"ID":"d14b1b41-c496-4c93-8620-3e6e04139acb","Type":"ContainerStarted","Data":"f5b81df3486fdbf9a06580fe0afbb2df9c85ca301679c107bbeff6532ba7ad71"}
Jul 02 19:33:27.694040 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:27.693993    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podStartSLOduration=1.6939774600000002 podStartE2EDuration="1.69397746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:27.692456903 +0000 UTC m=+1872.064211645" watchObservedRunningTime="2026-07-02 19:33:27.69397746 +0000 UTC m=+1872.065732181"
Jul 02 19:33:28.128444 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:28.128413    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:28.134270 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:28.134241    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:28.677437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:28.677404    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:28.678406 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:28.678390    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:29.381521 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:29.381487    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:33:36.953238 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:36.953179    2572 patch_prober.go:28] interesting pod/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:56088->10.132.0.42:15021: read: connection reset by peer" start-of-body=
Jul 02 19:33:36.953619 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:36.953265    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:56088->10.132.0.42:15021: read: connection reset by peer"
Jul 02 19:33:37.720616 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:37.720581    2572 generic.go:356] "Generic (PLEG): container finished" podID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerID="e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88" exitCode=0
Jul 02 19:33:37.720844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:37.720653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" event={"ID":"90a2a180-c479-4f3f-bcec-f7edd830eb35","Type":"ContainerDied","Data":"e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"}
Jul 02 19:33:37.721092 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:37.721078    2572 scope.go:117] "RemoveContainer" containerID="e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"
Jul 02 19:33:37.722068 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:37.722040    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:37.722177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:37.722119    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:37.722177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:37.722167    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:38.727673 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:38.727591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" event={"ID":"90a2a180-c479-4f3f-bcec-f7edd830eb35","Type":"ContainerStarted","Data":"4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d"}
Jul 02 19:33:38.805559 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:38.805528    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:38.805790 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:38.805769    2572 patch_prober.go:28] interesting pod/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:33:38.805935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:38.805915    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:33:39.805932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:39.805893    2572 patch_prober.go:28] interesting pod/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:33:39.806338 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:39.805952    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:33:40.805454 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:40.805412    2572 patch_prober.go:28] interesting pod/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:33:40.805669 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:40.805468    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:33:41.805340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:41.805301    2572 patch_prober.go:28] interesting pod/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:33:41.805842 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:41.805357    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:33:42.808744 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:42.808709    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:42.809220 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:42.809147    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:42.809778 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:42.809758    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:33:43.489483 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:43.489450    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:33:44.719960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:44.719921    2572 patch_prober.go:28] interesting pod/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 19:33:44.720371 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:44.719974    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 19:33:45.776235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:45.776145    2572 generic.go:356] "Generic (PLEG): container finished" podID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerID="bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce" exitCode=0
Jul 02 19:33:45.776681 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:45.776224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" event={"ID":"d14b1b41-c496-4c93-8620-3e6e04139acb","Type":"ContainerDied","Data":"bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"}
Jul 02 19:33:45.776681 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:45.776627    2572 scope.go:117] "RemoveContainer" containerID="bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"
Jul 02 19:33:45.777626 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:45.777601    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:45.777697 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:45.777680    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:45.777761 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:45.777749    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:33:46.782978 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:46.782944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" event={"ID":"d14b1b41-c496-4c93-8620-3e6e04139acb","Type":"ContainerStarted","Data":"0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f"}
Jul 02 19:33:47.128658 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.128561    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:47.128855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.128688    2572 patch_prober.go:28] interesting pod/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 02 19:33:47.128855 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.128733    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 02 19:33:47.891264 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.891233    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"]
Jul 02 19:33:47.893749 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.893725    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:47.897050 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.897024    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1980a2\"/\"kube-root-ca.crt\""
Jul 02 19:33:47.897165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.897056    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1980a2\"/\"default-dockercfg-lb5w2\""
Jul 02 19:33:47.897333 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.897311    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1980a2\"/\"openshift-service-ca.crt\""
Jul 02 19:33:47.897493 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.897467    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1980a2\"/\"test-model-1980a2-kserve-self-signed-certs\""
Jul 02 19:33:47.904730 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.904700    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"]
Jul 02 19:33:47.983422 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.983382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-dshm\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:47.983422 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.983420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7tnc\" (UniqueName: \"kubernetes.io/projected/941b37e6-7576-4f2e-ba21-9612f228a893-kube-api-access-n7tnc\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:47.983645 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.983442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/941b37e6-7576-4f2e-ba21-9612f228a893-tls-certs\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:47.983645 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.983483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-model-cache\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:47.983645 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.983527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-tmp-dir\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:47.983645 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:47.983580    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-home\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.084932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.084885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-dshm\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.084932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.084935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7tnc\" (UniqueName: \"kubernetes.io/projected/941b37e6-7576-4f2e-ba21-9612f228a893-kube-api-access-n7tnc\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.084963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/941b37e6-7576-4f2e-ba21-9612f228a893-tls-certs\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.084988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-model-cache\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.085033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-tmp-dir\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085201 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.085099    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-home\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085529 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.085499    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-home\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085641 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.085614    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-model-cache\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.085713 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.085642    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-tmp-dir\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.087963 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.087933    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/941b37e6-7576-4f2e-ba21-9612f228a893-tls-certs\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.088093 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.087967    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-dshm\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.093321 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.093296    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7tnc\" (UniqueName: \"kubernetes.io/projected/941b37e6-7576-4f2e-ba21-9612f228a893-kube-api-access-n7tnc\") pod \"test-model-1980a2-kserve-85459fc6c-5cttl\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") " pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.129544 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.129101    2572 patch_prober.go:28] interesting pod/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 02 19:33:48.129544 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.129172    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 02 19:33:48.206306 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.206221    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:48.385253 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.385223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"]
Jul 02 19:33:48.387627 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:33:48.387602    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod941b37e6_7576_4f2e_ba21_9612f228a893.slice/crio-2bf1164158301d0017255db3226477e727acb4c779afae009d643b062679a9ff WatchSource:0}: Error finding container 2bf1164158301d0017255db3226477e727acb4c779afae009d643b062679a9ff: Status 404 returned error can't find the container with id 2bf1164158301d0017255db3226477e727acb4c779afae009d643b062679a9ff
Jul 02 19:33:48.794820 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.794761    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl" event={"ID":"941b37e6-7576-4f2e-ba21-9612f228a893","Type":"ContainerStarted","Data":"29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5"}
Jul 02 19:33:48.795021 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.794832    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl" event={"ID":"941b37e6-7576-4f2e-ba21-9612f228a893","Type":"ContainerStarted","Data":"2bf1164158301d0017255db3226477e727acb4c779afae009d643b062679a9ff"}
Jul 02 19:33:48.813439 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:48.813390    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl" podStartSLOduration=1.813375127 podStartE2EDuration="1.813375127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:48.811069165 +0000 UTC m=+1893.182823900" watchObservedRunningTime="2026-07-02 19:33:48.813375127 +0000 UTC m=+1893.185129848"
Jul 02 19:33:49.129233 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:49.129136    2572 patch_prober.go:28] interesting pod/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 02 19:33:49.130177 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:49.129746    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 02 19:33:50.128922 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:50.128882    2572 patch_prober.go:28] interesting pod/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 02 19:33:50.129239 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:50.129205    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 02 19:33:51.132157 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:51.132127    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:51.132591 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:51.132504    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:51.133326 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:51.133306    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:33:53.295850 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:53.295818    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:33:58.206489 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:58.206457    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:58.206924 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:58.206505    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:58.218960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:58.218932    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:33:58.853335 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:33:58.853302    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:34:30.247699 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:30.247665    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:34:43.059643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:43.059611    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"]
Jul 02 19:34:48.284983 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:48.284946    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:34:58.080088 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.080035    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl" podUID="941b37e6-7576-4f2e-ba21-9612f228a893" containerName="main" containerID="cri-o://29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5" gracePeriod=45
Jul 02 19:34:58.328012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.327985    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:34:58.425269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425171    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-dshm\") pod \"941b37e6-7576-4f2e-ba21-9612f228a893\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") "
Jul 02 19:34:58.425269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425227    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-home\") pod \"941b37e6-7576-4f2e-ba21-9612f228a893\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") "
Jul 02 19:34:58.425269 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425249    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/941b37e6-7576-4f2e-ba21-9612f228a893-tls-certs\") pod \"941b37e6-7576-4f2e-ba21-9612f228a893\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") "
Jul 02 19:34:58.425567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425283    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-tmp-dir\") pod \"941b37e6-7576-4f2e-ba21-9612f228a893\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") "
Jul 02 19:34:58.425567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425305    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7tnc\" (UniqueName: \"kubernetes.io/projected/941b37e6-7576-4f2e-ba21-9612f228a893-kube-api-access-n7tnc\") pod \"941b37e6-7576-4f2e-ba21-9612f228a893\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") "
Jul 02 19:34:58.425567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425338    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-model-cache\") pod \"941b37e6-7576-4f2e-ba21-9612f228a893\" (UID: \"941b37e6-7576-4f2e-ba21-9612f228a893\") "
Jul 02 19:34:58.425705 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425560    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-home" (OuterVolumeSpecName: "home") pod "941b37e6-7576-4f2e-ba21-9612f228a893" (UID: "941b37e6-7576-4f2e-ba21-9612f228a893"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:58.425705 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425611    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "941b37e6-7576-4f2e-ba21-9612f228a893" (UID: "941b37e6-7576-4f2e-ba21-9612f228a893"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:58.425705 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425636    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-model-cache" (OuterVolumeSpecName: "model-cache") pod "941b37e6-7576-4f2e-ba21-9612f228a893" (UID: "941b37e6-7576-4f2e-ba21-9612f228a893"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:58.425857 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425838    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-model-cache\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:34:58.425920 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425861    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-home\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:34:58.425920 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.425874    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-tmp-dir\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:34:58.427529 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.427509    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-dshm" (OuterVolumeSpecName: "dshm") pod "941b37e6-7576-4f2e-ba21-9612f228a893" (UID: "941b37e6-7576-4f2e-ba21-9612f228a893"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:58.427613 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.427577    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941b37e6-7576-4f2e-ba21-9612f228a893-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "941b37e6-7576-4f2e-ba21-9612f228a893" (UID: "941b37e6-7576-4f2e-ba21-9612f228a893"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:34:58.427696 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.427679    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941b37e6-7576-4f2e-ba21-9612f228a893-kube-api-access-n7tnc" (OuterVolumeSpecName: "kube-api-access-n7tnc") pod "941b37e6-7576-4f2e-ba21-9612f228a893" (UID: "941b37e6-7576-4f2e-ba21-9612f228a893"). InnerVolumeSpecName "kube-api-access-n7tnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:34:58.527048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.527016    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/941b37e6-7576-4f2e-ba21-9612f228a893-dshm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:34:58.527048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.527045    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/941b37e6-7576-4f2e-ba21-9612f228a893-tls-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:34:58.527048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:58.527056    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7tnc\" (UniqueName: \"kubernetes.io/projected/941b37e6-7576-4f2e-ba21-9612f228a893-kube-api-access-n7tnc\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:34:59.134792 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.134750    2572 generic.go:356] "Generic (PLEG): container finished" podID="941b37e6-7576-4f2e-ba21-9612f228a893" containerID="29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5" exitCode=0
Jul 02 19:34:59.135316 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.134792    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"
Jul 02 19:34:59.135316 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.134794    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl" event={"ID":"941b37e6-7576-4f2e-ba21-9612f228a893","Type":"ContainerDied","Data":"29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5"}
Jul 02 19:34:59.135316 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.134888    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl" event={"ID":"941b37e6-7576-4f2e-ba21-9612f228a893","Type":"ContainerDied","Data":"2bf1164158301d0017255db3226477e727acb4c779afae009d643b062679a9ff"}
Jul 02 19:34:59.135316 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.134912    2572 scope.go:117] "RemoveContainer" containerID="29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5"
Jul 02 19:34:59.147168 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.147143    2572 scope.go:117] "RemoveContainer" containerID="29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5"
Jul 02 19:34:59.147525 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:34:59.147431    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5\": container with ID starting with 29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5 not found: ID does not exist" containerID="29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5"
Jul 02 19:34:59.147525 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.147467    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5"} err="failed to get container status \"29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5\": rpc error: code = NotFound desc = could not find container \"29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5\": container with ID starting with 29497293a8795b66ba7ea51a7896cf41c5af6ce8eaf85f28f9959fbdeeb4d3b5 not found: ID does not exist"
Jul 02 19:34:59.160991 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.160952    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"]
Jul 02 19:34:59.163666 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:34:59.163640    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1980a2/test-model-1980a2-kserve-85459fc6c-5cttl"]
Jul 02 19:35:00.162410 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:00.162377    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="941b37e6-7576-4f2e-ba21-9612f228a893" path="/var/lib/kubelet/pods/941b37e6-7576-4f2e-ba21-9612f228a893/volumes"
Jul 02 19:35:26.997245 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:26.997211    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"]
Jul 02 19:35:26.997669 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:26.997459    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" containerID="cri-o://4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d" gracePeriod=30
Jul 02 19:35:27.811431 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:27.811393    2572 patch_prober.go:28] interesting pod/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:35:27.811594 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:27.811464    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:35:30.184606 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:30.184572    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:35:32.248471 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.248448    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:35:32.291167 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.291101    2572 generic.go:356] "Generic (PLEG): container finished" podID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerID="4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d" exitCode=0
Jul 02 19:35:32.291167 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.291142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" event={"ID":"90a2a180-c479-4f3f-bcec-f7edd830eb35","Type":"ContainerDied","Data":"4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d"}
Jul 02 19:35:32.291367 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.291178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"
Jul 02 19:35:32.291367 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.291195    2572 scope.go:117] "RemoveContainer" containerID="4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d"
Jul 02 19:35:32.291367 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.291182    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz" event={"ID":"90a2a180-c479-4f3f-bcec-f7edd830eb35","Type":"ContainerDied","Data":"7100f9233a37b4082894016da4a2278f353caa21ff06abcf1332070d2e91f45f"}
Jul 02 19:35:32.300145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.300126    2572 scope.go:117] "RemoveContainer" containerID="e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"
Jul 02 19:35:32.308059 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.308043    2572 scope.go:117] "RemoveContainer" containerID="4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d"
Jul 02 19:35:32.308296 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:35:32.308277    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d\": container with ID starting with 4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d not found: ID does not exist" containerID="4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d"
Jul 02 19:35:32.308344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.308312    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d"} err="failed to get container status \"4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d\": rpc error: code = NotFound desc = could not find container \"4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d\": container with ID starting with 4fa12802161c8b44041ed9e527e71ad0a77ae29ec9e93344a6dbfa9869d9690d not found: ID does not exist"
Jul 02 19:35:32.308344 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.308331    2572 scope.go:117] "RemoveContainer" containerID="e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"
Jul 02 19:35:32.308510 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:35:32.308493    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88\": container with ID starting with e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88 not found: ID does not exist" containerID="e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"
Jul 02 19:35:32.308564 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.308517    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88"} err="failed to get container status \"e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88\": rpc error: code = NotFound desc = could not find container \"e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88\": container with ID starting with e1eec5255788a6510a959710630e71e39db660f48885d2bb94d1bdb9def9de88 not found: ID does not exist"
Jul 02 19:35:32.326971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.326941    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-token\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327077 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327015    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-certs\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327077 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327067    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-data\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327106    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a2a180-c479-4f3f-bcec-f7edd830eb35-istiod-ca-cert\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327147    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-socket\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327182    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-podinfo\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327351 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327231    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-envoy\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327351 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327254    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-credential-socket\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327351 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327303    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tfzz\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-kube-api-access-7tfzz\") pod \"90a2a180-c479-4f3f-bcec-f7edd830eb35\" (UID: \"90a2a180-c479-4f3f-bcec-f7edd830eb35\") "
Jul 02 19:35:32.327510 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327384    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:32.327895 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327639    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.327895 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327856    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:32.328085 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.327987    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:32.328219 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.328163    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90a2a180-c479-4f3f-bcec-f7edd830eb35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:35:32.328310 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.328289    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-data" (OuterVolumeSpecName: "istio-data") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:32.329546 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.329512    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-token" (OuterVolumeSpecName: "istio-token") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:35:32.329857 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.329832    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-kube-api-access-7tfzz" (OuterVolumeSpecName: "kube-api-access-7tfzz") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "kube-api-access-7tfzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:35:32.329857 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.329841    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:32.330106 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.330069    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90a2a180-c479-4f3f-bcec-f7edd830eb35" (UID: "90a2a180-c479-4f3f-bcec-f7edd830eb35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:35:32.428485 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428451    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428485 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428478    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428485 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428487    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428485 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428496    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tfzz\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-kube-api-access-7tfzz\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428879 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428505    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428879 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428513    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428879 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428521    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a2a180-c479-4f3f-bcec-f7edd830eb35-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.428879 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.428529    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a2a180-c479-4f3f-bcec-f7edd830eb35-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:32.613388 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.613358    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"]
Jul 02 19:35:32.618232 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:32.618208    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1980a2-openshift-default-6b5cbf8899-rzsbz"]
Jul 02 19:35:34.162061 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:34.162021    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" path="/var/lib/kubelet/pods/90a2a180-c479-4f3f-bcec-f7edd830eb35/volumes"
Jul 02 19:35:34.289357 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:34.289327    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"]
Jul 02 19:35:34.289565 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:34.289538    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" containerID="cri-o://0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f" gracePeriod=30
Jul 02 19:35:35.174454 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174415    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"]
Jul 02 19:35:35.174960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174755    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy"
Jul 02 19:35:35.174960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174766    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy"
Jul 02 19:35:35.174960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174775    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941b37e6-7576-4f2e-ba21-9612f228a893" containerName="main"
Jul 02 19:35:35.174960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174781    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="941b37e6-7576-4f2e-ba21-9612f228a893" containerName="main"
Jul 02 19:35:35.174960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174874    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy"
Jul 02 19:35:35.174960 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.174886    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="941b37e6-7576-4f2e-ba21-9612f228a893" containerName="main"
Jul 02 19:35:35.177782 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.177754    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.180778 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.180757    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-55a636-openshift-default-dockercfg-vvk5p\""
Jul 02 19:35:35.190555 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.190526    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"]
Jul 02 19:35:35.253427 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-istio-token\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253427 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-certs\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-envoy\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-credential-socket\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mw7z\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-kube-api-access-7mw7z\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67f2f282-991a-4993-8876-40781dbdc3d8-istio-podinfo\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253661 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253623    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-socket\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253659    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-data\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.253869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.253705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67f2f282-991a-4993-8876-40781dbdc3d8-istiod-ca-cert\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355083 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-istio-token\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355083 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-certs\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-envoy\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-credential-socket\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mw7z\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-kube-api-access-7mw7z\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67f2f282-991a-4993-8876-40781dbdc3d8-istio-podinfo\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355538 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-socket\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355538 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355402    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-data\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355538 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67f2f282-991a-4993-8876-40781dbdc3d8-istiod-ca-cert\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355699 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355585    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-credential-socket\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355699 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355622    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-certs\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355772    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-data\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.355844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.355776    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-socket\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.356144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.356124    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67f2f282-991a-4993-8876-40781dbdc3d8-istiod-ca-cert\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.357280 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.357254    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-envoy\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.357550 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.357533    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67f2f282-991a-4993-8876-40781dbdc3d8-istio-podinfo\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.363231 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.363203    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-istio-token\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.363340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.363326    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mw7z\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-kube-api-access-7mw7z\") pod \"e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") " pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.489973 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.489939    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:35.627653 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.627625    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"]
Jul 02 19:35:35.629512 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:35:35.629486    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f2f282_991a_4993_8876_40781dbdc3d8.slice/crio-5635953f42b7a60c4af1c97a815c1e4a4e0ca39adff8f255f408bd643b174690 WatchSource:0}: Error finding container 5635953f42b7a60c4af1c97a815c1e4a4e0ca39adff8f255f408bd643b174690: Status 404 returned error can't find the container with id 5635953f42b7a60c4af1c97a815c1e4a4e0ca39adff8f255f408bd643b174690
Jul 02 19:35:35.632030 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.631999    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:35.632109 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.632072    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:35.632109 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:35.632102    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:36.134420 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.134381    2572 patch_prober.go:28] interesting pod/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:35:36.134569 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.134447    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:35:36.313720 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.313686    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" event={"ID":"67f2f282-991a-4993-8876-40781dbdc3d8","Type":"ContainerStarted","Data":"311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"}
Jul 02 19:35:36.314126 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.313742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" event={"ID":"67f2f282-991a-4993-8876-40781dbdc3d8","Type":"ContainerStarted","Data":"5635953f42b7a60c4af1c97a815c1e4a4e0ca39adff8f255f408bd643b174690"}
Jul 02 19:35:36.490486 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.490456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:36.495075 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.495052    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:36.521959 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:36.521917    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podStartSLOduration=1.5219022930000001 podStartE2EDuration="1.521902293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:36.334358233 +0000 UTC m=+2000.706112954" watchObservedRunningTime="2026-07-02 19:35:36.521902293 +0000 UTC m=+2000.893657013"
Jul 02 19:35:37.318877 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:37.318851    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:37.319740 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:37.319720    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:39.544168 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.544145    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:35:39.601735 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601635    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-socket\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.601735 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601698    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhtw7\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-kube-api-access-lhtw7\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.601992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601792    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-credential-socket\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.601992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601847    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-token\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.601992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601879    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-envoy\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.601992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601910    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:39.601992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601945    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d14b1b41-c496-4c93-8620-3e6e04139acb-istiod-ca-cert\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.601992 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.601976    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-podinfo\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.602310 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602015    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-data\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.602310 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602033    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-certs\") pod \"d14b1b41-c496-4c93-8620-3e6e04139acb\" (UID: \"d14b1b41-c496-4c93-8620-3e6e04139acb\") "
Jul 02 19:35:39.602310 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602290    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:39.602631 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602611    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.602717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602638    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.602717 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602670    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:39.602878 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.602853    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d14b1b41-c496-4c93-8620-3e6e04139acb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:35:39.603595 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.603575    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-data" (OuterVolumeSpecName: "istio-data") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:39.604388 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.604369    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-token" (OuterVolumeSpecName: "istio-token") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:35:39.604482 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.604456    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:35:39.604482 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.604463    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-kube-api-access-lhtw7" (OuterVolumeSpecName: "kube-api-access-lhtw7") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "kube-api-access-lhtw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:35:39.604674 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.604652    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d14b1b41-c496-4c93-8620-3e6e04139acb" (UID: "d14b1b41-c496-4c93-8620-3e6e04139acb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:35:39.704082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704040    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.704082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704071    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d14b1b41-c496-4c93-8620-3e6e04139acb-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.704082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704080    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.704082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704090    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.704348 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704099    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhtw7\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-kube-api-access-lhtw7\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.704348 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704108    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d14b1b41-c496-4c93-8620-3e6e04139acb-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:39.704348 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:39.704115    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d14b1b41-c496-4c93-8620-3e6e04139acb-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:35:40.337264 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.337227    2572 generic.go:356] "Generic (PLEG): container finished" podID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerID="0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f" exitCode=0
Jul 02 19:35:40.337458 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.337299    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"
Jul 02 19:35:40.337458 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.337305    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" event={"ID":"d14b1b41-c496-4c93-8620-3e6e04139acb","Type":"ContainerDied","Data":"0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f"}
Jul 02 19:35:40.337458 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.337360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs" event={"ID":"d14b1b41-c496-4c93-8620-3e6e04139acb","Type":"ContainerDied","Data":"f5b81df3486fdbf9a06580fe0afbb2df9c85ca301679c107bbeff6532ba7ad71"}
Jul 02 19:35:40.337458 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.337381    2572 scope.go:117] "RemoveContainer" containerID="0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f"
Jul 02 19:35:40.346159 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.346142    2572 scope.go:117] "RemoveContainer" containerID="bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"
Jul 02 19:35:40.354154 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.354124    2572 scope.go:117] "RemoveContainer" containerID="0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f"
Jul 02 19:35:40.354433 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:35:40.354414    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f\": container with ID starting with 0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f not found: ID does not exist" containerID="0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f"
Jul 02 19:35:40.354473 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.354442    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f"} err="failed to get container status \"0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f\": rpc error: code = NotFound desc = could not find container \"0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f\": container with ID starting with 0f66cd62e125ed97edca4aca03e531ed5f18a251702bd02afacec170b15cf19f not found: ID does not exist"
Jul 02 19:35:40.354473 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.354458    2572 scope.go:117] "RemoveContainer" containerID="bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"
Jul 02 19:35:40.354678 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:35:40.354663    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce\": container with ID starting with bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce not found: ID does not exist" containerID="bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"
Jul 02 19:35:40.354739 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.354681    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce"} err="failed to get container status \"bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce\": rpc error: code = NotFound desc = could not find container \"bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce\": container with ID starting with bb4ee9229a18fd9e974196c0ae8de5f8fabf8ccee3c78c8e1961f42d8ac12fce not found: ID does not exist"
Jul 02 19:35:40.355692 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.355675    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"]
Jul 02 19:35:40.361100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:40.361079    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-85423d-openshift-default-7476f5f6c5-d5pqs"]
Jul 02 19:35:42.161491 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:42.161453    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" path="/var/lib/kubelet/pods/d14b1b41-c496-4c93-8620-3e6e04139acb/volumes"
Jul 02 19:35:43.601385 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.601353    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"]
Jul 02 19:35:43.601907 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.601888    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy"
Jul 02 19:35:43.601991 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.601910    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy"
Jul 02 19:35:43.601991 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.601928    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy"
Jul 02 19:35:43.601991 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.601936    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy"
Jul 02 19:35:43.602153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.602047    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a2a180-c479-4f3f-bcec-f7edd830eb35" containerName="istio-proxy"
Jul 02 19:35:43.602153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.602065    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy"
Jul 02 19:35:43.602153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.602075    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy"
Jul 02 19:35:43.606556 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.606537    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.609012 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.608995    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a3b3e6-openshift-default-dockercfg-dz6zb\""
Jul 02 19:35:43.617910 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.617887    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"]
Jul 02 19:35:43.739139 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-envoy\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739331 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739164    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-credential-socket\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739331 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739193    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-token\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739331 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-data\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-socket\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4kxz\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-kube-api-access-l4kxz\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739393    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-certs\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739418    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-podinfo\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.739614 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.739471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a87cce-951f-4d7e-9896-af3d1609c1a6-istiod-ca-cert\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-podinfo\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a87cce-951f-4d7e-9896-af3d1609c1a6-istiod-ca-cert\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840685 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840564    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-envoy\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840685 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-credential-socket\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840685 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-token\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840870 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-data\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840870 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-socket\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840870 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4kxz\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-kube-api-access-l4kxz\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.840870 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.840859    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-certs\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.841287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.841237    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-socket\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.841287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.841271    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a87cce-951f-4d7e-9896-af3d1609c1a6-istiod-ca-cert\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.841488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.841296    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-certs\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.841488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.841274    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-data\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.841488 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.841329    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-credential-socket\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.843061 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.843040    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-envoy\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.843152 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.843108    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-podinfo\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.848474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.848454    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-token\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.848715 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.848698    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4kxz\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-kube-api-access-l4kxz\") pod \"e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") " pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.917869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.917776    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:43.994572 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:43.994539    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:35:44.061525 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.061496    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"]
Jul 02 19:35:44.063308 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:35:44.063280    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a87cce_951f_4d7e_9896_af3d1609c1a6.slice/crio-d8923ce2f2c80275d24a305e37250e2974256ec451404637e1181d56be2be9d1 WatchSource:0}: Error finding container d8923ce2f2c80275d24a305e37250e2974256ec451404637e1181d56be2be9d1: Status 404 returned error can't find the container with id d8923ce2f2c80275d24a305e37250e2974256ec451404637e1181d56be2be9d1
Jul 02 19:35:44.065516 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.065479    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:44.065594 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.065540    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:44.065594 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.065569    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:44.361152 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.361119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" event={"ID":"63a87cce-951f-4d7e-9896-af3d1609c1a6","Type":"ContainerStarted","Data":"c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf"}
Jul 02 19:35:44.361347 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.361169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" event={"ID":"63a87cce-951f-4d7e-9896-af3d1609c1a6","Type":"ContainerStarted","Data":"d8923ce2f2c80275d24a305e37250e2974256ec451404637e1181d56be2be9d1"}
Jul 02 19:35:44.380763 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.380718    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" podStartSLOduration=1.380703268 podStartE2EDuration="1.380703268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:44.378895217 +0000 UTC m=+2008.750649939" watchObservedRunningTime="2026-07-02 19:35:44.380703268 +0000 UTC m=+2008.752457989"
Jul 02 19:35:44.918727 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:44.918679    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:45.923285 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:45.923251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:46.371089 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:46.371055    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:46.372091 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:46.372073    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:35:52.320963 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.320919    2572 patch_prober.go:28] interesting pod/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 02 19:35:52.321451 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.320984    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 02 19:35:52.402202 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.402171    2572 generic.go:356] "Generic (PLEG): container finished" podID="67f2f282-991a-4993-8876-40781dbdc3d8" containerID="311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426" exitCode=0
Jul 02 19:35:52.402370 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.402249    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" event={"ID":"67f2f282-991a-4993-8876-40781dbdc3d8","Type":"ContainerDied","Data":"311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"}
Jul 02 19:35:52.402665 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.402651    2572 scope.go:117] "RemoveContainer" containerID="311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"
Jul 02 19:35:52.403817 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.403777    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:52.403878 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.403861    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:52.403915 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:52.403895    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:53.409109 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:53.409070    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" event={"ID":"67f2f282-991a-4993-8876-40781dbdc3d8","Type":"ContainerStarted","Data":"3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4"}
Jul 02 19:35:53.490356 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:53.490312    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:53.490566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:53.490536    2572 patch_prober.go:28] interesting pod/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 02 19:35:53.490643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:53.490599    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 02 19:35:54.491209 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:54.491169    2572 patch_prober.go:28] interesting pod/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 02 19:35:54.491641 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:54.491224    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 02 19:35:55.490507 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:55.490468    2572 patch_prober.go:28] interesting pod/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 02 19:35:55.490712 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:55.490546    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 02 19:35:56.490677 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:56.490643    2572 patch_prober.go:28] interesting pod/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 02 19:35:56.491072 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:56.490697    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 02 19:35:57.496385 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:57.496340    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:57.496890 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:57.496679    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:57.497463 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:57.497444    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:35:59.442006 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:59.441975    2572 generic.go:356] "Generic (PLEG): container finished" podID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerID="c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf" exitCode=0
Jul 02 19:35:59.442396 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:59.442044    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" event={"ID":"63a87cce-951f-4d7e-9896-af3d1609c1a6","Type":"ContainerDied","Data":"c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf"}
Jul 02 19:35:59.442535 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:59.442522    2572 scope.go:117] "RemoveContainer" containerID="c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf"
Jul 02 19:35:59.443470 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:59.443446    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:59.443521 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:59.443508    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:35:59.443564 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:35:59.443551    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:00.452933 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:00.452892    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" event={"ID":"63a87cce-951f-4d7e-9896-af3d1609c1a6","Type":"ContainerStarted","Data":"783f5e63c8522ab045556d5dda3b06aa3347a696846c501c68b2da29450c3cf4"}
Jul 02 19:36:00.918133 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:00.918095    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:36:00.919430 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:00.919402    2572 patch_prober.go:28] interesting pod/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:36:00.919546 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:00.919452    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:36:01.371031 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:01.370982    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:36:01.791273 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:01.791240    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:36:01.918941 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:01.918905    2572 patch_prober.go:28] interesting pod/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:36:01.919117 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:01.918961    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:36:02.919077 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:02.919035    2572 patch_prober.go:28] interesting pod/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:36:02.919466 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:02.919099    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:36:03.918395 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:03.918354    2572 patch_prober.go:28] interesting pod/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:36:03.918566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:03.918446    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:36:04.921915 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:04.921885    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:36:04.922897 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:04.922877    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:36:05.783440 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:05.783411    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"]
Jul 02 19:36:05.783648 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:05.783621    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy" containerID="cri-o://3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4" gracePeriod=30
Jul 02 19:36:11.048906 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.048838    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:36:11.088977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.088940    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-envoy\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.088977 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.088988    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mw7z\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-kube-api-access-7mw7z\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089215 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089011    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67f2f282-991a-4993-8876-40781dbdc3d8-istio-podinfo\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089215 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089094    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-socket\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089215 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089115    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-credential-socket\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089215 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089131    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-data\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089215 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089155    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67f2f282-991a-4993-8876-40781dbdc3d8-istiod-ca-cert\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089215 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089186    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-certs\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089528 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089221    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-istio-token\") pod \"67f2f282-991a-4993-8876-40781dbdc3d8\" (UID: \"67f2f282-991a-4993-8876-40781dbdc3d8\") "
Jul 02 19:36:11.089528 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089407    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:11.089643 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089559    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.089782 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089720    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:11.089782 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.089744    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:11.090151 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.090118    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f2f282-991a-4993-8876-40781dbdc3d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:36:11.090326 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.090304    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:11.091683 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.091655    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:11.091781 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.091717    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:11.091781 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.091747    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-kube-api-access-7mw7z" (OuterVolumeSpecName: "kube-api-access-7mw7z") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "kube-api-access-7mw7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:11.091917 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.091779    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67f2f282-991a-4993-8876-40781dbdc3d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67f2f282-991a-4993-8876-40781dbdc3d8" (UID: "67f2f282-991a-4993-8876-40781dbdc3d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:36:11.190693 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190653    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.190693 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190689    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mw7z\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-kube-api-access-7mw7z\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.191029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190704    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67f2f282-991a-4993-8876-40781dbdc3d8-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.191029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190718    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.191029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190729    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.191029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190743    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67f2f282-991a-4993-8876-40781dbdc3d8-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.191029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190774    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67f2f282-991a-4993-8876-40781dbdc3d8-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.191029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.190785    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67f2f282-991a-4993-8876-40781dbdc3d8-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:11.511148 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.511114    2572 generic.go:356] "Generic (PLEG): container finished" podID="67f2f282-991a-4993-8876-40781dbdc3d8" containerID="3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4" exitCode=0
Jul 02 19:36:11.511327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.511157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" event={"ID":"67f2f282-991a-4993-8876-40781dbdc3d8","Type":"ContainerDied","Data":"3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4"}
Jul 02 19:36:11.511327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.511163    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"
Jul 02 19:36:11.511327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.511199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9" event={"ID":"67f2f282-991a-4993-8876-40781dbdc3d8","Type":"ContainerDied","Data":"5635953f42b7a60c4af1c97a815c1e4a4e0ca39adff8f255f408bd643b174690"}
Jul 02 19:36:11.511327 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.511219    2572 scope.go:117] "RemoveContainer" containerID="3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4"
Jul 02 19:36:11.520299 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.520277    2572 scope.go:117] "RemoveContainer" containerID="311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"
Jul 02 19:36:11.528252 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.528231    2572 scope.go:117] "RemoveContainer" containerID="3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4"
Jul 02 19:36:11.528515 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:36:11.528491    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4\": container with ID starting with 3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4 not found: ID does not exist" containerID="3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4"
Jul 02 19:36:11.528602 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.528526    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4"} err="failed to get container status \"3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4\": rpc error: code = NotFound desc = could not find container \"3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4\": container with ID starting with 3cbb1f263b517328890d96791143c24d2df8d81e1c322e66b6c2d53369b6d9f4 not found: ID does not exist"
Jul 02 19:36:11.528602 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.528550    2572 scope.go:117] "RemoveContainer" containerID="311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"
Jul 02 19:36:11.528794 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:36:11.528772    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426\": container with ID starting with 311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426 not found: ID does not exist" containerID="311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"
Jul 02 19:36:11.528888 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.528822    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426"} err="failed to get container status \"311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426\": rpc error: code = NotFound desc = could not find container \"311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426\": container with ID starting with 311f06233f1c638ecc25b337ca9b5b189f797638db7c313d340a730affaa0426 not found: ID does not exist"
Jul 02 19:36:11.535374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.535350    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"]
Jul 02 19:36:11.539587 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:11.539567    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-55a636-openshift-default-84c84dd795-tw4g9"]
Jul 02 19:36:12.162779 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:12.162746    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" path="/var/lib/kubelet/pods/67f2f282-991a-4993-8876-40781dbdc3d8/volumes"
Jul 02 19:36:13.323876 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:13.323835    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"]
Jul 02 19:36:13.324423 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:13.324098    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy" containerID="cri-o://783f5e63c8522ab045556d5dda3b06aa3347a696846c501c68b2da29450c3cf4" gracePeriod=30
Jul 02 19:36:14.175515 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.175479    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"]
Jul 02 19:36:14.175956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.175934    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy"
Jul 02 19:36:14.175956 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.175951    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14b1b41-c496-4c93-8620-3e6e04139acb" containerName="istio-proxy"
Jul 02 19:36:14.176105 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.175961    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy"
Jul 02 19:36:14.176105 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.175966    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy"
Jul 02 19:36:14.176105 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.176023    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy"
Jul 02 19:36:14.180534 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.180511    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.183014 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.182996    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9629e8-openshift-default-dockercfg-br2b9\""
Jul 02 19:36:14.197021 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.196914    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"]
Jul 02 19:36:14.214166 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-envoy\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istiod-ca-cert\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214345 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-data\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214345 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlcp\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-kube-api-access-2vlcp\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214463 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-podinfo\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-socket\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214546    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-certs\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214670 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214595    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-token\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.214724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.214674    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-credential-socket\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316051 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-credential-socket\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316051 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316050    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-envoy\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316299 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istiod-ca-cert\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316299 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-data\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316299 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlcp\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-kube-api-access-2vlcp\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316299 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-podinfo\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316299 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316287    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-socket\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316319    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-certs\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-token\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316414    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-credential-socket\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316561 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316505    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-data\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316767 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316671    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-socket\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316836 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316822    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-certs\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.316985 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.316966    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istiod-ca-cert\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.318313 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.318288    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-envoy\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.318606 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.318588    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-podinfo\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.324071 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.324049    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-token\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.324646 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.324626    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlcp\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-kube-api-access-2vlcp\") pod \"e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") " pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.500305 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.500276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:14.660262 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.660229    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"]
Jul 02 19:36:14.660838 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:36:14.660797    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0467a0_2ab5_4f3e_840d_d1b96a3eb786.slice/crio-30b9bee92dee1a6ea0178addee3bfc20a625b4c185dff349469ffeb539b7a22f WatchSource:0}: Error finding container 30b9bee92dee1a6ea0178addee3bfc20a625b4c185dff349469ffeb539b7a22f: Status 404 returned error can't find the container with id 30b9bee92dee1a6ea0178addee3bfc20a625b4c185dff349469ffeb539b7a22f
Jul 02 19:36:14.663429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.663400    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:14.663518 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.663466    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:14.663518 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:14.663495    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:15.533599 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:15.533564    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" event={"ID":"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786","Type":"ContainerStarted","Data":"f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"}
Jul 02 19:36:15.534123 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:15.533619    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" event={"ID":"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786","Type":"ContainerStarted","Data":"30b9bee92dee1a6ea0178addee3bfc20a625b4c185dff349469ffeb539b7a22f"}
Jul 02 19:36:15.554321 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:15.554267    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podStartSLOduration=1.554251799 podStartE2EDuration="1.554251799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:36:15.553481141 +0000 UTC m=+2039.925235861" watchObservedRunningTime="2026-07-02 19:36:15.554251799 +0000 UTC m=+2039.926006518"
Jul 02 19:36:16.501386 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:16.501352    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:16.506590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:16.506567    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:16.538258 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:16.538235    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:16.539134 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:16.539111    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:17.099679 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:17.099642    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:36:18.551761 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.551729    2572 generic.go:356] "Generic (PLEG): container finished" podID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerID="783f5e63c8522ab045556d5dda3b06aa3347a696846c501c68b2da29450c3cf4" exitCode=0
Jul 02 19:36:18.552277 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.551828    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" event={"ID":"63a87cce-951f-4d7e-9896-af3d1609c1a6","Type":"ContainerDied","Data":"783f5e63c8522ab045556d5dda3b06aa3347a696846c501c68b2da29450c3cf4"}
Jul 02 19:36:18.552277 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.551911    2572 scope.go:117] "RemoveContainer" containerID="c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf"
Jul 02 19:36:18.572578 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:36:18.572556    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf\": container with ID starting with c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf not found: ID does not exist" containerID="c20dddfe00bb8fb9a288822fa2d43c2fed80cb38b7fd5829c078337874c18ecf"
Jul 02 19:36:18.575916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.575899    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:36:18.657624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657534    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-data\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657579    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a87cce-951f-4d7e-9896-af3d1609c1a6-istiod-ca-cert\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657615    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-envoy\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657672    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-credential-socket\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657725    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-certs\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657748    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-podinfo\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657785    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4kxz\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-kube-api-access-l4kxz\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657835    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-socket\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.657927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657882    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-token\") pod \"63a87cce-951f-4d7e-9896-af3d1609c1a6\" (UID: \"63a87cce-951f-4d7e-9896-af3d1609c1a6\") "
Jul 02 19:36:18.658216 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.657996    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:18.658216 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658001    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a87cce-951f-4d7e-9896-af3d1609c1a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:36:18.658216 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658180    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:18.658479 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658443    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:18.658479 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658480    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.658681 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658497    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.658681 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658493    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:18.658681 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.658509    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a87cce-951f-4d7e-9896-af3d1609c1a6-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.660048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.660023    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:18.660242 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.660219    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:36:18.660242 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.660235    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:18.660338 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.660311    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-kube-api-access-l4kxz" (OuterVolumeSpecName: "kube-api-access-l4kxz") pod "63a87cce-951f-4d7e-9896-af3d1609c1a6" (UID: "63a87cce-951f-4d7e-9896-af3d1609c1a6"). InnerVolumeSpecName "kube-api-access-l4kxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:18.759434 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.759395    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.759434 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.759427    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.759434 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.759440    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a87cce-951f-4d7e-9896-af3d1609c1a6-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.759675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.759452    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.759675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.759464    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4kxz\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-kube-api-access-l4kxz\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:18.759675 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:18.759475    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a87cce-951f-4d7e-9896-af3d1609c1a6-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:36:19.557695 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:19.557667    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"
Jul 02 19:36:19.557695 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:19.557682    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl" event={"ID":"63a87cce-951f-4d7e-9896-af3d1609c1a6","Type":"ContainerDied","Data":"d8923ce2f2c80275d24a305e37250e2974256ec451404637e1181d56be2be9d1"}
Jul 02 19:36:19.558243 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:19.557737    2572 scope.go:117] "RemoveContainer" containerID="783f5e63c8522ab045556d5dda3b06aa3347a696846c501c68b2da29450c3cf4"
Jul 02 19:36:19.579186 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:19.579160    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"]
Jul 02 19:36:19.582944 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:19.582924    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a3b3e6-openshift-default-56546f8697-r2mxl"]
Jul 02 19:36:20.162140 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:20.162104    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" path="/var/lib/kubelet/pods/63a87cce-951f-4d7e-9896-af3d1609c1a6/volumes"
Jul 02 19:36:22.701581 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.701551    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"]
Jul 02 19:36:22.701989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.701914    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy"
Jul 02 19:36:22.701989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.701926    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy"
Jul 02 19:36:22.701989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.701944    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy"
Jul 02 19:36:22.701989 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.701949    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy"
Jul 02 19:36:22.702153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.702008    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="67f2f282-991a-4993-8876-40781dbdc3d8" containerName="istio-proxy"
Jul 02 19:36:22.702153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.702017    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy"
Jul 02 19:36:22.702153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.702025    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy"
Jul 02 19:36:22.705308 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.705290    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.707818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.707779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6500fd-openshift-default-dockercfg-bpgg9\""
Jul 02 19:36:22.718332 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.718307    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"]
Jul 02 19:36:22.797082 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istiod-ca-cert\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-credential-socket\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-socket\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-podinfo\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797282 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-data\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797504 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797317    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-envoy\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797504 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-certs\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797504 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-token\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.797504 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.797451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6kjw\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-kube-api-access-n6kjw\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.898931 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.898901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-certs\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899141 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.898941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-token\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899141 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.898963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6kjw\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-kube-api-access-n6kjw\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899141 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istiod-ca-cert\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899141 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-credential-socket\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-socket\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-podinfo\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-data\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-envoy\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899374 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899362    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-certs\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899441    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-socket\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899566 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899512    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-credential-socket\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899713 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899691    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-data\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.899861 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.899833    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istiod-ca-cert\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.901559 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.901539    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-envoy\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.901919 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.901887    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-podinfo\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.907339 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.907317    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-token\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:22.907505 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:22.907485    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6kjw\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-kube-api-access-n6kjw\") pod \"e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") " pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:23.015289 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.015249    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:23.165061 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.164999    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"]
Jul 02 19:36:23.168754 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:36:23.168720    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b4b6c0_a5f5_4ea5_ba27_0a65ffb2683d.slice/crio-31b11e323a3f29a903988ebc3de6d8e1da1cbcff1060f2753d55cd79e54bc30f WatchSource:0}: Error finding container 31b11e323a3f29a903988ebc3de6d8e1da1cbcff1060f2753d55cd79e54bc30f: Status 404 returned error can't find the container with id 31b11e323a3f29a903988ebc3de6d8e1da1cbcff1060f2753d55cd79e54bc30f
Jul 02 19:36:23.170900 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.170873    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:23.170972 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.170932    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:23.170972 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.170959    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:23.579108 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.579070    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" event={"ID":"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d","Type":"ContainerStarted","Data":"679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"}
Jul 02 19:36:23.579287 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.579126    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" event={"ID":"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d","Type":"ContainerStarted","Data":"31b11e323a3f29a903988ebc3de6d8e1da1cbcff1060f2753d55cd79e54bc30f"}
Jul 02 19:36:23.617037 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:23.616993    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podStartSLOduration=1.616976706 podStartE2EDuration="1.616976706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:36:23.616913515 +0000 UTC m=+2047.988668248" watchObservedRunningTime="2026-07-02 19:36:23.616976706 +0000 UTC m=+2047.988731428"
Jul 02 19:36:24.015444 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:24.015411    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:24.019871 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:24.019840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:24.585357 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:24.585324    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:24.586388 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:24.586368    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:29.691274 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:29.691241    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:36:31.540627 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.540582    2572 patch_prober.go:28] interesting pod/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:36:31.541238 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.540668    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:36:31.622935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.622898    2572 generic.go:356] "Generic (PLEG): container finished" podID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerID="f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794" exitCode=0
Jul 02 19:36:31.623117 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.622972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" event={"ID":"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786","Type":"ContainerDied","Data":"f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"}
Jul 02 19:36:31.623377 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.623362    2572 scope.go:117] "RemoveContainer" containerID="f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"
Jul 02 19:36:31.624343 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.624318    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:31.624398 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.624382    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:31.624437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:31.624412    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:32.632797 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.632751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" event={"ID":"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786","Type":"ContainerStarted","Data":"236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db"}
Jul 02 19:36:32.788670 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.788626    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"]
Jul 02 19:36:32.789246 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.789225    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy"
Jul 02 19:36:32.789311 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.789252    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a87cce-951f-4d7e-9896-af3d1609c1a6" containerName="istio-proxy"
Jul 02 19:36:32.792757 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.792737    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:32.798027 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.798004    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"openshift-service-ca.crt\""
Jul 02 19:36:32.798144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.798034    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"kube-root-ca.crt\""
Jul 02 19:36:32.798144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.798080    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"default-dockercfg-7bhmm\""
Jul 02 19:36:32.798144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.798088    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"auth-test-model-9629e8-kserve-self-signed-certs\""
Jul 02 19:36:32.802583 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.802559    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"]
Jul 02 19:36:32.905934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.905789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-home\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:32.905934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.905888    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-tmp-dir\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:32.905934 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.905923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2llq6\" (UniqueName: \"kubernetes.io/projected/08962bdc-1a9f-4e95-a786-eac00b887114-kube-api-access-2llq6\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:32.906165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.905952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08962bdc-1a9f-4e95-a786-eac00b887114-tls-certs\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:32.906165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.906003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-dshm\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:32.906165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:32.906018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-model-cache\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.006978 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.006944    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-home\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.006978 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.006979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-tmp-dir\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.006998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2llq6\" (UniqueName: \"kubernetes.io/projected/08962bdc-1a9f-4e95-a786-eac00b887114-kube-api-access-2llq6\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.007025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08962bdc-1a9f-4e95-a786-eac00b887114-tls-certs\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.007046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-dshm\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007191 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.007061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-model-cache\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007324 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.007296    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-home\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007362 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.007345    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-model-cache\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.007758 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.007729    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-tmp-dir\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.009516 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.009500    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-dshm\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.010022 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.009993    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08962bdc-1a9f-4e95-a786-eac00b887114-tls-certs\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.017913 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.017889    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2llq6\" (UniqueName: \"kubernetes.io/projected/08962bdc-1a9f-4e95-a786-eac00b887114-kube-api-access-2llq6\") pod \"auth-test-model-9629e8-kserve-79599f7d47-8pbd2\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") " pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.102723 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.102688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:33.349949 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.349866    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"]
Jul 02 19:36:33.500552 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.500528    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:33.500904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.500882    2572 patch_prober.go:28] interesting pod/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:36:33.500966 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.500933    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:36:33.644772 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.644256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2" event={"ID":"08962bdc-1a9f-4e95-a786-eac00b887114","Type":"ContainerStarted","Data":"b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf"}
Jul 02 19:36:33.644772 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.644303    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2" event={"ID":"08962bdc-1a9f-4e95-a786-eac00b887114","Type":"ContainerStarted","Data":"afd9e47517abf94b911df2d3bb7404657a72d02dbe283474d39bc0b42a92f1e2"}
Jul 02 19:36:33.663068 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:33.663008    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2" podStartSLOduration=1.6629866519999998 podStartE2EDuration="1.662986652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:36:33.661585976 +0000 UTC m=+2058.033340693" watchObservedRunningTime="2026-07-02 19:36:33.662986652 +0000 UTC m=+2058.034741374"
Jul 02 19:36:34.501200 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:34.501166    2572 patch_prober.go:28] interesting pod/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:36:34.501369 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:34.501221    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:36:35.501166 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:35.501132    2572 patch_prober.go:28] interesting pod/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:36:35.501537 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:35.501186    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:36:36.505512 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:36.505481    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:36.506047 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:36.505840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:36.506761 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:36.506740    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:36:38.710156 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:38.710125    2572 generic.go:356] "Generic (PLEG): container finished" podID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerID="679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607" exitCode=0
Jul 02 19:36:38.710604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:38.710202    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" event={"ID":"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d","Type":"ContainerDied","Data":"679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"}
Jul 02 19:36:38.710604 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:38.710572    2572 scope.go:117] "RemoveContainer" containerID="679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"
Jul 02 19:36:38.711521 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:38.711497    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:38.711574 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:38.711561    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:38.711609 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:38.711590    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:36:39.585962 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:39.585931    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:39.719844 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:39.719783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" event={"ID":"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d","Type":"ContainerStarted","Data":"e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d"}
Jul 02 19:36:40.016321 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:40.016293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:40.017451 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:40.017428    2572 patch_prober.go:28] interesting pod/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:36:40.017558 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:40.017483    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:36:41.015874 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:41.015840    2572 patch_prober.go:28] interesting pod/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:36:41.016311 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:41.015890    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:36:42.016483 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:42.016444    2572 patch_prober.go:28] interesting pod/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:36:42.016909 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:42.016501    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:36:43.015952 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:43.015907    2572 patch_prober.go:28] interesting pod/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:36:43.016161 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:43.015968    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:36:43.103636 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:43.103602    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:43.104095 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:43.103652    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:43.116529 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:43.116507    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:43.756622 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:43.756594    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:36:44.019514 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:44.019442    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:44.019743 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:44.019691    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:44.020391 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:44.020375    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:36:45.197359 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:36:45.197325    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:37:16.253932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:37:16.253901    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:37:16.263930 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:37:16.263909    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:37:24.592376 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:37:24.592339    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:37:38.928023 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:37:38.927975    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:37:57.394603 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:37:57.394570    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:38:14.300725 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:38:14.300690    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:38:32.291863 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:38:32.291825    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:38:49.696178 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:38:49.696139    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:39:04.487670 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:04.487633    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:39:19.549683 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:19.549652    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"]
Jul 02 19:39:23.094665 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:23.094629    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:39:34.569655 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.569597    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2" podUID="08962bdc-1a9f-4e95-a786-eac00b887114" containerName="main" containerID="cri-o://b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf" gracePeriod=45
Jul 02 19:39:34.827476 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.827402    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:39:34.972508 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-home\") pod \"08962bdc-1a9f-4e95-a786-eac00b887114\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") "
Jul 02 19:39:34.972702 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972517    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2llq6\" (UniqueName: \"kubernetes.io/projected/08962bdc-1a9f-4e95-a786-eac00b887114-kube-api-access-2llq6\") pod \"08962bdc-1a9f-4e95-a786-eac00b887114\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") "
Jul 02 19:39:34.972702 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08962bdc-1a9f-4e95-a786-eac00b887114-tls-certs\") pod \"08962bdc-1a9f-4e95-a786-eac00b887114\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") "
Jul 02 19:39:34.972702 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972647    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-dshm\") pod \"08962bdc-1a9f-4e95-a786-eac00b887114\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") "
Jul 02 19:39:34.972702 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972679    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-tmp-dir\") pod \"08962bdc-1a9f-4e95-a786-eac00b887114\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") "
Jul 02 19:39:34.972976 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972732    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-model-cache\") pod \"08962bdc-1a9f-4e95-a786-eac00b887114\" (UID: \"08962bdc-1a9f-4e95-a786-eac00b887114\") "
Jul 02 19:39:34.972976 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972764    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-home" (OuterVolumeSpecName: "home") pod "08962bdc-1a9f-4e95-a786-eac00b887114" (UID: "08962bdc-1a9f-4e95-a786-eac00b887114"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:34.972976 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.972950    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08962bdc-1a9f-4e95-a786-eac00b887114" (UID: "08962bdc-1a9f-4e95-a786-eac00b887114"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:34.973142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.973025    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-model-cache" (OuterVolumeSpecName: "model-cache") pod "08962bdc-1a9f-4e95-a786-eac00b887114" (UID: "08962bdc-1a9f-4e95-a786-eac00b887114"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:34.973142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.973100    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-home\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:39:34.973142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.973114    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-tmp-dir\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:39:34.973142 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.973123    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-model-cache\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:39:34.974921 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.974893    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-dshm" (OuterVolumeSpecName: "dshm") pod "08962bdc-1a9f-4e95-a786-eac00b887114" (UID: "08962bdc-1a9f-4e95-a786-eac00b887114"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:34.975044 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.974988    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08962bdc-1a9f-4e95-a786-eac00b887114-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08962bdc-1a9f-4e95-a786-eac00b887114" (UID: "08962bdc-1a9f-4e95-a786-eac00b887114"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:39:34.975104 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:34.975045    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08962bdc-1a9f-4e95-a786-eac00b887114-kube-api-access-2llq6" (OuterVolumeSpecName: "kube-api-access-2llq6") pod "08962bdc-1a9f-4e95-a786-eac00b887114" (UID: "08962bdc-1a9f-4e95-a786-eac00b887114"). InnerVolumeSpecName "kube-api-access-2llq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:35.074217 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.074166    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08962bdc-1a9f-4e95-a786-eac00b887114-tls-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.074217 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.074211    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08962bdc-1a9f-4e95-a786-eac00b887114-dshm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.074217 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.074223    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2llq6\" (UniqueName: \"kubernetes.io/projected/08962bdc-1a9f-4e95-a786-eac00b887114-kube-api-access-2llq6\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.559895 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.559860    2572 generic.go:356] "Generic (PLEG): container finished" podID="08962bdc-1a9f-4e95-a786-eac00b887114" containerID="b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf" exitCode=0
Jul 02 19:39:35.560221 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.559902    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"
Jul 02 19:39:35.560221 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.559947    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2" event={"ID":"08962bdc-1a9f-4e95-a786-eac00b887114","Type":"ContainerDied","Data":"b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf"}
Jul 02 19:39:35.560221 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.560003    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2" event={"ID":"08962bdc-1a9f-4e95-a786-eac00b887114","Type":"ContainerDied","Data":"afd9e47517abf94b911df2d3bb7404657a72d02dbe283474d39bc0b42a92f1e2"}
Jul 02 19:39:35.560221 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.560027    2572 scope.go:117] "RemoveContainer" containerID="b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf"
Jul 02 19:39:35.572227 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.572033    2572 scope.go:117] "RemoveContainer" containerID="b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf"
Jul 02 19:39:35.572477 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:39:35.572299    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf\": container with ID starting with b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf not found: ID does not exist" containerID="b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf"
Jul 02 19:39:35.572477 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.572320    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf"} err="failed to get container status \"b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf\": rpc error: code = NotFound desc = could not find container \"b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf\": container with ID starting with b04204127dace90d275c2661d1b84c0d6abef99809350d0c5e4c4d6ffebacbaf not found: ID does not exist"
Jul 02 19:39:35.584125 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.584099    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"]
Jul 02 19:39:35.587772 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:35.587751    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/auth-test-model-9629e8-kserve-79599f7d47-8pbd2"]
Jul 02 19:39:36.162351 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:36.162318    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08962bdc-1a9f-4e95-a786-eac00b887114" path="/var/lib/kubelet/pods/08962bdc-1a9f-4e95-a786-eac00b887114/volumes"
Jul 02 19:39:37.691762 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.691728    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"]
Jul 02 19:39:37.692300 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.692281    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08962bdc-1a9f-4e95-a786-eac00b887114" containerName="main"
Jul 02 19:39:37.692398 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.692303    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08962bdc-1a9f-4e95-a786-eac00b887114" containerName="main"
Jul 02 19:39:37.692459 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.692439    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="08962bdc-1a9f-4e95-a786-eac00b887114" containerName="main"
Jul 02 19:39:37.697032 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.697009    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.699603 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.699582    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"openshift-service-ca.crt\""
Jul 02 19:39:37.699763 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.699582    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"sub-test-model-9629e8-kserve-self-signed-certs\""
Jul 02 19:39:37.700402 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.700382    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"kube-root-ca.crt\""
Jul 02 19:39:37.700733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.700523    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"default-dockercfg-7bhmm\""
Jul 02 19:39:37.702797 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.702771    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"]
Jul 02 19:39:37.800429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.800399    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e3b25f-32b0-46a1-be98-5f946427ebd9-tls-certs\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.800613 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.800440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-dshm\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.800613 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.800469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5t8g\" (UniqueName: \"kubernetes.io/projected/74e3b25f-32b0-46a1-be98-5f946427ebd9-kube-api-access-n5t8g\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.800613 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.800553    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-tmp-dir\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.800723 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.800619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-home\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.800723 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.800653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-model-cache\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.901491 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.901454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e3b25f-32b0-46a1-be98-5f946427ebd9-tls-certs\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.901491 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.901495    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-dshm\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.901733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.901512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5t8g\" (UniqueName: \"kubernetes.io/projected/74e3b25f-32b0-46a1-be98-5f946427ebd9-kube-api-access-n5t8g\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.901733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.901636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-tmp-dir\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.901733 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.901703    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-home\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.901952 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.901742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-model-cache\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.902092 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.902072    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-home\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.902158 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.902096    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-tmp-dir\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.902208 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.902152    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-model-cache\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.903852 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.903834    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-dshm\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.904115 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.904098    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e3b25f-32b0-46a1-be98-5f946427ebd9-tls-certs\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:37.909853 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:37.909799    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5t8g\" (UniqueName: \"kubernetes.io/projected/74e3b25f-32b0-46a1-be98-5f946427ebd9-kube-api-access-n5t8g\") pod \"sub-test-model-9629e8-kserve-868df778d9-2nnn2\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") " pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:38.007158 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:38.007110    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:38.149100 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:38.149074    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"]
Jul 02 19:39:38.150726 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:39:38.150687    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74e3b25f_32b0_46a1_be98_5f946427ebd9.slice/crio-5879ca0f3970600dda1c0d7a38e6f17951e30f2abbf62d1bb73b7ebb6c888332 WatchSource:0}: Error finding container 5879ca0f3970600dda1c0d7a38e6f17951e30f2abbf62d1bb73b7ebb6c888332: Status 404 returned error can't find the container with id 5879ca0f3970600dda1c0d7a38e6f17951e30f2abbf62d1bb73b7ebb6c888332
Jul 02 19:39:38.578124 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:38.578089    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2" event={"ID":"74e3b25f-32b0-46a1-be98-5f946427ebd9","Type":"ContainerStarted","Data":"701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064"}
Jul 02 19:39:38.578315 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:38.578142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2" event={"ID":"74e3b25f-32b0-46a1-be98-5f946427ebd9","Type":"ContainerStarted","Data":"5879ca0f3970600dda1c0d7a38e6f17951e30f2abbf62d1bb73b7ebb6c888332"}
Jul 02 19:39:38.635461 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:38.635405    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2" podStartSLOduration=1.6353895939999998 podStartE2EDuration="1.635389594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:38.633957187 +0000 UTC m=+2243.005711910" watchObservedRunningTime="2026-07-02 19:39:38.635389594 +0000 UTC m=+2243.007144317"
Jul 02 19:39:41.391091 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:41.391062    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:39:48.008011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:48.007956    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:48.008011 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:48.008022    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:48.020540 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:48.020510    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:39:48.634762 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:39:48.634733    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:40:07.188709 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:40:07.188671    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:40:22.294143 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:40:22.294081    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:40:38.582166 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:40:38.582126    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:40:45.056742 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:40:45.056707    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"]
Jul 02 19:40:58.885459 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:40:58.885421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:41:00.077464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.077423    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2" podUID="74e3b25f-32b0-46a1-be98-5f946427ebd9" containerName="main" containerID="cri-o://701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064" gracePeriod=45
Jul 02 19:41:00.325957 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.325933    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:41:00.445869 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.445780    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5t8g\" (UniqueName: \"kubernetes.io/projected/74e3b25f-32b0-46a1-be98-5f946427ebd9-kube-api-access-n5t8g\") pod \"74e3b25f-32b0-46a1-be98-5f946427ebd9\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") "
Jul 02 19:41:00.446028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.445877    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-home\") pod \"74e3b25f-32b0-46a1-be98-5f946427ebd9\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") "
Jul 02 19:41:00.446028 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.445984    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-model-cache\") pod \"74e3b25f-32b0-46a1-be98-5f946427ebd9\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") "
Jul 02 19:41:00.446145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446045    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-dshm\") pod \"74e3b25f-32b0-46a1-be98-5f946427ebd9\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") "
Jul 02 19:41:00.446145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446070    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-home" (OuterVolumeSpecName: "home") pod "74e3b25f-32b0-46a1-be98-5f946427ebd9" (UID: "74e3b25f-32b0-46a1-be98-5f946427ebd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:00.446145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446079    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e3b25f-32b0-46a1-be98-5f946427ebd9-tls-certs\") pod \"74e3b25f-32b0-46a1-be98-5f946427ebd9\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") "
Jul 02 19:41:00.446145 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446118    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-tmp-dir\") pod \"74e3b25f-32b0-46a1-be98-5f946427ebd9\" (UID: \"74e3b25f-32b0-46a1-be98-5f946427ebd9\") "
Jul 02 19:41:00.446346 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446222    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "74e3b25f-32b0-46a1-be98-5f946427ebd9" (UID: "74e3b25f-32b0-46a1-be98-5f946427ebd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:00.446444 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446419    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74e3b25f-32b0-46a1-be98-5f946427ebd9" (UID: "74e3b25f-32b0-46a1-be98-5f946427ebd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:00.446583 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446462    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-home\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:41:00.446583 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.446481    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-model-cache\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:41:00.448158 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.448138    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-dshm" (OuterVolumeSpecName: "dshm") pod "74e3b25f-32b0-46a1-be98-5f946427ebd9" (UID: "74e3b25f-32b0-46a1-be98-5f946427ebd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:00.448247 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.448209    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e3b25f-32b0-46a1-be98-5f946427ebd9-kube-api-access-n5t8g" (OuterVolumeSpecName: "kube-api-access-n5t8g") pod "74e3b25f-32b0-46a1-be98-5f946427ebd9" (UID: "74e3b25f-32b0-46a1-be98-5f946427ebd9"). InnerVolumeSpecName "kube-api-access-n5t8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:41:00.448286 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.448244    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e3b25f-32b0-46a1-be98-5f946427ebd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74e3b25f-32b0-46a1-be98-5f946427ebd9" (UID: "74e3b25f-32b0-46a1-be98-5f946427ebd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:41:00.546953 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.546921    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5t8g\" (UniqueName: \"kubernetes.io/projected/74e3b25f-32b0-46a1-be98-5f946427ebd9-kube-api-access-n5t8g\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:41:00.546953 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.546949    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-dshm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:41:00.546953 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.546958    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e3b25f-32b0-46a1-be98-5f946427ebd9-tls-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:41:00.547196 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.546968    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e3b25f-32b0-46a1-be98-5f946427ebd9-tmp-dir\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:41:00.979932 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.979895    2572 generic.go:356] "Generic (PLEG): container finished" podID="74e3b25f-32b0-46a1-be98-5f946427ebd9" containerID="701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064" exitCode=0
Jul 02 19:41:00.980111 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.979949    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"
Jul 02 19:41:00.980111 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.979960    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2" event={"ID":"74e3b25f-32b0-46a1-be98-5f946427ebd9","Type":"ContainerDied","Data":"701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064"}
Jul 02 19:41:00.980111 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.979991    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2" event={"ID":"74e3b25f-32b0-46a1-be98-5f946427ebd9","Type":"ContainerDied","Data":"5879ca0f3970600dda1c0d7a38e6f17951e30f2abbf62d1bb73b7ebb6c888332"}
Jul 02 19:41:00.980111 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.980007    2572 scope.go:117] "RemoveContainer" containerID="701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064"
Jul 02 19:41:00.996169 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.996149    2572 scope.go:117] "RemoveContainer" containerID="701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064"
Jul 02 19:41:00.996428 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:41:00.996409    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064\": container with ID starting with 701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064 not found: ID does not exist" containerID="701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064"
Jul 02 19:41:00.996495 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:00.996436    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064"} err="failed to get container status \"701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064\": rpc error: code = NotFound desc = could not find container \"701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064\": container with ID starting with 701ae7d2a1d61792e672211ba8b77c4d87f02e35f2dd746a432acd0a3c0fd064 not found: ID does not exist"
Jul 02 19:41:01.004148 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:01.004125    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"]
Jul 02 19:41:01.007341 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:01.007320    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/sub-test-model-9629e8-kserve-868df778d9-2nnn2"]
Jul 02 19:41:02.162268 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:02.162235    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e3b25f-32b0-46a1-be98-5f946427ebd9" path="/var/lib/kubelet/pods/74e3b25f-32b0-46a1-be98-5f946427ebd9/volumes"
Jul 02 19:41:13.296746 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.296715    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"]
Jul 02 19:41:13.297293 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.297258    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e3b25f-32b0-46a1-be98-5f946427ebd9" containerName="main"
Jul 02 19:41:13.297293 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.297274    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e3b25f-32b0-46a1-be98-5f946427ebd9" containerName="main"
Jul 02 19:41:13.297384 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.297372    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e3b25f-32b0-46a1-be98-5f946427ebd9" containerName="main"
Jul 02 19:41:13.300765 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.300726    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.304464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.304373    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"kube-root-ca.crt\""
Jul 02 19:41:13.304464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.304393    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"openshift-service-ca.crt\""
Jul 02 19:41:13.304464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.304375    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"rate-test-model-9629e8-kserve-self-signed-certs\""
Jul 02 19:41:13.304464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.304432    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9629e8\"/\"default-dockercfg-7bhmm\""
Jul 02 19:41:13.315562 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.315537    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"]
Jul 02 19:41:13.364520 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.364479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/737cd828-35f9-4c45-a646-98af6c34c41b-tls-certs\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.364724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.364525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7qsl\" (UniqueName: \"kubernetes.io/projected/737cd828-35f9-4c45-a646-98af6c34c41b-kube-api-access-z7qsl\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.364724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.364601    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-model-cache\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.364724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.364626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-home\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.364724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.364658    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-tmp-dir\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.364724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.364710    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-dshm\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466071 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/737cd828-35f9-4c45-a646-98af6c34c41b-tls-certs\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466071 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7qsl\" (UniqueName: \"kubernetes.io/projected/737cd828-35f9-4c45-a646-98af6c34c41b-kube-api-access-z7qsl\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466338 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466119    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-model-cache\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466338 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466135    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-home\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466338 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-tmp-dir\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466338 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466176    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-dshm\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466611 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466590    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-model-cache\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466678 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466639    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-home\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.466678 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.466660    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-tmp-dir\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.468424 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.468406    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-dshm\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.468590 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.468572    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/737cd828-35f9-4c45-a646-98af6c34c41b-tls-certs\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.477820 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.476399    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7qsl\" (UniqueName: \"kubernetes.io/projected/737cd828-35f9-4c45-a646-98af6c34c41b-kube-api-access-z7qsl\") pod \"rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") " pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.611117 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.611021    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:13.750624 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:13.750595    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"]
Jul 02 19:41:13.752918 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:41:13.752893    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod737cd828_35f9_4c45_a646_98af6c34c41b.slice/crio-471ebea2338b8df25998d8ae4df956971ac8d67c8316ecac3319392f42ada317 WatchSource:0}: Error finding container 471ebea2338b8df25998d8ae4df956971ac8d67c8316ecac3319392f42ada317: Status 404 returned error can't find the container with id 471ebea2338b8df25998d8ae4df956971ac8d67c8316ecac3319392f42ada317
Jul 02 19:41:14.047429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:14.047393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg" event={"ID":"737cd828-35f9-4c45-a646-98af6c34c41b","Type":"ContainerStarted","Data":"93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537"}
Jul 02 19:41:14.047429 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:14.047433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg" event={"ID":"737cd828-35f9-4c45-a646-98af6c34c41b","Type":"ContainerStarted","Data":"471ebea2338b8df25998d8ae4df956971ac8d67c8316ecac3319392f42ada317"}
Jul 02 19:41:14.068818 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:14.068758    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg" podStartSLOduration=1.068743377 podStartE2EDuration="1.068743377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:41:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:41:14.06764756 +0000 UTC m=+2338.439402282" watchObservedRunningTime="2026-07-02 19:41:14.068743377 +0000 UTC m=+2338.440498088"
Jul 02 19:41:17.088757 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:17.088723    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:41:23.611330 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:23.611289    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:23.611330 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:23.611334    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:23.623689 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:23.623662    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:24.107211 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:24.107176    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:41:53.788603 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:41:53.788562    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:42:09.083235 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:09.083196    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:42:16.284023 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:16.283994    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:42:16.294280 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:16.294255    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:42:30.192731 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:30.192696    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:42:34.622775 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:34.622741    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"]
Jul 02 19:42:41.087123 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:41.087038    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:42:49.643579 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:49.643532    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg" podUID="737cd828-35f9-4c45-a646-98af6c34c41b" containerName="main" containerID="cri-o://93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537" gracePeriod=45
Jul 02 19:42:49.898005 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:49.897938    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:42:50.087966 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.087936    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-dshm\") pod \"737cd828-35f9-4c45-a646-98af6c34c41b\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") "
Jul 02 19:42:50.088213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.087988    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/737cd828-35f9-4c45-a646-98af6c34c41b-tls-certs\") pod \"737cd828-35f9-4c45-a646-98af6c34c41b\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") "
Jul 02 19:42:50.088213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088019    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-model-cache\") pod \"737cd828-35f9-4c45-a646-98af6c34c41b\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") "
Jul 02 19:42:50.088213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088051    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-tmp-dir\") pod \"737cd828-35f9-4c45-a646-98af6c34c41b\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") "
Jul 02 19:42:50.088213 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088168    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7qsl\" (UniqueName: \"kubernetes.io/projected/737cd828-35f9-4c45-a646-98af6c34c41b-kube-api-access-z7qsl\") pod \"737cd828-35f9-4c45-a646-98af6c34c41b\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") "
Jul 02 19:42:50.088437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088224    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-home\") pod \"737cd828-35f9-4c45-a646-98af6c34c41b\" (UID: \"737cd828-35f9-4c45-a646-98af6c34c41b\") "
Jul 02 19:42:50.088437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088305    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "737cd828-35f9-4c45-a646-98af6c34c41b" (UID: "737cd828-35f9-4c45-a646-98af6c34c41b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:50.088437 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088317    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-model-cache" (OuterVolumeSpecName: "model-cache") pod "737cd828-35f9-4c45-a646-98af6c34c41b" (UID: "737cd828-35f9-4c45-a646-98af6c34c41b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:50.088593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088542    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-home" (OuterVolumeSpecName: "home") pod "737cd828-35f9-4c45-a646-98af6c34c41b" (UID: "737cd828-35f9-4c45-a646-98af6c34c41b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:50.088593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088550    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-model-cache\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:42:50.088593 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.088579    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-tmp-dir\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:42:50.090190 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.090162    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/737cd828-35f9-4c45-a646-98af6c34c41b-kube-api-access-z7qsl" (OuterVolumeSpecName: "kube-api-access-z7qsl") pod "737cd828-35f9-4c45-a646-98af6c34c41b" (UID: "737cd828-35f9-4c45-a646-98af6c34c41b"). InnerVolumeSpecName "kube-api-access-z7qsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:42:50.090259 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.090176    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-dshm" (OuterVolumeSpecName: "dshm") pod "737cd828-35f9-4c45-a646-98af6c34c41b" (UID: "737cd828-35f9-4c45-a646-98af6c34c41b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:50.090259 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.090219    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/737cd828-35f9-4c45-a646-98af6c34c41b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "737cd828-35f9-4c45-a646-98af6c34c41b" (UID: "737cd828-35f9-4c45-a646-98af6c34c41b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:42:50.190047 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.190016    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-home\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:42:50.190047 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.190042    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/737cd828-35f9-4c45-a646-98af6c34c41b-dshm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:42:50.190047 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.190049    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/737cd828-35f9-4c45-a646-98af6c34c41b-tls-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:42:50.190275 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.190060    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7qsl\" (UniqueName: \"kubernetes.io/projected/737cd828-35f9-4c45-a646-98af6c34c41b-kube-api-access-z7qsl\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:42:50.519703 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.519670    2572 generic.go:356] "Generic (PLEG): container finished" podID="737cd828-35f9-4c45-a646-98af6c34c41b" containerID="93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537" exitCode=0
Jul 02 19:42:50.519904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.519715    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"
Jul 02 19:42:50.519904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.519761    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg" event={"ID":"737cd828-35f9-4c45-a646-98af6c34c41b","Type":"ContainerDied","Data":"93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537"}
Jul 02 19:42:50.519904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.519832    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg" event={"ID":"737cd828-35f9-4c45-a646-98af6c34c41b","Type":"ContainerDied","Data":"471ebea2338b8df25998d8ae4df956971ac8d67c8316ecac3319392f42ada317"}
Jul 02 19:42:50.519904 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.519853    2572 scope.go:117] "RemoveContainer" containerID="93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537"
Jul 02 19:42:50.528487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.528466    2572 scope.go:117] "RemoveContainer" containerID="93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537"
Jul 02 19:42:50.528821 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:42:50.528770    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537\": container with ID starting with 93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537 not found: ID does not exist" containerID="93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537"
Jul 02 19:42:50.528935 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.528817    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537"} err="failed to get container status \"93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537\": rpc error: code = NotFound desc = could not find container \"93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537\": container with ID starting with 93321860a3c7e98e5631e00ea855cedd6a25c9c1174473961e6ed7b552aa4537 not found: ID does not exist"
Jul 02 19:42:50.543792 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.543761    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"]
Jul 02 19:42:50.546112 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:50.546089    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9629e8/rate-test-model-9629e8-kserve-c6cc84cd7-r4cgg"]
Jul 02 19:42:52.163048 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:42:52.163011    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="737cd828-35f9-4c45-a646-98af6c34c41b" path="/var/lib/kubelet/pods/737cd828-35f9-4c45-a646-98af6c34c41b/volumes"
Jul 02 19:43:02.427458 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:02.427426    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:43:05.161297 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:05.161259    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"]
Jul 02 19:43:05.161718 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:05.161468    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy" containerID="cri-o://236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db" gracePeriod=30
Jul 02 19:43:06.508722 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:06.508687    2572 patch_prober.go:28] interesting pod/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:43:06.509120 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:06.508756    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:43:10.425571 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.425505    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:43:10.472029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.471990    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vlcp\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-kube-api-access-2vlcp\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472029 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472031    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-data\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472052    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-envoy\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472116    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-token\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472152    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-credential-socket\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472178    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-podinfo\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472206    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-socket\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472258    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istiod-ca-cert\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472295 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472296    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-certs\") pod \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\" (UID: \"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786\") "
Jul 02 19:43:10.472680 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472479    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:10.472680 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472640    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.472792 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472714    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:10.472792 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472745    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:43:10.472942 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.472845    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:10.473090 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.473067    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:10.474411 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.474387    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-kube-api-access-2vlcp" (OuterVolumeSpecName: "kube-api-access-2vlcp") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "kube-api-access-2vlcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:43:10.474694 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.474664    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:43:10.474981 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.474960    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:10.475065 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.475014    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" (UID: "0e0467a0-2ab5-4f3e-840d-d1b96a3eb786"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:43:10.573441 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573396    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573441 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573436    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573441 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573445    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vlcp\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-kube-api-access-2vlcp\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573441 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573456    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573732 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573464    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573732 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573473    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573732 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573481    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.573732 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.573488    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:10.615743 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.615702    2572 generic.go:356] "Generic (PLEG): container finished" podID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerID="236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db" exitCode=0
Jul 02 19:43:10.615927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.615747    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" event={"ID":"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786","Type":"ContainerDied","Data":"236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db"}
Jul 02 19:43:10.615927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.615763    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"
Jul 02 19:43:10.615927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.615833    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j" event={"ID":"0e0467a0-2ab5-4f3e-840d-d1b96a3eb786","Type":"ContainerDied","Data":"30b9bee92dee1a6ea0178addee3bfc20a625b4c185dff349469ffeb539b7a22f"}
Jul 02 19:43:10.615927 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.615861    2572 scope.go:117] "RemoveContainer" containerID="236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db"
Jul 02 19:43:10.625313 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.625297    2572 scope.go:117] "RemoveContainer" containerID="f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"
Jul 02 19:43:10.635030 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.635007    2572 scope.go:117] "RemoveContainer" containerID="236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db"
Jul 02 19:43:10.635285 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:43:10.635261    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db\": container with ID starting with 236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db not found: ID does not exist" containerID="236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db"
Jul 02 19:43:10.635355 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.635293    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db"} err="failed to get container status \"236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db\": rpc error: code = NotFound desc = could not find container \"236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db\": container with ID starting with 236038d179d4b8d98319d9099c10e96086b921c921e92ead581889155e4d21db not found: ID does not exist"
Jul 02 19:43:10.635355 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.635310    2572 scope.go:117] "RemoveContainer" containerID="f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"
Jul 02 19:43:10.635580 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:43:10.635562    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794\": container with ID starting with f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794 not found: ID does not exist" containerID="f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"
Jul 02 19:43:10.635636 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.635591    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794"} err="failed to get container status \"f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794\": rpc error: code = NotFound desc = could not find container \"f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794\": container with ID starting with f2e02c4524884f19c1417446c77b53bac029b5cbad6f20d8e6a98a095e536794 not found: ID does not exist"
Jul 02 19:43:10.639310 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.639287    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"]
Jul 02 19:43:10.643230 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:10.643210    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9629e8-openshift-default-7dfb8cf599-l799j"]
Jul 02 19:43:12.163463 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:12.163428    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" path="/var/lib/kubelet/pods/0e0467a0-2ab5-4f3e-840d-d1b96a3eb786/volumes"
Jul 02 19:43:12.320151 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:12.320123    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"]
Jul 02 19:43:12.320350 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:12.320325    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy" containerID="cri-o://e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d" gracePeriod=30
Jul 02 19:43:14.022657 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:14.022618    2572 patch_prober.go:28] interesting pod/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:43:14.023076 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:14.022675    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:43:15.085851 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:15.085797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-knjk8"]
Jul 02 19:43:17.578823 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.578787    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:43:17.638001 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.637908    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-socket\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638001 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.637952    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-credential-socket\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638001 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.637973    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-podinfo\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638001 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.637990    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-data\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638020    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-envoy\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638061    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-certs\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638095    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-token\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istiod-ca-cert\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638177    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6kjw\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-kube-api-access-n6kjw\") pod \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\" (UID: \"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d\") "
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638250    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:17.638340 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638283    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:17.638683 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638452    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.638683 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638473    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-credential-socket\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.638683 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638529    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:17.638683 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.638611    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:43:17.639107 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.639077    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-data" (OuterVolumeSpecName: "istio-data") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:17.640368 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.640344    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:17.640446 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.640352    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-token" (OuterVolumeSpecName: "istio-token") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:43:17.640633 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.640610    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-kube-api-access-n6kjw" (OuterVolumeSpecName: "kube-api-access-n6kjw") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "kube-api-access-n6kjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:43:17.640633 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.640615    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" (UID: "31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:43:17.651165 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.651142    2572 generic.go:356] "Generic (PLEG): container finished" podID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerID="e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d" exitCode=0
Jul 02 19:43:17.651271 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.651188    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"
Jul 02 19:43:17.651271 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.651228    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" event={"ID":"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d","Type":"ContainerDied","Data":"e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d"}
Jul 02 19:43:17.651356 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.651294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g" event={"ID":"31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d","Type":"ContainerDied","Data":"31b11e323a3f29a903988ebc3de6d8e1da1cbcff1060f2753d55cd79e54bc30f"}
Jul 02 19:43:17.651356 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.651327    2572 scope.go:117] "RemoveContainer" containerID="e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d"
Jul 02 19:43:17.660886 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.660871    2572 scope.go:117] "RemoveContainer" containerID="679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"
Jul 02 19:43:17.668640 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.668624    2572 scope.go:117] "RemoveContainer" containerID="e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d"
Jul 02 19:43:17.668894 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:43:17.668876    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d\": container with ID starting with e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d not found: ID does not exist" containerID="e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d"
Jul 02 19:43:17.668962 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.668902    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d"} err="failed to get container status \"e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d\": rpc error: code = NotFound desc = could not find container \"e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d\": container with ID starting with e18ba12bf75d1c1177571df4f4d0cb2541649297d4f2455a692837cd0577700d not found: ID does not exist"
Jul 02 19:43:17.668962 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.668919    2572 scope.go:117] "RemoveContainer" containerID="679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"
Jul 02 19:43:17.669161 ip-10-0-135-32 kubenswrapper[2572]: E0702 19:43:17.669145    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607\": container with ID starting with 679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607 not found: ID does not exist" containerID="679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"
Jul 02 19:43:17.669198 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.669167    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607"} err="failed to get container status \"679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607\": rpc error: code = NotFound desc = could not find container \"679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607\": container with ID starting with 679133e2383f058ae289b6c1ea2e1019913ef3fe62aa6c72a2029825e2e2e607 not found: ID does not exist"
Jul 02 19:43:17.674153 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.674134    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"]
Jul 02 19:43:17.678636 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.678617    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6500fd-openshift-default-779dfbc7d7-7ks4g"]
Jul 02 19:43:17.739887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739855    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6kjw\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-kube-api-access-n6kjw\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.739887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739882    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-podinfo\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.739887 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739895    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-data\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.740110 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739904    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-envoy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.740110 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739913    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-workload-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.740110 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739920    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.740110 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.739928    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d-istiod-ca-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\""
Jul 02 19:43:17.949880 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:17.949795    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716995-trh7t_c8f87c78-8a70-409c-8d4e-aa9ba1025b7b/cleanup/0.log"
Jul 02 19:43:18.062546 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:18.062518    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717010-r9kxs_59c03ea4-3971-4673-ab41-9237bedf316a/cleanup/0.log"
Jul 02 19:43:18.162248 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:18.162216    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" path="/var/lib/kubelet/pods/31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d/volumes"
Jul 02 19:43:18.527243 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:18.527214    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd5847cc4-6hf84_36ce6334-3cef-4a1d-8c35-bd4e98419017/copy-manifests/0.log"
Jul 02 19:43:18.534474 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:18.534451    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd5847cc4-6hf84_36ce6334-3cef-4a1d-8c35-bd4e98419017/manager/0.log"
Jul 02 19:43:20.775487 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:20.775455    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mt2b6_cdfd2ce8-988c-4b90-b20a-06df800639b6/manager/0.log"
Jul 02 19:43:20.886251 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:20.886224    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-knjk8_7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5/limitador/0.log"
Jul 02 19:43:21.358214 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:21.358187    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf485mnr_a535b9c8-dc0a-49a9-8cf8-65462d007696/istio-proxy/0.log"
Jul 02 19:43:22.182089 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:22.182064    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5db59696f7-89w6b_d3692552-803f-4f43-9405-4f8cd39fc29a/router/0.log"
Jul 02 19:43:22.758966 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:22.758934    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-x54k6_7f949cbb-a58c-4df0-8d0e-6256d20f9436/main/0.log"
Jul 02 19:43:22.987790 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:22.987763    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gt4pk_74cee73c-7181-495c-bf71-2cfe9b38c328/main/0.log"
Jul 02 19:43:30.254710 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:30.254683    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jc67t_d1ef9e2e-6ff3-49fe-8d4d-72b495cafc19/global-pull-secret-syncer/0.log"
Jul 02 19:43:30.400355 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:30.400311    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cm8kq_c7ce4001-40cb-4c97-97a3-e59a793880c9/konnectivity-agent/0.log"
Jul 02 19:43:30.457407 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:30.457379    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-32.ec2.internal_691e52ad59e0d902715180e32ae604d0/haproxy/0.log"
Jul 02 19:43:35.960107 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:35.960069    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mt2b6_cdfd2ce8-988c-4b90-b20a-06df800639b6/manager/0.log"
Jul 02 19:43:35.992754 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:35.992718    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-knjk8_7ceb1c07-14fd-4afa-ae27-6d4e25d4f7e5/limitador/0.log"
Jul 02 19:43:37.947147 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:37.947120    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-vtqvj_f1cffd56-8726-47a1-9b35-51d2fa542c69/cluster-monitoring-operator/0.log"
Jul 02 19:43:38.197613 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:38.197539    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4n8j_0d129a21-a3b5-4c42-b05b-0b1c98fec73f/node-exporter/0.log"
Jul 02 19:43:38.219842 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:38.219815    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4n8j_0d129a21-a3b5-4c42-b05b-0b1c98fec73f/kube-rbac-proxy/0.log"
Jul 02 19:43:38.240498 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:38.240465    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4n8j_0d129a21-a3b5-4c42-b05b-0b1c98fec73f/init-textfile/0.log"
Jul 02 19:43:40.004315 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.004280    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-j2khf_7d3802f7-7635-420a-a1c1-d3b47cfdf88a/networking-console-plugin/0.log"
Jul 02 19:43:40.481997 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.481959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"]
Jul 02 19:43:40.482375 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482357    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737cd828-35f9-4c45-a646-98af6c34c41b" containerName="main"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482378    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="737cd828-35f9-4c45-a646-98af6c34c41b" containerName="main"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482423    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482431    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482445    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482453    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482461    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy"
Jul 02 19:43:40.482484 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482470    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy"
Jul 02 19:43:40.482860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482489    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy"
Jul 02 19:43:40.482860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482497    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy"
Jul 02 19:43:40.482860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482610    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e0467a0-2ab5-4f3e-840d-d1b96a3eb786" containerName="istio-proxy"
Jul 02 19:43:40.482860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482624    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b4b6c0-a5f5-4ea5-ba27-0a65ffb2683d" containerName="istio-proxy"
Jul 02 19:43:40.482860 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.482639    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="737cd828-35f9-4c45-a646-98af6c34c41b" containerName="main"
Jul 02 19:43:40.485903 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.485881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.488005 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.487980    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d52kh\"/\"kube-root-ca.crt\""
Jul 02 19:43:40.488797 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.488780    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d52kh\"/\"default-dockercfg-n4n8v\""
Jul 02 19:43:40.488876 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.488819    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d52kh\"/\"openshift-service-ca.crt\""
Jul 02 19:43:40.495366 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.495340    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"]
Jul 02 19:43:40.544933 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.544890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfftw\" (UniqueName: \"kubernetes.io/projected/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-kube-api-access-cfftw\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.545146 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.544947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-lib-modules\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.545146 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.545031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-sys\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.545146 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.545086    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-proc\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.545285 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.545146    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-podres\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.633129 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.633094    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/1.log"
Jul 02 19:43:40.637464 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.637440    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bxd4g_2cccf563-ab49-48b6-9f72-d9508c8a04ce/console-operator/2.log"
Jul 02 19:43:40.645629 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-podres\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645759 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfftw\" (UniqueName: \"kubernetes.io/projected/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-kube-api-access-cfftw\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645759 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-lib-modules\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645774    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-podres\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-sys\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645837    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-sys\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-proc\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645884    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-lib-modules\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.645971 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.645906    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-proc\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.653951 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.653930    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfftw\" (UniqueName: \"kubernetes.io/projected/1f347b4d-e8ae-45a4-9e8e-31f3122f61c2-kube-api-access-cfftw\") pod \"perf-node-gather-daemonset-n8sx7\" (UID: \"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2\") " pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.797750 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.797660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:40.934690 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:40.934663    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"]
Jul 02 19:43:40.936551 ip-10-0-135-32 kubenswrapper[2572]: W0702 19:43:40.936519    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f347b4d_e8ae_45a4_9e8e_31f3122f61c2.slice/crio-3ae0eef4d9b8fd9e3a282a309c0005eee1b6757356d3de40d0ce28d04b51fc7a WatchSource:0}: Error finding container 3ae0eef4d9b8fd9e3a282a309c0005eee1b6757356d3de40d0ce28d04b51fc7a: Status 404 returned error can't find the container with id 3ae0eef4d9b8fd9e3a282a309c0005eee1b6757356d3de40d0ce28d04b51fc7a
Jul 02 19:43:41.240081 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:41.240039    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-6rntt_531354b8-bd16-4540-aa87-dc7b1f59732f/download-server/0.log"
Jul 02 19:43:41.772240 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:41.772205    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7" event={"ID":"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2","Type":"ContainerStarted","Data":"59d3e1fb56f74b3aff287f3d6fddfa12010e9a8e45b5aacd86c803b02e9f7d73"}
Jul 02 19:43:41.772469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:41.772268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7" event={"ID":"1f347b4d-e8ae-45a4-9e8e-31f3122f61c2","Type":"ContainerStarted","Data":"3ae0eef4d9b8fd9e3a282a309c0005eee1b6757356d3de40d0ce28d04b51fc7a"}
Jul 02 19:43:41.772469 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:41.772318    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:41.797422 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:41.797370    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7" podStartSLOduration=1.797354367 podStartE2EDuration="1.797354367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:43:41.795844087 +0000 UTC m=+2486.167598809" watchObservedRunningTime="2026-07-02 19:43:41.797354367 +0000 UTC m=+2486.169109088"
Jul 02 19:43:41.861710 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:41.861681    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-x4m7s_dd82f036-a46e-4742-9c8d-3defed3cc338/volume-data-source-validator/0.log"
Jul 02 19:43:43.144168 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:43.144139    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkh4n_510cc5e4-74d7-4a78-b5ab-000cf3718710/dns/0.log"
Jul 02 19:43:43.168516 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:43.168484    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkh4n_510cc5e4-74d7-4a78-b5ab-000cf3718710/kube-rbac-proxy/0.log"
Jul 02 19:43:43.193987 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:43.193964    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jghjq_000b8b07-ebc7-466c-a66a-41d4d57fbc90/dns-node-resolver/0.log"
Jul 02 19:43:43.873144 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:43.873095    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8k6f_f6b9268f-a010-415e-8c68-964fed87830f/node-ca/0.log"
Jul 02 19:43:44.868043 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:44.868010    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf485mnr_a535b9c8-dc0a-49a9-8cf8-65462d007696/istio-proxy/0.log"
Jul 02 19:43:45.226769 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:45.226739    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5db59696f7-89w6b_d3692552-803f-4f43-9405-4f8cd39fc29a/router/0.log"
Jul 02 19:43:45.910569 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:45.910531    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p6pxx_9be95b23-1b9e-4618-a1bd-c2e046daeafd/serve-healthcheck-canary/0.log"
Jul 02 19:43:46.404286 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:46.404257    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-5dhf8_19f2d0ce-1a4a-48e3-b367-5da8db66ed32/insights-operator/0.log"
Jul 02 19:43:46.404506 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:46.404469    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-5dhf8_19f2d0ce-1a4a-48e3-b367-5da8db66ed32/insights-operator/1.log"
Jul 02 19:43:46.424538 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:46.424510    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98hmj_99fc9be5-dcf9-420d-84d1-84d98b65f980/kube-rbac-proxy/0.log"
Jul 02 19:43:46.444313 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:46.444283    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98hmj_99fc9be5-dcf9-420d-84d1-84d98b65f980/exporter/0.log"
Jul 02 19:43:46.468097 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:46.468072    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98hmj_99fc9be5-dcf9-420d-84d1-84d98b65f980/extractor/0.log"
Jul 02 19:43:47.794128 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:47.794102    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d52kh/perf-node-gather-daemonset-n8sx7"
Jul 02 19:43:49.154567 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:49.154540    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716995-trh7t_c8f87c78-8a70-409c-8d4e-aa9ba1025b7b/cleanup/0.log"
Jul 02 19:43:49.177916 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:49.177892    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717010-r9kxs_59c03ea4-3971-4673-ab41-9237bedf316a/cleanup/0.log"
Jul 02 19:43:49.437078 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:49.437054    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd5847cc4-6hf84_36ce6334-3cef-4a1d-8c35-bd4e98419017/manager/0.log"
Jul 02 19:43:49.455968 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:49.455946    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd5847cc4-6hf84_36ce6334-3cef-4a1d-8c35-bd4e98419017/copy-manifests/0.log"
Jul 02 19:43:51.132405 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:51.132376    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d578bc98c-j6lh7_f38e3fe3-75c9-42c1-b214-d6d54414794c/manager/0.log"
Jul 02 19:43:51.435520 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:51.435436    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf485mnr_a535b9c8-dc0a-49a9-8cf8-65462d007696/istio-proxy/0.log"
Jul 02 19:43:51.719990 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:51.719966    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5db59696f7-89w6b_d3692552-803f-4f43-9405-4f8cd39fc29a/router/0.log"
Jul 02 19:43:52.846724 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:52.846693    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf485mnr_a535b9c8-dc0a-49a9-8cf8-65462d007696/istio-proxy/0.log"
Jul 02 19:43:53.146016 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:53.145946    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5db59696f7-89w6b_d3692552-803f-4f43-9405-4f8cd39fc29a/router/0.log"
Jul 02 19:43:56.148601 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:56.148571    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-llsfn_ffdbba89-a540-4450-93eb-1f28f7d01f71/migrator/0.log"
Jul 02 19:43:56.169373 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:56.169343    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-llsfn_ffdbba89-a540-4450-93eb-1f28f7d01f71/graceful-termination/0.log"
Jul 02 19:43:56.507988 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:56.507957    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ms56h_45c43a6b-6053-47e2-81c9-4a01e8e22407/kube-storage-version-migrator-operator/1.log"
Jul 02 19:43:56.508787 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:56.508768    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ms56h_45c43a6b-6053-47e2-81c9-4a01e8e22407/kube-storage-version-migrator-operator/0.log"
Jul 02 19:43:57.656244 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.656207    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/kube-multus-additional-cni-plugins/0.log"
Jul 02 19:43:57.676762 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.676732    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/egress-router-binary-copy/0.log"
Jul 02 19:43:57.696097 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.696074    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/cni-plugins/0.log"
Jul 02 19:43:57.718172 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.718148    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/bond-cni-plugin/0.log"
Jul 02 19:43:57.739780 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.739752    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/routeoverride-cni/0.log"
Jul 02 19:43:57.764190 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.764160    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/whereabouts-cni-bincopy/0.log"
Jul 02 19:43:57.786425 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.786388    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6dzp_4aedc5c1-65fc-44b6-bb08-5f72641fed58/whereabouts-cni/0.log"
Jul 02 19:43:57.979976 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:57.979951    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mm6g4_5b1fd3d8-64b4-4d0d-9a69-02b8a382f808/kube-multus/0.log"
Jul 02 19:43:58.025756 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:58.025722    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-24bgr_03c2b116-1d0c-4b5a-ab9f-0c601e7236dc/network-metrics-daemon/0.log"
Jul 02 19:43:58.045757 ip-10-0-135-32 kubenswrapper[2572]: I0702 19:43:58.045730    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-24bgr_03c2b116-1d0c-4b5a-ab9f-0c601e7236dc/kube-rbac-proxy/0.log"