Jul 16 00:42:13.345179 ip-10-0-142-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 00:42:13.345189 ip-10-0-142-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 00:42:13.345196 ip-10-0-142-236 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 00:42:13.345456 ip-10-0-142-236 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 00:42:23.580954 ip-10-0-142-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 00:42:23.580971 ip-10-0-142-236 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4e2252b551d14a4680b13b88c4bd4ef9 --
Jul 16 00:44:17.964072 ip-10-0-142-236 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 00:44:18.367951 ip-10-0-142-236 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 00:44:18.367951 ip-10-0-142-236 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 00:44:18.367951 ip-10-0-142-236 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 00:44:18.367951 ip-10-0-142-236 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 00:44:18.367951 ip-10-0-142-236 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 00:44:18.368746 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.368032    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 00:44:18.371576 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371546    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:44:18.371576 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371571    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:44:18.371576 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371577    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:44:18.371576 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371581    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371586    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371591    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371596    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371600    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371608    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371612    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371617    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371621    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371625    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371629    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371632    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371638    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371643    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371648    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371652    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371658    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371663    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371668    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:44:18.371845 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371672    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371676    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371681    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371685    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371689    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371693    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371697    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371701    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371705    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371710    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371714    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371718    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371722    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371726    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371731    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371740    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371746    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371751    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:44:18.372626 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371756    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371760    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371765    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371769    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371773    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371777    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371782    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371786    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371806    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371810    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371815    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371819    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371823    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371827    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371831    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371836    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371840    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371843    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371847    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371852    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:44:18.373411 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371856    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371860    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371865    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371869    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371873    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371878    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371882    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371886    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371890    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371895    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371899    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371904    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371909    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371913    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371917    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371920    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371925    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371929    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371933    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371937    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371941    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:44:18.374253 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371946    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371950    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371954    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371959    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371963    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.371968    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372018    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372027    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372032    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372036    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372041    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372046    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372050    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372054    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372058    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372062    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372067    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.372071    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373232    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373242    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:44:18.375145 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373247    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373251    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373255    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373261    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373266    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373274    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373280    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373285    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373289    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373293    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373298    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373302    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373306    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373310    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373314    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373319    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373323    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373327    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373331    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:44:18.376060 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373336    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373341    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373345    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373349    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373353    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373359    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373363    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373368    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373372    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373376    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373380    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373384    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373389    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373393    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373398    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373402    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373406    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373419    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373424    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373428    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:44:18.376771 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373433    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373437    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373441    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373446    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373450    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373455    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373459    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373463    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373467    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373471    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373475    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373480    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373484    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373488    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373493    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373497    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373501    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373505    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373509    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373514    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:44:18.377425 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373518    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373522    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373526    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373533    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373540    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373548    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373552    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373557    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373561    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373567    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373574    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373579    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373583    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373588    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373592    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373597    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373600    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373605    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373610    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:44:18.378028 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373614    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373619    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373623    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373628    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373633    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373638    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373642    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373646    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373650    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373654    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373659    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373663    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373667    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373671    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373675    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373680    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373684    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373688    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.373694    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374322    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:44:18.378483 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374334    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374340    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374345    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374350    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374355    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374360    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374364    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374368    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374373    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374378    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374382    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374386    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374390    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374394    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374398    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374403    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374407    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374412    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374417    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374421    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:44:18.379087 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374426    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374430    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374434    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374438    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374442    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374446    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374451    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374455    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374459    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374466    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374474    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374479    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374483    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374487    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374492    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374497    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374502    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374506    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374511    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:44:18.379577 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374515    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374519    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374524    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374528    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374532    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374536    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374541    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374545    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374549    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374553    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374557    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374561    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374565    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374570    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374574    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374578    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374582    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374587    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374591    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374595    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:44:18.380061 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374599    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374603    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374607    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374613    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374617    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374625    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374629    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374633    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374638    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374642    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374647    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374651    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374656    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374660    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374664    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374668    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374672    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374676    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374681    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374685    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:44:18.380534 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374689    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374693    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374698    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374702    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374709    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374714    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374718    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374723    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374727    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374731    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374735    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374739    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374743    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374748    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374752    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374757    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374764    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374771    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.374776    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374882    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 00:44:18.381019 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374892    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374902    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374909    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374923    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374928    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374935    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374941    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374946    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374951    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374957    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374963    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374967    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374972    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374977    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374982    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374986    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374991    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.374996    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375001    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375006    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375011    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375016    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375022    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 00:44:18.381493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375026    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375032    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375037    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375042    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375049    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375054    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375061    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375066    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375073    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375078    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375082    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375087    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375092    2578 flags.go:64] FLAG: --enable-server="true"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375097    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375104    2578 flags.go:64] FLAG: --event-burst="100"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375109    2578 flags.go:64] FLAG: --event-qps="50"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375114    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375120    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375124    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375130    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375135    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375140    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375144    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375149    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375154    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 00:44:18.382118 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375158    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375163    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375167    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375172    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375176    2578 flags.go:64] FLAG: --feature-gates=""
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375183    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375188    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375193    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375198    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375203    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375207    2578 flags.go:64] FLAG: --help="false"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375212    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375217    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375225    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375229    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375235    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375240    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375245    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375249    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375253    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375258    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375264    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375270    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375275    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 16 00:44:18.382755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375280    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375284    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375289    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375293    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375298    2578 flags.go:64] FLAG: --lock-file=""
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375302    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375307    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375312    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375320    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375325    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375329    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375333    2578 flags.go:64] FLAG: --logging-format="text"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375338    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375343    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375348    2578 flags.go:64] FLAG: --manifest-url=""
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375353    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375359    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375364    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375370    2578 flags.go:64] FLAG: --max-pods="110"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375375    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375380    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375387    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375391    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375396    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375401    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 00:44:18.383354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375406    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375418    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375423    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375429    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375434    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375439    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375448    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375452    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375457    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375462    2578 flags.go:64] FLAG: --port="10250"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375467    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375472    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c8c8246aad8f4e0"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375477    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375481    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375486    2578 flags.go:64] FLAG: --register-node="true"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375491    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375496    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375501    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375505    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375510    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375516    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375520    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375525    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375530    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375535    2578 flags.go:64] FLAG: --runonce="false"
Jul 16 00:44:18.384023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375539    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375545    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375551    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375569    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375575    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375580    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375585    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375590    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375594    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375599    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375603    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375608    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375633    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375640    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375645    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375655    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375660    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375664    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375670    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375674    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375679    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375683    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375688    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375693    2578 flags.go:64] FLAG: --v="2"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375699    2578 flags.go:64] FLAG: --version="false"
Jul 16 00:44:18.384622 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375705    2578 flags.go:64] FLAG: --vmodule=""
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375710    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.375716    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375946    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375955    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375959    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375964    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375969    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375973    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375977    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375984    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375991    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.375997    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376002    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376006    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376011    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376016    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376020    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376024    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376028    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:44:18.385241 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376032    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376038    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376042    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376046    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376050    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376054    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376058    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376062    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376066    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376070    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376074    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376078    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376082    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376087    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376092    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376096    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376100    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376105    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376109    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:44:18.385731 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376116    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376121    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376128    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376135    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376140    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376145    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376150    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376154    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376159    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376163    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376167    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376171    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376176    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376180    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376184    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376190    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376195    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376199    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376203    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:44:18.386244 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376207    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376212    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376216    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376221    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376225    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376229    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376233    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376237    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376242    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376245    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376250    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376254    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376258    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376263    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376267    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376273    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376278    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376283    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376287    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:44:18.386709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376291    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376295    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376300    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376304    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376308    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376312    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376316    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376320    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376324    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376329    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376334    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376338    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376343    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376347    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376353    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376360    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376364    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376369    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376374    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376378    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:44:18.387185 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376384    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376388    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376392    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376397    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.376402    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.376410    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.383549    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.383572    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.384354    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.384361    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384412    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384417    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384420    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384423    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384426    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:44:18.387677 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384429    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384432    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384435    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384437    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384440    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384442    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384445    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384448    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384451    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384453    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384456    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384458    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384461    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384463    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384466    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384468    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384471    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384473    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384476    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:44:18.388072 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384478    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384482    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384486    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384489    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384492    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384496    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384499    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384502    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384505    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384507    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384510    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384513    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384516    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384518    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384520    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384523    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384525    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384528    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384531    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384533    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:44:18.388533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384536    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384538    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384541    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384543    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384545    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384548    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384550    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384553    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384556    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384558    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384561    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384563    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384566    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384568    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384571    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384574    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384576    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384580    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384583    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384585    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:44:18.389024 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384588    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384591    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384593    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384596    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384598    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384601    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384603    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384606    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384609    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384611    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384614    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384616    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384619    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384621    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384624    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384626    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384629    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384632    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384636    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384640    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:44:18.389503 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384642    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384645    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384648    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384650    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384652    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384655    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384659    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384663    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384666    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384669    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384672    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384675    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384678    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384681    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384684    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:44:18.390011 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.384689    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384800    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384806    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384809    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384811    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384814    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384817    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384820    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384822    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384825    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384827    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384830    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384832    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384835    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384837    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384839    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384842    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384844    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384847    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384849    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:44:18.390381 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384852    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384854    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384857    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384859    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384862    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384865    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384869    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384872    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384874    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384878    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384880    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384883    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384886    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384888    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384891    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384893    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384895    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384898    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384900    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:44:18.390951 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384903    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384905    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384908    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384910    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384912    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384915    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384917    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384919    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384922    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384924    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384927    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384929    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384932    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384935    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384937    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384940    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384944    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384946    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384949    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:44:18.391418 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384951    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384954    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384956    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384959    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384962    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384965    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384967    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384970    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384972    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384974    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384977    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384979    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384981    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384984    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384986    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384989    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384991    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384994    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384996    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.384998    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:44:18.391946 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385001    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385003    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385006    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385008    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385011    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385014    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385016    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385019    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385021    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385024    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385026    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385029    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385031    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385033    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385036    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385038    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385041    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385044    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385046    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:44:18.392473 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385050    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385053    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:18.385056    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.385061    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.385150    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.387952    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.389140    2578 server.go:1019] "Starting client certificate rotation"
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.389231    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.390403    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 00:44:18.393050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.391463    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 00:44:18.395001 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.394982    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 00:44:18.404815 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.404786    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 16 00:44:18.406801 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.406776    2578 log.go:25] "Validated CRI v1 image API"
Jul 16 00:44:18.408175 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.408158    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 00:44:18.411989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.411971    2578 fs.go:135] Filesystem UUIDs: map[16132e3e-f7df-4e9e-add5-09f6b4f64599:/dev/nvme0n1p4 20956f58-e136-42d5-8697-a50301bf6dfc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 16 00:44:18.412041 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.411989    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 00:44:18.417549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.417447    2578 manager.go:216] Machine: {Timestamp:2026-07-16 00:44:18.416102099 +0000 UTC m=+0.338925987 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098812 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23bfe592b200c6c8382d9363dedac9 SystemUUID:ec23bfe5-92b2-00c6-c838-2d9363dedac9 BootID:4e2252b5-51d1-4a46-80b1-3b88c4bd4ef9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:c2:69:11:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:c2:69:11:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:81:9e:96:13:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 00:44:18.417549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.417545    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 00:44:18.417652 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.417635    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 00:44:18.419971 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.419946    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 00:44:18.420096 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.419974    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 00:44:18.421224 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.421212    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 00:44:18.421224 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.421226    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 00:44:18.421304 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.421233    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 00:44:18.421878 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.421868    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 00:44:18.422680 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.422670    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 00:44:18.424511 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.424497    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 00:44:18.425989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.425979    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 00:44:18.426104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426095    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 00:44:18.426135 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426125    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 00:44:18.426166 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426140    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 00:44:18.426166 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426163    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 00:44:18.426218 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426176    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 16 00:44:18.426218 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426188    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 00:44:18.426582 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426550    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 00:44:18.426582 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.426569    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 00:44:18.428729 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.428708    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 00:44:18.432248 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.432230    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 00:44:18.432310 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.432267    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 00:44:18.432965 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.432954    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 00:44:18.433002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.432981    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 00:44:18.433002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.432988    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 00:44:18.433002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.432993    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 00:44:18.433002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433002    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433007    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433015    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433019    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433025    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433031    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433039    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 00:44:18.433102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433044    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 00:44:18.433904 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433894    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 00:44:18.433933 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.433905    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 00:44:18.437138 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.437121    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 00:44:18.437211 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.437138    2578 server.go:1268] "Started kubelet"
Jul 16 00:44:18.437211 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.437132    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 00:44:18.437301 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.437217    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 00:44:18.437345 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.437123    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 00:44:18.437392 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.437332    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 00:44:18.437392 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.437388    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 00:44:18.437979 ip-10-0-142-236 systemd[1]: Started Kubernetes Kubelet.
Jul 16 00:44:18.438470 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.438432    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 00:44:18.438681 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.438661    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 00:44:18.442407 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.442389    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 00:44:18.442699 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.442682    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 00:44:18.442699 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.442691    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 00:44:18.442878 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.442856    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:18.443346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443284    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 00:44:18.443346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443300    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 00:44:18.443346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443329    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 00:44:18.443538 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443397    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 00:44:18.443538 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443407    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 00:44:18.443671 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443648    2578 factory.go:55] Registering systemd factory
Jul 16 00:44:18.443671 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443664    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 16 00:44:18.443763 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.442819    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-236.ec2.internal.18c29e7c25a92d84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-236.ec2.internal,UID:ip-10-0-142-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-236.ec2.internal,},FirstTimestamp:2026-07-16 00:44:18.437115268 +0000 UTC m=+0.359939130,LastTimestamp:2026-07-16 00:44:18.437115268 +0000 UTC m=+0.359939130,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-236.ec2.internal,}"
Jul 16 00:44:18.443883 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443869    2578 factory.go:153] Registering CRI-O factory
Jul 16 00:44:18.443944 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443885    2578 factory.go:223] Registration of the crio container factory successfully
Jul 16 00:44:18.443944 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443925    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 00:44:18.444056 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443950    2578 factory.go:103] Registering Raw factory
Jul 16 00:44:18.444056 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.443969    2578 manager.go:1196] Started watching for new ooms in manager
Jul 16 00:44:18.444464 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.444445    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6bx7s"
Jul 16 00:44:18.444808 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.444782    2578 manager.go:349] Starting recovery of all containers
Jul 16 00:44:18.451684 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.451656    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 00:44:18.451834 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.451696    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 00:44:18.454510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.454484    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6bx7s"
Jul 16 00:44:18.456745 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.456727    2578 manager.go:354] Recovery completed
Jul 16 00:44:18.461175 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.461162    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.463099 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463085    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.463180 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463113    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.463180 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463128    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.463644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463627    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 00:44:18.463644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463643    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 00:44:18.463750 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463634    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.463750 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.463657    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 00:44:18.464289 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.464275    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.464355 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.464306    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.464355 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.464321    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.464957 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.464946    2578 policy_none.go:49] "None policy: Start"
Jul 16 00:44:18.464989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.464968    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 00:44:18.464989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.464978    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 00:44:18.466033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.466022    2578 policy_none.go:47] "Start"
Jul 16 00:44:18.510444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510332    2578 manager.go:337] "Starting Device Plugin manager"
Jul 16 00:44:18.510541 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.510477    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 00:44:18.510541 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510488    2578 server.go:87] "Starting device plugin registration server"
Jul 16 00:44:18.510720 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510709    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 00:44:18.510765 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510721    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 00:44:18.510886 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510864    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 00:44:18.510966 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510935    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 00:44:18.510966 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.510941    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 00:44:18.511459 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.511440    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 00:44:18.511544 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.511487    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:18.611556 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.611528    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.612485 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.612471    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.612537 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.612499    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.612537 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.612510    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.612537 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.612537    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.624261 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.624195    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 00:44:18.625505 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.625484    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 00:44:18.625601 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.625529    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 00:44:18.625601 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.625559    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 00:44:18.625708 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.625602    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 00:44:18.625772 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.625738    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.625772 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.625764    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-236.ec2.internal\": node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:18.628086 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.628066    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:18.680523 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.680500    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:18.727055 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.727016    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"]
Jul 16 00:44:18.727184 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.727103    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.728083 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.728065    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.728198 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.728098    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.728198 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.728112    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.729463 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.729449    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.729575 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.729560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.729616 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.729592    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.730225 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.730207    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.730225 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.730221    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.730398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.730235    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.730398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.730248    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.730398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.730247    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.730398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.730325    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.731482 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.731459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.731580 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.731488    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:44:18.732169 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.732146    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:44:18.732279 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.732180    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:44:18.732279 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.732195    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:44:18.744629 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.744609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d92aa44007fbeeba58b77b0f3aaedc2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-236.ec2.internal\" (UID: \"6d92aa44007fbeeba58b77b0f3aaedc2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.744704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.744640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.744704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.744663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.758683 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.758660    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-236.ec2.internal\" not found" node="ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.763438 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.763419    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-236.ec2.internal\" not found" node="ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.781227 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.781189    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:18.845172 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.845147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d92aa44007fbeeba58b77b0f3aaedc2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-236.ec2.internal\" (UID: \"6d92aa44007fbeeba58b77b0f3aaedc2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.845172 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.845176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.845346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.845195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.845346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.845241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.845346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.845269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.845346 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:18.845269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d92aa44007fbeeba58b77b0f3aaedc2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-236.ec2.internal\" (UID: \"6d92aa44007fbeeba58b77b0f3aaedc2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:18.881304 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.881233    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:18.983521 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:18.983478    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:19.061778 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.061737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:19.066909 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.066891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:19.083910 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:19.083880    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:19.186816 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:19.186732    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:19.263906 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.263754    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:19.288023 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:19.287991    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:19.350162 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.350136    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:19.388501 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.388467    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 00:44:19.388501 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:19.388468    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:19.388985 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.388614    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 00:44:19.388985 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.388642    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 00:44:19.388985 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.388673    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 00:44:19.458989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.458904    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 00:39:19 +0000 UTC" deadline="2028-01-04 22:59:29.73689764 +0000 UTC"
Jul 16 00:44:19.458989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.458929    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12910h15m10.277971061s"
Jul 16 00:44:19.489246 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:19.489214    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found"
Jul 16 00:44:19.559358 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.559331    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:19.600264 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:19.600236    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a76ec413de110e8f73baffdec3c3161.slice/crio-420c1de4cbffed051e2190803cda7635385bd764ecefe9e3293984444a582d2d WatchSource:0}: Error finding container 420c1de4cbffed051e2190803cda7635385bd764ecefe9e3293984444a582d2d: Status 404 returned error can't find the container with id 420c1de4cbffed051e2190803cda7635385bd764ecefe9e3293984444a582d2d
Jul 16 00:44:19.600564 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:19.600548    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d92aa44007fbeeba58b77b0f3aaedc2.slice/crio-40ada7c4a877de0a2dba9131693ace200c5566e189d83e3ff7ea82979c8f05f7 WatchSource:0}: Error finding container 40ada7c4a877de0a2dba9131693ace200c5566e189d83e3ff7ea82979c8f05f7: Status 404 returned error can't find the container with id 40ada7c4a877de0a2dba9131693ace200c5566e189d83e3ff7ea82979c8f05f7
Jul 16 00:44:19.604846 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.604827    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:44:19.630284 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.630234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" event={"ID":"6d92aa44007fbeeba58b77b0f3aaedc2","Type":"ContainerStarted","Data":"40ada7c4a877de0a2dba9131693ace200c5566e189d83e3ff7ea82979c8f05f7"}
Jul 16 00:44:19.631349 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.631323    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" event={"ID":"1a76ec413de110e8f73baffdec3c3161","Type":"ContainerStarted","Data":"420c1de4cbffed051e2190803cda7635385bd764ecefe9e3293984444a582d2d"}
Jul 16 00:44:19.643780 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.643763    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:19.653679 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.653661    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 00:44:19.654702 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.654689    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal"
Jul 16 00:44:19.665362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:19.665346    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 00:44:20.429529 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.429503    2578 apiserver.go:52] "Watching apiserver"
Jul 16 00:44:20.437348 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.437313    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 00:44:20.440027 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.439877    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-jxfjl","openshift-network-operator/iptables-alerter-wrxkr","kube-system/global-pull-secret-syncer-6t24c","kube-system/konnectivity-agent-lxhrt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk","openshift-dns/node-resolver-5ggd7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal","openshift-multus/multus-additional-cni-plugins-mcv46","openshift-ovn-kubernetes/ovnkube-node-mvzwt","kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ljsqn","openshift-image-registry/node-ca-h8jgz","openshift-multus/multus-94gvb","openshift-multus/network-metrics-daemon-qjhq2"]
Jul 16 00:44:20.441578 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.441554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.442824 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.442786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.444297 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.444025    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 00:44:20.444297 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.444139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.444297 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.444206    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:20.444937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.444736    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.444937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.444750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 00:44:20.444937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.444814    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 00:44:20.444937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.444817    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.445468 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.445283    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-st5bn\""
Jul 16 00:44:20.445637 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.445602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.445999 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.445978    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.446442 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.446422    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fflk2\""
Jul 16 00:44:20.446529 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.446485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 00:44:20.446588 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.446425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.447216 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.446948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.448510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.448491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.452034 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452014    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 00:44:20.452180 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452161    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 00:44:20.452325 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452307    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.452404 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452338    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-277b4\""
Jul 16 00:44:20.452460 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nbsvb\""
Jul 16 00:44:20.452460 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452021    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r7tzh\""
Jul 16 00:44:20.452558 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.452558 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.452667 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452205    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 00:44:20.452790 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8749c357-68f3-437b-9dde-4e1accea2001-iptables-alerter-script\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.452861 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452786    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.452861 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22844470-6776-4ac9-8bbb-647de271bf46-kubelet-config\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.452983 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-system-cni-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.452983 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-cnibin\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453094 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.452996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-hostroot\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453094 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tkh\" (UniqueName: \"kubernetes.io/projected/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-kube-api-access-f8tkh\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:20.453201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8749c357-68f3-437b-9dde-4e1accea2001-host-slash\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.453201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-cni-bin\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-kubelet\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-etc-kubernetes\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453408 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.453238    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:20.453408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmn8x\" (UniqueName: \"kubernetes.io/projected/8749c357-68f3-437b-9dde-4e1accea2001-kube-api-access-kmn8x\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.453408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.453621 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-cni-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453621 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-os-release\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453621 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-k8s-cni-cncf-io\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453621 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-multus-certs\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453621 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22844470-6776-4ac9-8bbb-647de271bf46-dbus\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.453897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-cni-binary-copy\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-socket-dir-parent\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.453897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-netns\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.454059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-cni-multus\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.454059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-conf-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.454059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.453992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-daemon-config\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.455869 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.455506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.457265 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.457244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.458853 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.458836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:20.458951 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.458915    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:20.460443 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460424    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.460643 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460621    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 00:44:20.460706 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460691    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 00:44:20.460776 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460694    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4gvm2\""
Jul 16 00:44:20.460882 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460865    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 00:44:20.460960 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460928    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 00:44:20.461016 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.460959    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 00:44:20.461016 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.461010    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 00:44:20.461112 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.461094    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.461430 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.461416    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g4st4\""
Jul 16 00:44:20.462067 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.462024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.462840 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.462820    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:20.463620 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.463599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.465428 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.465408    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 00:44:20.465648 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.465609    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nb6dc\""
Jul 16 00:44:20.465648 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.465625    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.465883 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.465845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.468089 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.468070    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 00:44:20.468474 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.468445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 00:44:20.468574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.468454    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 00:44:20.468574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.468544    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tmqnz\""
Jul 16 00:44:20.485023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.485003    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gqst"
Jul 16 00:44:20.491914 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.491837    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gqst"
Jul 16 00:44:20.544639 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.544597    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 00:44:20.554380 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-log-socket\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.554484 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5264f69b-0ae5-416e-a2ac-ed5e067e84b7-konnectivity-ca\") pod \"konnectivity-agent-lxhrt\" (UID: \"5264f69b-0ae5-416e-a2ac-ed5e067e84b7\") " pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.554484 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.554484 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-system-cni-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.554484 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-node-log\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-cni-netd\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkngv\" (UniqueName: \"kubernetes.io/projected/8fd7b54c-919f-48f9-8e14-b37280e324f9-kube-api-access-qkngv\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-system-cni-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-cni-bin\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-etc-kubernetes\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-host\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-cni-bin\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.554696 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-tmp-dir\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-etc-kubernetes\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-slash\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-socket-dir-parent\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-daemon-config\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22844470-6776-4ac9-8bbb-647de271bf46-kubelet-config\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-socket-dir-parent\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-hostroot\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tkh\" (UniqueName: \"kubernetes.io/projected/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-kube-api-access-f8tkh\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.554983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-etc-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-ovnkube-config\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-ovnkube-script-lib\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knq5\" (UniqueName: \"kubernetes.io/projected/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-kube-api-access-6knq5\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba6772b7-dafe-4bcc-ac65-8385c85b1644-host\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.555104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-system-cni-dir\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-cnibin\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e513803d-327c-4deb-973b-600531818aab-ovn-node-metrics-cert\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysconfig\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-run\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-tuned\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-os-release\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-k8s-cni-cncf-io\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-multus-certs\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22844470-6776-4ac9-8bbb-647de271bf46-dbus\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-cni-bin\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-env-overrides\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-daemon-config\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-kubernetes\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-cni-binary-copy\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-device-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.555884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22844470-6776-4ac9-8bbb-647de271bf46-kubelet-config\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-var-lib-kubelet\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmvvk\" (UniqueName: \"kubernetes.io/projected/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-kube-api-access-rmvvk\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-var-lib-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-hostroot\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-os-release\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.555906    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-k8s-cni-cncf-io\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-multus-certs\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.555980    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:21.055957081 +0000 UTC m=+2.978780934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-cni-binary-copy\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.555785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-sys-fs\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22844470-6776-4ac9-8bbb-647de271bf46-dbus\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-systemd\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-systemd-units\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.556803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-systemd\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-etc-selinux\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppjg\" (UniqueName: \"kubernetes.io/projected/4660564e-0cc2-4c38-a389-bc66722b8ce0-kube-api-access-dppjg\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-tmp\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-socket-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-registration-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-netns\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-hosts-file\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-run-netns\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-run-netns\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpx9r\" (UniqueName: \"kubernetes.io/projected/ba6772b7-dafe-4bcc-ac65-8385c85b1644-kube-api-access-dpx9r\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-cnibin\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8749c357-68f3-437b-9dde-4e1accea2001-host-slash\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8749c357-68f3-437b-9dde-4e1accea2001-host-slash\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-cnibin\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.557561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysctl-conf\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-sys\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba6772b7-dafe-4bcc-ac65-8385c85b1644-serviceca\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-kubelet\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmn8x\" (UniqueName: \"kubernetes.io/projected/8749c357-68f3-437b-9dde-4e1accea2001-kube-api-access-kmn8x\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dcb\" (UniqueName: \"kubernetes.io/projected/aa76d468-c54d-4433-b390-afd258495c35-kube-api-access-62dcb\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-kubelet\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-kubelet\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.556977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-modprobe-d\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysctl-d\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-lib-modules\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-cni-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhmsx\" (UniqueName: \"kubernetes.io/projected/e513803d-327c-4deb-973b-600531818aab-kube-api-access-nhmsx\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-cni-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5264f69b-0ae5-416e-a2ac-ed5e067e84b7-agent-certs\") pod \"konnectivity-agent-lxhrt\" (UID: \"5264f69b-0ae5-416e-a2ac-ed5e067e84b7\") " pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.558323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-cni-multus\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-conf-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8749c357-68f3-437b-9dde-4e1accea2001-iptables-alerter-script\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-host-var-lib-cni-multus\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-os-release\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-ovn\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-multus-conf-dir\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.558939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.557851    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8749c357-68f3-437b-9dde-4e1accea2001-iptables-alerter-script\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.562885 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.562843    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 00:44:20.567024 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.566993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tkh\" (UniqueName: \"kubernetes.io/projected/49aeb313-0dbc-41b5-a7e4-26ee61c93e9f-kube-api-access-f8tkh\") pod \"multus-94gvb\" (UID: \"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f\") " pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.567132 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.567013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmn8x\" (UniqueName: \"kubernetes.io/projected/8749c357-68f3-437b-9dde-4e1accea2001-kube-api-access-kmn8x\") pod \"iptables-alerter-wrxkr\" (UID: \"8749c357-68f3-437b-9dde-4e1accea2001\") " pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.657864 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-etc-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.657864 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-ovnkube-config\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-ovnkube-script-lib\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knq5\" (UniqueName: \"kubernetes.io/projected/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-kube-api-access-6knq5\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba6772b7-dafe-4bcc-ac65-8385c85b1644-host\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-system-cni-dir\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-cnibin\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.657918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-etc-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e513803d-327c-4deb-973b-600531818aab-ovn-node-metrics-cert\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysconfig\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-run\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-tuned\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-cni-bin\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-env-overrides\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-kubernetes\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-device-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-var-lib-kubelet\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmvvk\" (UniqueName: \"kubernetes.io/projected/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-kube-api-access-rmvvk\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-var-lib-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-sys-fs\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-systemd\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-systemd-units\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.658461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-systemd\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-etc-selinux\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dppjg\" (UniqueName: \"kubernetes.io/projected/4660564e-0cc2-4c38-a389-bc66722b8ce0-kube-api-access-dppjg\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-tmp\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-system-cni-dir\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-socket-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-registration-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba6772b7-dafe-4bcc-ac65-8385c85b1644-host\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-hosts-file\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-hosts-file\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-run-netns\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysconfig\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpx9r\" (UniqueName: \"kubernetes.io/projected/ba6772b7-dafe-4bcc-ac65-8385c85b1644-kube-api-access-dpx9r\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysctl-conf\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-sys\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.659305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba6772b7-dafe-4bcc-ac65-8385c85b1644-serviceca\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.658943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62dcb\" (UniqueName: \"kubernetes.io/projected/aa76d468-c54d-4433-b390-afd258495c35-kube-api-access-62dcb\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-kubelet\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-run\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-modprobe-d\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysctl-d\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-cnibin\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-lib-modules\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-modprobe-d\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-run-netns\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-kubelet\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhmsx\" (UniqueName: \"kubernetes.io/projected/e513803d-327c-4deb-973b-600531818aab-kube-api-access-nhmsx\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5264f69b-0ae5-416e-a2ac-ed5e067e84b7-agent-certs\") pod \"konnectivity-agent-lxhrt\" (UID: \"5264f69b-0ae5-416e-a2ac-ed5e067e84b7\") " pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.660176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-lib-modules\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-os-release\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-ovn\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-log-socket\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5264f69b-0ae5-416e-a2ac-ed5e067e84b7-konnectivity-ca\") pod \"konnectivity-agent-lxhrt\" (UID: \"5264f69b-0ae5-416e-a2ac-ed5e067e84b7\") " pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-node-log\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-cni-netd\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-systemd-units\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkngv\" (UniqueName: \"kubernetes.io/projected/8fd7b54c-919f-48f9-8e14-b37280e324f9-kube-api-access-qkngv\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-host\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-cni-bin\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.659239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-ovnkube-script-lib\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-tmp-dir\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-slash\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-slash\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-env-overrides\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-systemd\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa76d468-c54d-4433-b390-afd258495c35-os-release\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-tmp-dir\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-run-ovn\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.660390    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.660502    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:21.16047754 +0000 UTC m=+3.083301389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-sys\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-log-socket\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-etc-selinux\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba6772b7-dafe-4bcc-ac65-8385c85b1644-serviceca\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-var-lib-kubelet\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.661926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.660924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysctl-conf\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-var-lib-openvswitch\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5264f69b-0ae5-416e-a2ac-ed5e067e84b7-konnectivity-ca\") pod \"konnectivity-agent-lxhrt\" (UID: \"5264f69b-0ae5-416e-a2ac-ed5e067e84b7\") " pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e513803d-327c-4deb-973b-600531818aab-ovnkube-config\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-device-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-socket-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-sys-fs\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-systemd\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-sysctl-d\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-host-cni-netd\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e513803d-327c-4deb-973b-600531818aab-node-log\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-kubernetes\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-host\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa76d468-c54d-4433-b390-afd258495c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.661693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4660564e-0cc2-4c38-a389-bc66722b8ce0-registration-dir\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.662654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.662174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-etc-tuned\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.663523 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.662811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5264f69b-0ae5-416e-a2ac-ed5e067e84b7-agent-certs\") pod \"konnectivity-agent-lxhrt\" (UID: \"5264f69b-0ae5-416e-a2ac-ed5e067e84b7\") " pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.664059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.664033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e513803d-327c-4deb-973b-600531818aab-ovn-node-metrics-cert\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.664242 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.664202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-tmp\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.669194 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.668684    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:20.669194 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.668710    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:20.669194 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.668725    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:20.669194 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:20.668786    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:44:21.168768094 +0000 UTC m=+3.091591965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:20.670729 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.670704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmvvk\" (UniqueName: \"kubernetes.io/projected/bc3b94c1-ffa7-4a33-a4b3-1a58d545c186-kube-api-access-rmvvk\") pod \"node-resolver-5ggd7\" (UID: \"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186\") " pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.670917 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.670891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dcb\" (UniqueName: \"kubernetes.io/projected/aa76d468-c54d-4433-b390-afd258495c35-kube-api-access-62dcb\") pod \"multus-additional-cni-plugins-mcv46\" (UID: \"aa76d468-c54d-4433-b390-afd258495c35\") " pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.671960 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.671891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpx9r\" (UniqueName: \"kubernetes.io/projected/ba6772b7-dafe-4bcc-ac65-8385c85b1644-kube-api-access-dpx9r\") pod \"node-ca-h8jgz\" (UID: \"ba6772b7-dafe-4bcc-ac65-8385c85b1644\") " pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:20.671960 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.671904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhmsx\" (UniqueName: \"kubernetes.io/projected/e513803d-327c-4deb-973b-600531818aab-kube-api-access-nhmsx\") pod \"ovnkube-node-mvzwt\" (UID: \"e513803d-327c-4deb-973b-600531818aab\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.672400 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.672378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkngv\" (UniqueName: \"kubernetes.io/projected/8fd7b54c-919f-48f9-8e14-b37280e324f9-kube-api-access-qkngv\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:20.672731 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.672707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dppjg\" (UniqueName: \"kubernetes.io/projected/4660564e-0cc2-4c38-a389-bc66722b8ce0-kube-api-access-dppjg\") pod \"aws-ebs-csi-driver-node-8jpfk\" (UID: \"4660564e-0cc2-4c38-a389-bc66722b8ce0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.672828 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.672753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knq5\" (UniqueName: \"kubernetes.io/projected/bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc-kube-api-access-6knq5\") pod \"tuned-ljsqn\" (UID: \"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.756116 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.756023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94gvb"
Jul 16 00:44:20.767845 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.767819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wrxkr"
Jul 16 00:44:20.777720 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.777699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:20.790669 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.790644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk"
Jul 16 00:44:20.800560 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.800540    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ggd7"
Jul 16 00:44:20.808340 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.808312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mcv46"
Jul 16 00:44:20.815426 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.815409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:20.822303 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.822281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljsqn"
Jul 16 00:44:20.829186 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:20.829165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h8jgz"
Jul 16 00:44:21.063083 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.063048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:21.063261 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.063212    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:21.063312 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.063285    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:22.063261605 +0000 UTC m=+3.986085462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:21.163807 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.163766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:21.163991 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.163912    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:21.163991 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.163977    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:22.16396072 +0000 UTC m=+4.086784588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:21.186021 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.185997    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:21.264671 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.264635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:21.264846 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.264827    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:21.264897 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.264854    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:21.264897 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.264866    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:21.264980 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.264925    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:44:22.264908634 +0000 UTC m=+4.187732485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:21.494267 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.494157    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:39:21 +0000 UTC" deadline="2028-02-25 13:25:52.779166779 +0000 UTC"
Jul 16 00:44:21.494267 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.494217    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14148h41m31.284955335s"
Jul 16 00:44:21.555151 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.555124    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6772b7_dafe_4bcc_ac65_8385c85b1644.slice/crio-225c7300f5c9aa4aa1224f3d75ea6da722b484cf9ee299b00c02884b96f38b67 WatchSource:0}: Error finding container 225c7300f5c9aa4aa1224f3d75ea6da722b484cf9ee299b00c02884b96f38b67: Status 404 returned error can't find the container with id 225c7300f5c9aa4aa1224f3d75ea6da722b484cf9ee299b00c02884b96f38b67
Jul 16 00:44:21.576595 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.576569    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5264f69b_0ae5_416e_a2ac_ed5e067e84b7.slice/crio-debf4f227fa4674efd6d233be60b4aee09aec0f47da81996810828b5f0f7bc8c WatchSource:0}: Error finding container debf4f227fa4674efd6d233be60b4aee09aec0f47da81996810828b5f0f7bc8c: Status 404 returned error can't find the container with id debf4f227fa4674efd6d233be60b4aee09aec0f47da81996810828b5f0f7bc8c
Jul 16 00:44:21.578213 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.577398    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49aeb313_0dbc_41b5_a7e4_26ee61c93e9f.slice/crio-b2e663ef736d6ab0c067604ec8212549a68c8b1fd149d27d6d3993719521ec94 WatchSource:0}: Error finding container b2e663ef736d6ab0c067604ec8212549a68c8b1fd149d27d6d3993719521ec94: Status 404 returned error can't find the container with id b2e663ef736d6ab0c067604ec8212549a68c8b1fd149d27d6d3993719521ec94
Jul 16 00:44:21.579138 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.578905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7fcf28_2f9e_4085_b87e_e8c0bd63e2fc.slice/crio-67a5dbf542e42116f9cf1a2d88eae31f44a38d712a3e1860391d9120c00ee38b WatchSource:0}: Error finding container 67a5dbf542e42116f9cf1a2d88eae31f44a38d712a3e1860391d9120c00ee38b: Status 404 returned error can't find the container with id 67a5dbf542e42116f9cf1a2d88eae31f44a38d712a3e1860391d9120c00ee38b
Jul 16 00:44:21.579697 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.579648    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3b94c1_ffa7_4a33_a4b3_1a58d545c186.slice/crio-65fca01e78f71464c6d4a490de777730ef9d4a30d94c769748e2a3e4fb9a35dc WatchSource:0}: Error finding container 65fca01e78f71464c6d4a490de777730ef9d4a30d94c769748e2a3e4fb9a35dc: Status 404 returned error can't find the container with id 65fca01e78f71464c6d4a490de777730ef9d4a30d94c769748e2a3e4fb9a35dc
Jul 16 00:44:21.581295 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.581272    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8749c357_68f3_437b_9dde_4e1accea2001.slice/crio-21ac1ff6484cb5f4bd0ec8a3ffce6a873f44ea899c5c3d8a78fe015a86b08109 WatchSource:0}: Error finding container 21ac1ff6484cb5f4bd0ec8a3ffce6a873f44ea899c5c3d8a78fe015a86b08109: Status 404 returned error can't find the container with id 21ac1ff6484cb5f4bd0ec8a3ffce6a873f44ea899c5c3d8a78fe015a86b08109
Jul 16 00:44:21.582469 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.582445    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4660564e_0cc2_4c38_a389_bc66722b8ce0.slice/crio-4d83def41982ece55906b3c93bd966309d2c9d8c41fc27a0e04fe72440d30e47 WatchSource:0}: Error finding container 4d83def41982ece55906b3c93bd966309d2c9d8c41fc27a0e04fe72440d30e47: Status 404 returned error can't find the container with id 4d83def41982ece55906b3c93bd966309d2c9d8c41fc27a0e04fe72440d30e47
Jul 16 00:44:21.583694 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.583661    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa76d468_c54d_4433_b390_afd258495c35.slice/crio-78b30df149322bb8cc1081f2e5feb5e841c72ca558280a5004ab769ab5818333 WatchSource:0}: Error finding container 78b30df149322bb8cc1081f2e5feb5e841c72ca558280a5004ab769ab5818333: Status 404 returned error can't find the container with id 78b30df149322bb8cc1081f2e5feb5e841c72ca558280a5004ab769ab5818333
Jul 16 00:44:21.585662 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:21.585639    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode513803d_327c_4deb_973b_600531818aab.slice/crio-ed80445e9442078f9474c82a1a3130721e2c834a68eb23f0cbedeea41a6ec8bc WatchSource:0}: Error finding container ed80445e9442078f9474c82a1a3130721e2c834a68eb23f0cbedeea41a6ec8bc: Status 404 returned error can't find the container with id ed80445e9442078f9474c82a1a3130721e2c834a68eb23f0cbedeea41a6ec8bc
Jul 16 00:44:21.599605 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.599553    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:44:21.626072 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.626054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:21.626170 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:21.626152    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:21.636541 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.636517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"ed80445e9442078f9474c82a1a3130721e2c834a68eb23f0cbedeea41a6ec8bc"}
Jul 16 00:44:21.637699 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.637675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk" event={"ID":"4660564e-0cc2-4c38-a389-bc66722b8ce0","Type":"ContainerStarted","Data":"4d83def41982ece55906b3c93bd966309d2c9d8c41fc27a0e04fe72440d30e47"}
Jul 16 00:44:21.638888 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.638864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wrxkr" event={"ID":"8749c357-68f3-437b-9dde-4e1accea2001","Type":"ContainerStarted","Data":"21ac1ff6484cb5f4bd0ec8a3ffce6a873f44ea899c5c3d8a78fe015a86b08109"}
Jul 16 00:44:21.640058 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.640035    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxhrt" event={"ID":"5264f69b-0ae5-416e-a2ac-ed5e067e84b7","Type":"ContainerStarted","Data":"debf4f227fa4674efd6d233be60b4aee09aec0f47da81996810828b5f0f7bc8c"}
Jul 16 00:44:21.641235 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.641212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h8jgz" event={"ID":"ba6772b7-dafe-4bcc-ac65-8385c85b1644","Type":"ContainerStarted","Data":"225c7300f5c9aa4aa1224f3d75ea6da722b484cf9ee299b00c02884b96f38b67"}
Jul 16 00:44:21.642355 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.642331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerStarted","Data":"78b30df149322bb8cc1081f2e5feb5e841c72ca558280a5004ab769ab5818333"}
Jul 16 00:44:21.643524 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.643503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ggd7" event={"ID":"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186","Type":"ContainerStarted","Data":"65fca01e78f71464c6d4a490de777730ef9d4a30d94c769748e2a3e4fb9a35dc"}
Jul 16 00:44:21.644671 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.644650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljsqn" event={"ID":"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc","Type":"ContainerStarted","Data":"67a5dbf542e42116f9cf1a2d88eae31f44a38d712a3e1860391d9120c00ee38b"}
Jul 16 00:44:21.645706 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:21.645686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94gvb" event={"ID":"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f","Type":"ContainerStarted","Data":"b2e663ef736d6ab0c067604ec8212549a68c8b1fd149d27d6d3993719521ec94"}
Jul 16 00:44:22.071683 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.071103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:22.071683 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.071256    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:22.071683 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.071330    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:24.071301432 +0000 UTC m=+5.994125284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:22.172293 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.171680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:22.172293 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.171865    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:22.172293 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.171948    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:24.171929556 +0000 UTC m=+6.094753417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:22.272369 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.272329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:22.272594 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.272546    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:22.272594 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.272575    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:22.272594 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.272590    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:22.272784 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.272653    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:44:24.272633865 +0000 UTC m=+6.195457714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:22.495170 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.495054    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:39:21 +0000 UTC" deadline="2028-01-17 12:33:55.172944495 +0000 UTC"
Jul 16 00:44:22.495170 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.495099    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13211h49m32.677850805s"
Jul 16 00:44:22.627082 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.627053    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:22.627250 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.627185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:22.636556 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.636524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:22.636733 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:22.636704    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:22.674441 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.674397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" event={"ID":"6d92aa44007fbeeba58b77b0f3aaedc2","Type":"ContainerStarted","Data":"e2ed4f718c9403a6cc621c7940c797987399dca2c6d79de2321b858d06993f4f"}
Jul 16 00:44:22.693226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.693159    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" podStartSLOduration=2.693140986 podStartE2EDuration="2.693140986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:22.692539637 +0000 UTC m=+4.615363526" watchObservedRunningTime="2026-07-16 00:44:22.693140986 +0000 UTC m=+4.615964858"
Jul 16 00:44:22.694245 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.694219    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a76ec413de110e8f73baffdec3c3161" containerID="82f855256d67b1440f388cd3c189e05ef61d6468b02440a242dfd3f3f9b5f49e" exitCode=0
Jul 16 00:44:22.694338 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:22.694269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" event={"ID":"1a76ec413de110e8f73baffdec3c3161","Type":"ContainerDied","Data":"82f855256d67b1440f388cd3c189e05ef61d6468b02440a242dfd3f3f9b5f49e"}
Jul 16 00:44:23.626357 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:23.626321    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:23.626847 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:23.626512    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:23.723783 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:23.723745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" event={"ID":"1a76ec413de110e8f73baffdec3c3161","Type":"ContainerStarted","Data":"08eb8875a073898a966ca19785e5b2cf169d4688934f2b3f353565fce4ebc61c"}
Jul 16 00:44:23.743921 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:23.743866    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" podStartSLOduration=3.743842016 podStartE2EDuration="3.743842016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:23.743726231 +0000 UTC m=+5.666550119" watchObservedRunningTime="2026-07-16 00:44:23.743842016 +0000 UTC m=+5.666665891"
Jul 16 00:44:24.090803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:24.090216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:24.090803 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.090386    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:24.090803 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.090450    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.090431452 +0000 UTC m=+10.013255302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:24.191301 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:24.191267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:24.191489 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.191451    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:24.191559 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.191510    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.191491738 +0000 UTC m=+10.114315599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:24.293348 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:24.292489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:24.293348 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.292642    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:24.293348 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.292664    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:24.293348 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.292678    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:24.293348 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.292734    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.292716481 +0000 UTC m=+10.215540341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:24.629332 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:24.629301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:24.629816 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.629445    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:24.629816 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:24.629516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:24.629816 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:24.629598    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:25.626133 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:25.626098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:25.626331 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:25.626251    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:26.628257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:26.626497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:26.628257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:26.626501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:26.628257 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:26.626643    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:26.628257 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:26.626732    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:27.626318 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:27.626283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:27.626518 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:27.626447    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:28.130209 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:28.130171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:28.130694 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.130363    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:28.130694 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.130444    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:36.130423602 +0000 UTC m=+18.053247453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:28.231557 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:28.231404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:28.231765 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.231611    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:28.231765 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.231682    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:36.231663358 +0000 UTC m=+18.154487206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:28.332703 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:28.332664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:28.332950 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.332928    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:28.333044 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.332960    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:28.333044 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.332975    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:28.333044 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.333039    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:44:36.333019533 +0000 UTC m=+18.255843398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:28.626402 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:28.626303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:28.626402 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:28.626343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:28.626714 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.626444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:28.627740 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:28.627691    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:29.626869 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:29.626365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:29.626869 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:29.626515    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:30.630138 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:30.630102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:30.630576 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:30.630218    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:30.630576 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:30.630102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:30.630576 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:30.630322    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:31.626807 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:31.626763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:31.626983 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:31.626908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:32.628122 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:32.628096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:32.628549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:32.628098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:32.628549 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:32.628198    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:32.628549 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:32.628265    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:33.626291 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:33.626258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:33.626446 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:33.626381    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:34.626260 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:34.626213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:34.626839 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:34.626336    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:34.626839 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:34.626383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:34.626839 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:34.626468    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:35.626086 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:35.626059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:35.626310 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:35.626182    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:36.194432 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:36.194386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:36.194629 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.194555    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:36.194629 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.194620    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:52.194600657 +0000 UTC m=+34.117424511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:36.295010 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:36.294969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:36.295180 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.295116    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:36.295241 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.295186    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:52.29516612 +0000 UTC m=+34.217989976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:36.395595 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:36.395560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:36.395807 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.395761    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:36.395807 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.395804    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:36.395919 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.395818    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:36.395919 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.395883    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:44:52.395863166 +0000 UTC m=+34.318687026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:36.625969 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:36.625931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:36.626173 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.626053    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:36.626173 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:36.626118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:36.626286 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:36.626215    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:37.626293 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:37.626260    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:37.626716 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:37.626397    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:38.627157 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:38.627121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:38.627625 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:38.627194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:38.627625 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:38.627216    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:38.627625 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:38.627308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:39.626206 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:39.626151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:39.626349 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:39.626257    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:40.626707 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:40.626618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:40.627156 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:40.626758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:40.627156 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:40.626820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:40.627156 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:40.626921    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:41.626649 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.626510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:41.626759 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:41.626723    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:41.760888 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.760864    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa76d468-c54d-4433-b390-afd258495c35" containerID="9996f50f495c9eeba7cba978ab4b7e3ed840db44e6d25d2ab2fd1f3436c94dd1" exitCode=0
Jul 16 00:44:41.760981 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.760941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerDied","Data":"9996f50f495c9eeba7cba978ab4b7e3ed840db44e6d25d2ab2fd1f3436c94dd1"}
Jul 16 00:44:41.762404 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.762379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ggd7" event={"ID":"bc3b94c1-ffa7-4a33-a4b3-1a58d545c186","Type":"ContainerStarted","Data":"2876c991ae7805c8845d664f9fa9f3c02335ad47c8e3a7af6d5ed1b15fc15100"}
Jul 16 00:44:41.763904 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.763884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljsqn" event={"ID":"bf7fcf28-2f9e-4085-b87e-e8c0bd63e2fc","Type":"ContainerStarted","Data":"eec880687e966f923f363fd10254184ea55feb0eff3ea3040108b4bb564bb9d5"}
Jul 16 00:44:41.765483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.765455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94gvb" event={"ID":"49aeb313-0dbc-41b5-a7e4-26ee61c93e9f","Type":"ContainerStarted","Data":"c65849302aea0683037c941912061382829112d1825b148d8101d04321b32334"}
Jul 16 00:44:41.767369 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.767350    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:44:41.767700 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.767680    2578 generic.go:356] "Generic (PLEG): container finished" podID="e513803d-327c-4deb-973b-600531818aab" containerID="2e2718266193c772f46682131932c4a1ef540faf36b4275842f15a386bda70e3" exitCode=1
Jul 16 00:44:41.767779 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.767754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"898cc98045f23b47ea3d10510f500e1990307bfd9752dff6c08292454726e27a"}
Jul 16 00:44:41.767857 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.767843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerDied","Data":"2e2718266193c772f46682131932c4a1ef540faf36b4275842f15a386bda70e3"}
Jul 16 00:44:41.767911 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.767897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"166cf6275fcc5063057dbd8070159e1b98c418530e8cfd8225ac3352a353df54"}
Jul 16 00:44:41.769228 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.769206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk" event={"ID":"4660564e-0cc2-4c38-a389-bc66722b8ce0","Type":"ContainerStarted","Data":"5c1c82226b9f3209c683aa27e5ca3a8a40377019742d04795c93e95a84bde3df"}
Jul 16 00:44:41.770517 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.770489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxhrt" event={"ID":"5264f69b-0ae5-416e-a2ac-ed5e067e84b7","Type":"ContainerStarted","Data":"f739a91ee6c7d86203ae13d5c686fb8c006d7ad4b5f2cd6d904dde5a7ba7385f"}
Jul 16 00:44:41.771923 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.771905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h8jgz" event={"ID":"ba6772b7-dafe-4bcc-ac65-8385c85b1644","Type":"ContainerStarted","Data":"b429ce583301403d3ab9354b773c461e834977792ed42e6acdd8c268c167cda2"}
Jul 16 00:44:41.857432 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.857392    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ljsqn" podStartSLOduration=3.442835693 podStartE2EDuration="22.857377624s" totalImagesPullingTime="19.414541931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:41.857260436 +0000 UTC m=+23.780084299" watchObservedRunningTime="2026-07-16 00:44:41.857377624 +0000 UTC m=+23.780201491"
Jul 16 00:44:41.857554 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.857527    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-94gvb" podStartSLOduration=3.417651819 podStartE2EDuration="22.857520375s" totalImagesPullingTime="19.439868556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:41.811489376 +0000 UTC m=+23.734313243" watchObservedRunningTime="2026-07-16 00:44:41.857520375 +0000 UTC m=+23.780344243"
Jul 16 00:44:41.874193 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.874149    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h8jgz" podStartSLOduration=3.43520973 podStartE2EDuration="22.874130656s" totalImagesPullingTime="19.438920926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:41.873749953 +0000 UTC m=+23.796573841" watchObservedRunningTime="2026-07-16 00:44:41.874130656 +0000 UTC m=+23.796954527"
Jul 16 00:44:41.903725 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.903576    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lxhrt" podStartSLOduration=3.486667889 podStartE2EDuration="22.903557769s" totalImagesPullingTime="19.41688988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:41.902943986 +0000 UTC m=+23.825767875" watchObservedRunningTime="2026-07-16 00:44:41.903557769 +0000 UTC m=+23.826381637"
Jul 16 00:44:41.917881 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:41.917835    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5ggd7" podStartSLOduration=3.5038835539999997 podStartE2EDuration="22.917818451s" totalImagesPullingTime="19.413934897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:41.917163376 +0000 UTC m=+23.839987244" watchObservedRunningTime="2026-07-16 00:44:41.917818451 +0000 UTC m=+23.840642316"
Jul 16 00:44:42.626753 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.626723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:42.627252 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.626754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:42.627252 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:42.626874    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:42.627252 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:42.626995    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:42.663078 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.663051    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 00:44:42.777659 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.777631    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:44:42.778102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.778078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"8e1f5974226bf8548a3b15fecad87098a8b2622a661e59cad5512726e66b7788"}
Jul 16 00:44:42.778187 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.778167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"36d76862aeeba32f4103de1d90517186dc71642671769ed106545e90cd66e3ff"}
Jul 16 00:44:42.778247 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.778217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"20eb3b57405588ab2a9ede193ced95baeeb61170a15358f174222801a6adee76"}
Jul 16 00:44:42.780065 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.780038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk" event={"ID":"4660564e-0cc2-4c38-a389-bc66722b8ce0","Type":"ContainerStarted","Data":"88c897eeb250dddd635f1a61e27e24719a7a25be124cad96cac106f538ed1573"}
Jul 16 00:44:42.781675 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:42.781648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wrxkr" event={"ID":"8749c357-68f3-437b-9dde-4e1accea2001","Type":"ContainerStarted","Data":"c9fd7b8eff321a10e45bdcbb8166da515bd9ca4aa6a0dd8989d411b6802e73b1"}
Jul 16 00:44:43.225999 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.225943    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:43.226625 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.226602    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:43.252803 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.252623    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wrxkr" podStartSLOduration=4.822865622 podStartE2EDuration="24.252602162s" totalImagesPullingTime="19.42973654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:42.797030323 +0000 UTC m=+24.719854188" watchObservedRunningTime="2026-07-16 00:44:43.252602162 +0000 UTC m=+25.175426031"
Jul 16 00:44:43.529212 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.529097    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T00:44:42.663072404Z","UUID":"30b8c606-7e67-475f-ab40-d9776cdb1144","Handler":null,"Name":"","Endpoint":""}
Jul 16 00:44:43.531164 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.531098    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 00:44:43.531164 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.531140    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 00:44:43.625971 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.625940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:43.626129 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:43.626076    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:43.784506 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.784397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:43.784930 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:43.784821    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lxhrt"
Jul 16 00:44:44.626485 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:44.626453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:44.626682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:44.626457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:44.626682 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:44.626577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:44.626682 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:44.626671    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:44.789058 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:44.788808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk" event={"ID":"4660564e-0cc2-4c38-a389-bc66722b8ce0","Type":"ContainerStarted","Data":"15e545eb3d802ded46284b617f459336488f61cf502a3dd1266f71070e0d21a3"}
Jul 16 00:44:44.807539 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:44.807485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jpfk" podStartSLOduration=4.097770352 podStartE2EDuration="25.807472158s" totalImagesPullingTime="21.709701806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.807012375 +0000 UTC m=+26.729836260" watchObservedRunningTime="2026-07-16 00:44:44.807472158 +0000 UTC m=+26.730296025"
Jul 16 00:44:45.626095 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:45.626053    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:45.626279 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:45.626166    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:45.794261 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:45.794241    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:44:45.794693 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:45.794624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"ad4526d413798675f3668c96f3b1ab2b39f39222556919e84aa0899cd4174160"}
Jul 16 00:44:46.626550 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:46.626488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:46.626550 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:46.626521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:46.626730 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:46.626589    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:46.626783 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:46.626731    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:46.797756 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:46.797726    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa76d468-c54d-4433-b390-afd258495c35" containerID="0c36e28b25dd5fde849f9f7b9b7f1cf1657c684a5dd21e03ccee42158fcf3ca6" exitCode=0
Jul 16 00:44:46.798309 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:46.797774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerDied","Data":"0c36e28b25dd5fde849f9f7b9b7f1cf1657c684a5dd21e03ccee42158fcf3ca6"}
Jul 16 00:44:47.626655 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:47.626628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:47.626903 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:47.626730    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:48.627051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.626877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:48.627597 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:48.627100    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:48.627597 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.626957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:48.627597 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:48.627228    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:48.804540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.804514    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:44:48.804903 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.804881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"1f7f7e751a11ceae043da476fdebf5e950d751bd3e87a359180d8bd48b1712ac"}
Jul 16 00:44:48.805136 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.805114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:48.805319 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.805302    2578 scope.go:117] "RemoveContainer" containerID="2e2718266193c772f46682131932c4a1ef540faf36b4275842f15a386bda70e3"
Jul 16 00:44:48.807036 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.807012    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa76d468-c54d-4433-b390-afd258495c35" containerID="48bea5e30d6607e673f8e9684e6f1699310c1ad1e396b4c36d0708319100f844" exitCode=0
Jul 16 00:44:48.807126 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.807048    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerDied","Data":"48bea5e30d6607e673f8e9684e6f1699310c1ad1e396b4c36d0708319100f844"}
Jul 16 00:44:48.822079 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:48.822059    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:49.626023 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.625991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:49.626161 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:49.626091    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:49.813322 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.813302    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:44:49.813735 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.813714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" event={"ID":"e513803d-327c-4deb-973b-600531818aab","Type":"ContainerStarted","Data":"cc357843bc8e0eecd094252abb665717baa6ec66020c1b0054572c0358b172b4"}
Jul 16 00:44:49.813995 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.813977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:49.814093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.814058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:49.828371 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.828354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:44:49.844772 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:49.844722    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt" podStartSLOduration=11.08049029 podStartE2EDuration="30.844706695s" totalImagesPullingTime="19.764216405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:49.843879428 +0000 UTC m=+31.766703315" watchObservedRunningTime="2026-07-16 00:44:49.844706695 +0000 UTC m=+31.767530563"
Jul 16 00:44:50.228785 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.228588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6t24c"]
Jul 16 00:44:50.228968 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.228896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:50.229029 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:50.228996    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:50.229335 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.229311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjhq2"]
Jul 16 00:44:50.229424 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.229414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:50.229545 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:50.229526    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:50.230532 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.230509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxfjl"]
Jul 16 00:44:50.230616 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.230588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:50.230702 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:50.230659    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:50.818305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.818275    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa76d468-c54d-4433-b390-afd258495c35" containerID="51d117e83f64424b17c17451d4b06eb6c5b20b0aaf388d155bfc44942f6ec975" exitCode=0
Jul 16 00:44:50.818752 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:50.818370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerDied","Data":"51d117e83f64424b17c17451d4b06eb6c5b20b0aaf388d155bfc44942f6ec975"}
Jul 16 00:44:51.626033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:51.625998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:51.626033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:51.626037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:51.626286 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:51.626064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:51.626286 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:51.626203    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:51.626395 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:51.626333    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:51.626450 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:51.626411    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:52.216948 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:52.216913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:52.217489 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.217040    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:52.217489 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.217104    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret podName:22844470-6776-4ac9-8bbb-647de271bf46 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:24.217085267 +0000 UTC m=+66.139909112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret") pod "global-pull-secret-syncer-6t24c" (UID: "22844470-6776-4ac9-8bbb-647de271bf46") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:44:52.318252 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:52.318224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:52.318424 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.318348    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:52.318424 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.318409    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:24.318390406 +0000 UTC m=+66.241214268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:44:52.418824 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:52.418776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:52.418973 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.418927    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:44:52.418973 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.418943    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:44:52.418973 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.418952    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mzqbq for pod openshift-network-diagnostics/network-check-target-jxfjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:52.419094 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:52.418998    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq podName:5dda1769-8a30-45ec-85df-3217080a7eaf nodeName:}" failed. No retries permitted until 2026-07-16 00:45:24.418983852 +0000 UTC m=+66.341807697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzqbq" (UniqueName: "kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq") pod "network-check-target-jxfjl" (UID: "5dda1769-8a30-45ec-85df-3217080a7eaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:44:53.626398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.626369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:53.626398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.626395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:53.626973 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.626391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:53.626973 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:53.626476    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t24c" podUID="22844470-6776-4ac9-8bbb-647de271bf46"
Jul 16 00:44:53.626973 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:53.626567    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfjl" podUID="5dda1769-8a30-45ec-85df-3217080a7eaf"
Jul 16 00:44:53.626973 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:53.626649    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:44:53.888182 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.888113    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeReady"
Jul 16 00:44:53.888335 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.888266    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 00:44:53.942577 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.942548    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d8884f6db-5rptb"]
Jul 16 00:44:53.945103 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.945078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:53.947661 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.947627    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 00:44:53.947812 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.947687    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 00:44:53.947812 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.947712    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pkjn\""
Jul 16 00:44:53.947812 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.947690    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 00:44:53.955485 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.955463    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 00:44:53.962607 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.962588    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8kbnj"]
Jul 16 00:44:53.964590 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.964573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:53.966157 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.966133    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84whq"]
Jul 16 00:44:53.967919 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.967903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:53.968328 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.968311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 00:44:53.968408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.968367    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 00:44:53.968408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.968319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm4s9\""
Jul 16 00:44:53.970454 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.970332    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ggldt\""
Jul 16 00:44:53.970454 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.970355    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 00:44:53.970763 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.970742    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 00:44:53.970867 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.970806    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 00:44:53.977255 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.977238    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d8884f6db-5rptb"]
Jul 16 00:44:53.981455 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.981437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8kbnj"]
Jul 16 00:44:53.982282 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:53.982260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84whq"]
Jul 16 00:44:54.130482 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z69sf\" (UniqueName: \"kubernetes.io/projected/ba6fd493-fc4b-4ebd-a7fd-de201f127040-kube-api-access-z69sf\") pod \"ingress-canary-84whq\" (UID: \"ba6fd493-fc4b-4ebd-a7fd-de201f127040\") " pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.130664 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-config-volume\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.130664 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.130664 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7573db31-0d42-450b-a007-a718f3ce5103-ca-trust-extracted\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.130828 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.130828 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-tmp-dir\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.130828 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnl4g\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-kube-api-access-cnl4g\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.130828 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w4qg\" (UniqueName: \"kubernetes.io/projected/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-kube-api-access-8w4qg\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.130828 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-image-registry-private-configuration\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.131042 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba6fd493-fc4b-4ebd-a7fd-de201f127040-cert\") pod \"ingress-canary-84whq\" (UID: \"ba6fd493-fc4b-4ebd-a7fd-de201f127040\") " pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.131042 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-registry-certificates\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.131042 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-trusted-ca\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.131042 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-installation-pull-secrets\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.131042 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.130957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-bound-sa-token\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.231832 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.231741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.231832 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.231780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-tmp-dir\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.231832 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.231817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnl4g\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-kube-api-access-cnl4g\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232095 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.231911    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:44:54.232095 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.231943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w4qg\" (UniqueName: \"kubernetes.io/projected/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-kube-api-access-8w4qg\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.232095 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.231979    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:44:54.73195919 +0000 UTC m=+36.654783035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:44:54.232095 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-image-registry-private-configuration\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232095 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba6fd493-fc4b-4ebd-a7fd-de201f127040-cert\") pod \"ingress-canary-84whq\" (UID: \"ba6fd493-fc4b-4ebd-a7fd-de201f127040\") " pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.232362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-tmp-dir\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.232362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-registry-certificates\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-trusted-ca\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-installation-pull-secrets\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-bound-sa-token\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z69sf\" (UniqueName: \"kubernetes.io/projected/ba6fd493-fc4b-4ebd-a7fd-de201f127040-kube-api-access-z69sf\") pod \"ingress-canary-84whq\" (UID: \"ba6fd493-fc4b-4ebd-a7fd-de201f127040\") " pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.232673 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-config-volume\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.232721 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.232772 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7573db31-0d42-450b-a007-a718f3ce5103-ca-trust-extracted\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.233093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.233070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-trusted-ca\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.233183 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.233097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7573db31-0d42-450b-a007-a718f3ce5103-ca-trust-extracted\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.233183 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.232660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-registry-certificates\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.233183 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.233147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-config-volume\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.233183 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.233173    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:44:54.233354 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.233187    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:44:54.233354 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.233271    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:54.733253254 +0000 UTC m=+36.656077110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:44:54.236646 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.236622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-installation-pull-secrets\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.236755 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.236712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-image-registry-private-configuration\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.236836 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.236759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba6fd493-fc4b-4ebd-a7fd-de201f127040-cert\") pod \"ingress-canary-84whq\" (UID: \"ba6fd493-fc4b-4ebd-a7fd-de201f127040\") " pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.241457 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.241431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnl4g\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-kube-api-access-cnl4g\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.241638 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.241619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w4qg\" (UniqueName: \"kubernetes.io/projected/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-kube-api-access-8w4qg\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.241638 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.241629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-bound-sa-token\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.242770 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.242747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z69sf\" (UniqueName: \"kubernetes.io/projected/ba6fd493-fc4b-4ebd-a7fd-de201f127040-kube-api-access-z69sf\") pod \"ingress-canary-84whq\" (UID: \"ba6fd493-fc4b-4ebd-a7fd-de201f127040\") " pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.283961 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.283935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84whq"
Jul 16 00:44:54.737243 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.737200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:54.737881 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:54.737262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:54.737881 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.737361    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:44:54.737881 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.737386    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:44:54.737881 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.737411    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:44:54.737881 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.737454    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:55.73743336 +0000 UTC m=+37.660257227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:44:54.737881 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:54.737473    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:44:55.737463827 +0000 UTC m=+37.660287675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:44:55.095814 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.095563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84whq"]
Jul 16 00:44:55.098255 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:44:55.098228    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6fd493_fc4b_4ebd_a7fd_de201f127040.slice/crio-7145f0ddd4f562e138cf124a856142bca5092c629ebd665c37c6c3246f556d73 WatchSource:0}: Error finding container 7145f0ddd4f562e138cf124a856142bca5092c629ebd665c37c6c3246f556d73: Status 404 returned error can't find the container with id 7145f0ddd4f562e138cf124a856142bca5092c629ebd665c37c6c3246f556d73
Jul 16 00:44:55.626247 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.626213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:44:55.626416 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.626330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:44:55.626416 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.626363    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:44:55.629054 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.629035    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 00:44:55.629681 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.629663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 00:44:55.629775 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.629662    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48jwq\""
Jul 16 00:44:55.629859 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.629662    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 00:44:55.629859 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.629663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b92gb\""
Jul 16 00:44:55.629967 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.629664    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 00:44:55.747368 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.747333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:55.747824 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.747403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:55.747824 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:55.747490    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:44:55.747824 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:55.747508    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:44:55.747824 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:55.747560    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:44:55.747824 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:55.747563    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:57.747545228 +0000 UTC m=+39.670369093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:44:55.747824 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:55.747634    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:44:57.747614888 +0000 UTC m=+39.670438735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:44:55.833781 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.833749    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa76d468-c54d-4433-b390-afd258495c35" containerID="2368d2d2ded260de99a613a1530ebec33eac42a1f039070dd238ca4676ee8968" exitCode=0
Jul 16 00:44:55.833956 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.833830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerDied","Data":"2368d2d2ded260de99a613a1530ebec33eac42a1f039070dd238ca4676ee8968"}
Jul 16 00:44:55.835066 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:55.835043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84whq" event={"ID":"ba6fd493-fc4b-4ebd-a7fd-de201f127040","Type":"ContainerStarted","Data":"7145f0ddd4f562e138cf124a856142bca5092c629ebd665c37c6c3246f556d73"}
Jul 16 00:44:56.841387 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:56.841353    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa76d468-c54d-4433-b390-afd258495c35" containerID="e061b19ef73f46e7a3dbf7be3734dd1c05236db6bc9eddad079efb59d63e521c" exitCode=0
Jul 16 00:44:56.841893 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:56.841422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerDied","Data":"e061b19ef73f46e7a3dbf7be3734dd1c05236db6bc9eddad079efb59d63e521c"}
Jul 16 00:44:57.763695 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:57.763658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:44:57.763929 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:57.763708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:44:57.763929 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:57.763827    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:44:57.763929 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:57.763839    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:44:57.763929 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:57.763862    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:44:57.763929 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:57.763915    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:01.7638964 +0000 UTC m=+43.686720269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:44:57.763929 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:44:57.763930    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:45:01.763923845 +0000 UTC m=+43.686747690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:44:57.847100 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:57.847068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcv46" event={"ID":"aa76d468-c54d-4433-b390-afd258495c35","Type":"ContainerStarted","Data":"63a9e792d2a4fcade9d4719752060cecfa40a334e3809c134ef353298950165a"}
Jul 16 00:44:57.848442 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:57.848407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84whq" event={"ID":"ba6fd493-fc4b-4ebd-a7fd-de201f127040","Type":"ContainerStarted","Data":"9e3f9061f72a09d8b026cbdc44d4a74d6f419de4efb8d96e60fd1d6da877c0c6"}
Jul 16 00:44:57.871244 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:57.871199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mcv46" podStartSLOduration=9.03998392 podStartE2EDuration="38.871184804s" totalImagesPullingTime="29.831200884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:57.870003864 +0000 UTC m=+39.792827747" watchObservedRunningTime="2026-07-16 00:44:57.871184804 +0000 UTC m=+39.794008671"
Jul 16 00:44:57.887686 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:44:57.887649    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84whq" podStartSLOduration=2.860427987 podStartE2EDuration="4.887641677s" totalImagesPullingTime="2.02721369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:57.886883018 +0000 UTC m=+39.809706911" watchObservedRunningTime="2026-07-16 00:44:57.887641677 +0000 UTC m=+39.810465543"
Jul 16 00:45:01.791111 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:01.791058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:45:01.791111 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:01.791114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:45:01.791653 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:01.791202    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:45:01.791653 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:01.791207    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:45:01.791653 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:01.791223    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:45:01.791653 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:01.791256    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:45:09.791242262 +0000 UTC m=+51.714066107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:45:01.791653 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:01.791269    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:09.791263504 +0000 UTC m=+51.714087349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:45:09.846375 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:09.846338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:45:09.846375 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:09.846380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:45:09.846885 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:09.846482    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:45:09.846885 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:09.846487    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:45:09.846885 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:09.846504    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:45:09.846885 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:09.846530    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:45:25.846517992 +0000 UTC m=+67.769341837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:45:09.846885 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:09.846549    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:25.846535576 +0000 UTC m=+67.769359426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:45:21.831724 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:21.831691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvzwt"
Jul 16 00:45:23.226277 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.226248    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"]
Jul 16 00:45:23.230814 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.230775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.233993 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.233964    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 00:45:23.234112 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.233964    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 00:45:23.234112 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.233965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 00:45:23.234112 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.233966    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 00:45:23.234112 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.233965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nm9tr\""
Jul 16 00:45:23.240977 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.240956    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"]
Jul 16 00:45:23.339969 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.339939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8433660b-70ec-4821-b933-e01a2f863781-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2\" (UID: \"8433660b-70ec-4821-b933-e01a2f863781\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.340115 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.340004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f45j8\" (UniqueName: \"kubernetes.io/projected/8433660b-70ec-4821-b933-e01a2f863781-kube-api-access-f45j8\") pod \"managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2\" (UID: \"8433660b-70ec-4821-b933-e01a2f863781\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.441268 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.441236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8433660b-70ec-4821-b933-e01a2f863781-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2\" (UID: \"8433660b-70ec-4821-b933-e01a2f863781\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.441402 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.441303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f45j8\" (UniqueName: \"kubernetes.io/projected/8433660b-70ec-4821-b933-e01a2f863781-kube-api-access-f45j8\") pod \"managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2\" (UID: \"8433660b-70ec-4821-b933-e01a2f863781\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.445056 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.445030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8433660b-70ec-4821-b933-e01a2f863781-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2\" (UID: \"8433660b-70ec-4821-b933-e01a2f863781\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.450281 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.450256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f45j8\" (UniqueName: \"kubernetes.io/projected/8433660b-70ec-4821-b933-e01a2f863781-kube-api-access-f45j8\") pod \"managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2\" (UID: \"8433660b-70ec-4821-b933-e01a2f863781\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.550110 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.550083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"
Jul 16 00:45:23.666013 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.665984    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2"]
Jul 16 00:45:23.669104 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:45:23.669079    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8433660b_70ec_4821_b933_e01a2f863781.slice/crio-f7d6820e85f1417c68e2214847bb6a29048541261287e793d28a8f80a2a83a81 WatchSource:0}: Error finding container f7d6820e85f1417c68e2214847bb6a29048541261287e793d28a8f80a2a83a81: Status 404 returned error can't find the container with id f7d6820e85f1417c68e2214847bb6a29048541261287e793d28a8f80a2a83a81
Jul 16 00:45:23.907198 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:23.907108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2" event={"ID":"8433660b-70ec-4821-b933-e01a2f863781","Type":"ContainerStarted","Data":"f7d6820e85f1417c68e2214847bb6a29048541261287e793d28a8f80a2a83a81"}
Jul 16 00:45:24.247083 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.246997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:45:24.249897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.249876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 00:45:24.259206 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.259186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22844470-6776-4ac9-8bbb-647de271bf46-original-pull-secret\") pod \"global-pull-secret-syncer-6t24c\" (UID: \"22844470-6776-4ac9-8bbb-647de271bf46\") " pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:45:24.347707 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.347672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:45:24.350498 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.350480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 00:45:24.358768 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:24.358751    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 00:45:24.358827 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:24.358819    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:46:28.358788002 +0000 UTC m=+130.281611848 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : secret "metrics-daemon-secret" not found
Jul 16 00:45:24.449054 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.449022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:45:24.451692 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.451674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t24c"
Jul 16 00:45:24.451969 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.451951    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 00:45:24.462597 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.462577    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 00:45:24.472908 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.472882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzqbq\" (UniqueName: \"kubernetes.io/projected/5dda1769-8a30-45ec-85df-3217080a7eaf-kube-api-access-mzqbq\") pod \"network-check-target-jxfjl\" (UID: \"5dda1769-8a30-45ec-85df-3217080a7eaf\") " pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:45:24.571854 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.571823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6t24c"]
Jul 16 00:45:24.575245 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:45:24.575206    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22844470_6776_4ac9_8bbb_647de271bf46.slice/crio-c0970c556766f5f564061fc9ead0a2d511ca37d80c7e4b270a3c7a7ae193a9fe WatchSource:0}: Error finding container c0970c556766f5f564061fc9ead0a2d511ca37d80c7e4b270a3c7a7ae193a9fe: Status 404 returned error can't find the container with id c0970c556766f5f564061fc9ead0a2d511ca37d80c7e4b270a3c7a7ae193a9fe
Jul 16 00:45:24.741046 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.741016    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48jwq\""
Jul 16 00:45:24.749258 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.749189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:45:24.911293 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.911225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxfjl"]
Jul 16 00:45:24.912412 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:24.912354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6t24c" event={"ID":"22844470-6776-4ac9-8bbb-647de271bf46","Type":"ContainerStarted","Data":"c0970c556766f5f564061fc9ead0a2d511ca37d80c7e4b270a3c7a7ae193a9fe"}
Jul 16 00:45:24.915966 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:45:24.915938    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dda1769_8a30_45ec_85df_3217080a7eaf.slice/crio-82d07abf1444f03e076f17cfa0ebea85ac2d2d0edffc57d8cf1ab799ee4d746e WatchSource:0}: Error finding container 82d07abf1444f03e076f17cfa0ebea85ac2d2d0edffc57d8cf1ab799ee4d746e: Status 404 returned error can't find the container with id 82d07abf1444f03e076f17cfa0ebea85ac2d2d0edffc57d8cf1ab799ee4d746e
Jul 16 00:45:25.858088 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:25.858047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:45:25.858552 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:25.858113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:45:25.858552 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:25.858222    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:45:25.858552 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:25.858248    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:45:25.858552 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:25.858278    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:45:25.858552 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:25.858316    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:57.858295007 +0000 UTC m=+99.781118855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:45:25.858552 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:25.858337    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:45:57.85832687 +0000 UTC m=+99.781150717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:45:25.917132 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:25.917095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxfjl" event={"ID":"5dda1769-8a30-45ec-85df-3217080a7eaf","Type":"ContainerStarted","Data":"82d07abf1444f03e076f17cfa0ebea85ac2d2d0edffc57d8cf1ab799ee4d746e"}
Jul 16 00:45:29.928362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.928260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2" event={"ID":"8433660b-70ec-4821-b933-e01a2f863781","Type":"ContainerStarted","Data":"b93558113406bb7b15878cb5f8daf418b4e939762c595fb0b9d86f7500cbfbbd"}
Jul 16 00:45:29.929910 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.929883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxfjl" event={"ID":"5dda1769-8a30-45ec-85df-3217080a7eaf","Type":"ContainerStarted","Data":"074e826c6d1f3844ae709f529efbc362a6fb5f3dce9f3351683058551494ebd2"}
Jul 16 00:45:29.930047 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.929943    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:45:29.931274 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.931253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6t24c" event={"ID":"22844470-6776-4ac9-8bbb-647de271bf46","Type":"ContainerStarted","Data":"3a82ca2066f35c1743c18ea07af8480ebefdae772a6cbb5d649d1d1780b45922"}
Jul 16 00:45:29.944925 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.944883    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2" podStartSLOduration=0.929758365 podStartE2EDuration="6.944870587s" totalImagesPullingTime="6.015112222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:29.943510854 +0000 UTC m=+71.866334731" watchObservedRunningTime="2026-07-16 00:45:29.944870587 +0000 UTC m=+71.867694454"
Jul 16 00:45:29.959893 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.959851    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jxfjl" podStartSLOduration=66.17927282 podStartE2EDuration="1m10.959838531s" totalImagesPullingTime="4.780565711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:29.958978662 +0000 UTC m=+71.881802553" watchObservedRunningTime="2026-07-16 00:45:29.959838531 +0000 UTC m=+71.882662395"
Jul 16 00:45:29.973969 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:29.973934    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6t24c" podStartSLOduration=65.847669643 podStartE2EDuration="1m10.97391875s" totalImagesPullingTime="5.126249107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:29.973103042 +0000 UTC m=+71.895926910" watchObservedRunningTime="2026-07-16 00:45:29.97391875 +0000 UTC m=+71.896742617"
Jul 16 00:45:57.880636 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:57.880521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:45:57.880636 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:45:57.880563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:45:57.881147 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:57.880664    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:45:57.881147 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:57.880672    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:45:57.881147 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:57.880692    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:45:57.881147 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:57.880723    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:47:01.880709489 +0000 UTC m=+163.803533334 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:45:57.881147 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:45:57.880771    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:47:01.880752613 +0000 UTC m=+163.803576472 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:46:00.936607 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:46:00.936577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxfjl"
Jul 16 00:46:28.395806 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:46:28.395743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:46:28.396277 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:46:28.395894    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 00:46:28.396277 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:46:28.395956    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:30.395940781 +0000 UTC m=+252.318764626 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : secret "metrics-daemon-secret" not found
Jul 16 00:46:56.957400 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:46:56.957357    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb" podUID="7573db31-0d42-450b-a007-a718f3ce5103"
Jul 16 00:46:56.975527 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:46:56.975496    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8kbnj" podUID="0cdc85b9-99ca-4e10-a269-5bdfe9e680ca"
Jul 16 00:46:57.140181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:46:57.140157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:46:57.140304 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:46:57.140190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:46:58.646666 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:46:58.646631    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:47:01.922649 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:01.922602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") pod \"image-registry-5d8884f6db-5rptb\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") " pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:47:01.922649 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:01.922646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:47:01.923056 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:47:01.922753    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:47:01.923056 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:47:01.922822    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls podName:0cdc85b9-99ca-4e10-a269-5bdfe9e680ca nodeName:}" failed. No retries permitted until 2026-07-16 00:49:03.922809822 +0000 UTC m=+285.845633680 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls") pod "dns-default-8kbnj" (UID: "0cdc85b9-99ca-4e10-a269-5bdfe9e680ca") : secret "dns-default-metrics-tls" not found
Jul 16 00:47:01.923056 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:47:01.922752    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 00:47:01.923056 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:47:01.922854    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8884f6db-5rptb: secret "image-registry-tls" not found
Jul 16 00:47:01.923056 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:47:01.922910    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls podName:7573db31-0d42-450b-a007-a718f3ce5103 nodeName:}" failed. No retries permitted until 2026-07-16 00:49:03.922896361 +0000 UTC m=+285.845720205 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls") pod "image-registry-5d8884f6db-5rptb" (UID: "7573db31-0d42-450b-a007-a718f3ce5103") : secret "image-registry-tls" not found
Jul 16 00:47:13.625980 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:13.625928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:47:30.219181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:30.219084    2578 generic.go:356] "Generic (PLEG): container finished" podID="8433660b-70ec-4821-b933-e01a2f863781" containerID="b93558113406bb7b15878cb5f8daf418b4e939762c595fb0b9d86f7500cbfbbd" exitCode=255
Jul 16 00:47:30.219181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:30.219158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2" event={"ID":"8433660b-70ec-4821-b933-e01a2f863781","Type":"ContainerDied","Data":"b93558113406bb7b15878cb5f8daf418b4e939762c595fb0b9d86f7500cbfbbd"}
Jul 16 00:47:30.224972 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:30.224952    2578 scope.go:117] "RemoveContainer" containerID="b93558113406bb7b15878cb5f8daf418b4e939762c595fb0b9d86f7500cbfbbd"
Jul 16 00:47:31.227567 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:47:31.227531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579b8b7dc4-x9nv2" event={"ID":"8433660b-70ec-4821-b933-e01a2f863781","Type":"ContainerStarted","Data":"f7476de1bf1091e7c66944e94e73c5d4349c8c4638fa22e6b87cdd3fcdbdbe7e"}
Jul 16 00:48:30.077483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.077424    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-r77qh"]
Jul 16 00:48:30.079635 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.079617    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"]
Jul 16 00:48:30.079736 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.079718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.081558 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.081539    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-kpmvf"]
Jul 16 00:48:30.081666 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.081653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"
Jul 16 00:48:30.082538 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.082517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:48:30.082988 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.082967    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2gf5g\""
Jul 16 00:48:30.083703 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.083097    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 00:48:30.083703 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.082554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 00:48:30.083703 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.083640    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 00:48:30.084752 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.084465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:48:30.084752 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.084499    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 16 00:48:30.086978 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.085099    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4fb59\""
Jul 16 00:48:30.087349 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.087141    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"]
Jul 16 00:48:30.087349 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.087238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.089542 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.089520    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 00:48:30.090084 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.090070    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 16 00:48:30.090319 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.090305    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.090397 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.090376    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6m68s\""
Jul 16 00:48:30.090468 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.090456    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 00:48:30.090539 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.090520    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 16 00:48:30.090912 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.090893    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 00:48:30.093905 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.093889    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:48:30.093998 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.093942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 16 00:48:30.093998 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.093958    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 16 00:48:30.094566 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.094549    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5xgnk\""
Jul 16 00:48:30.098091 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.098073    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"]
Jul 16 00:48:30.098252 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.098234    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 16 00:48:30.102583 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.102563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"]
Jul 16 00:48:30.104724 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.104702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-kpmvf"]
Jul 16 00:48:30.129025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.129001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-r77qh"]
Jul 16 00:48:30.170042 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.170022    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"]
Jul 16 00:48:30.171984 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.171971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.175294 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.175275    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 00:48:30.175544 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.175529    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:48:30.175606 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.175557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 00:48:30.175673 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.175654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hh2jg\""
Jul 16 00:48:30.177331 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.177314    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cb5fd56db-fx8qh"]
Jul 16 00:48:30.178879 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.178861    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 00:48:30.178989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.178973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.183786 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.183768    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"]
Jul 16 00:48:30.185212 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.185196    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 16 00:48:30.185682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.185668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mzxsk\""
Jul 16 00:48:30.194471 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.194454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 16 00:48:30.199939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.199922    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 16 00:48:30.200685 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.200673    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 00:48:30.201711 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.201698    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 00:48:30.205475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.205456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 16 00:48:30.217191 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.217162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cb5fd56db-fx8qh"]
Jul 16 00:48:30.218218 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.218299 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdffg\" (UniqueName: \"kubernetes.io/projected/4a39fba5-407e-4844-bc98-3054f8cbea67-kube-api-access-xdffg\") pod \"volume-data-source-validator-78495597f6-f6ggc\" (UID: \"4a39fba5-407e-4844-bc98-3054f8cbea67\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"
Jul 16 00:48:30.218299 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-trusted-ca\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.218377 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-serving-cert\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.218377 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw7mq\" (UniqueName: \"kubernetes.io/projected/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-kube-api-access-tw7mq\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.218377 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb26k\" (UniqueName: \"kubernetes.io/projected/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-kube-api-access-xb26k\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.218493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-tmp\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.218493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4scnc\" (UniqueName: \"kubernetes.io/projected/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-kube-api-access-4scnc\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.218493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-snapshots\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.218493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-serving-cert\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.218493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-config\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.218636 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.218636 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.218552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.318801 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.318767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdffg\" (UniqueName: \"kubernetes.io/projected/4a39fba5-407e-4844-bc98-3054f8cbea67-kube-api-access-xdffg\") pod \"volume-data-source-validator-78495597f6-f6ggc\" (UID: \"4a39fba5-407e-4844-bc98-3054f8cbea67\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"
Jul 16 00:48:30.318908 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.318810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-trusted-ca\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.318908 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.318844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.318908 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.318862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9f28\" (UniqueName: \"kubernetes.io/projected/2f04b6ee-46d2-4270-bb18-27c09be9b858-kube-api-access-p9f28\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.319026 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-serving-cert\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.319067 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw7mq\" (UniqueName: \"kubernetes.io/projected/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-kube-api-access-tw7mq\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319067 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.319141 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb26k\" (UniqueName: \"kubernetes.io/projected/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-kube-api-access-xb26k\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.319141 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-tmp\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319288 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4scnc\" (UniqueName: \"kubernetes.io/projected/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-kube-api-access-4scnc\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.319288 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-snapshots\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319288 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-serving-cert\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319288 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.319288 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-config\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm4p2\" (UniqueName: \"kubernetes.io/projected/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-kube-api-access-jm4p2\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-default-certificate\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-stats-auth\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.319889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-tmp\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319889 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.319623    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 00:48:30.319889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-trusted-ca\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.319889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.319844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-snapshots\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.319889 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.319878    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls podName:f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:30.819857343 +0000 UTC m=+252.742681187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls") pod "cluster-samples-operator-65db858894-pk8rr" (UID: "f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42") : secret "samples-operator-tls" not found
Jul 16 00:48:30.320168 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.320132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.320273 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.320227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.320343 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.320292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-config\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.321615 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.321593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-serving-cert\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.321686 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.321623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-serving-cert\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.327531 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.327467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdffg\" (UniqueName: \"kubernetes.io/projected/4a39fba5-407e-4844-bc98-3054f8cbea67-kube-api-access-xdffg\") pod \"volume-data-source-validator-78495597f6-f6ggc\" (UID: \"4a39fba5-407e-4844-bc98-3054f8cbea67\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"
Jul 16 00:48:30.327979 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.327955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw7mq\" (UniqueName: \"kubernetes.io/projected/bc0805a9-c09a-4ed8-a5ad-6e8775a38e70-kube-api-access-tw7mq\") pod \"insights-operator-68d9dd94cf-kpmvf\" (UID: \"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70\") " pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.328047 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.327961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4scnc\" (UniqueName: \"kubernetes.io/projected/7099ab79-8ce0-4762-bfa5-b3ae3d33d65a-kube-api-access-4scnc\") pod \"console-operator-7866497494-r77qh\" (UID: \"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a\") " pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.328508 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.328492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb26k\" (UniqueName: \"kubernetes.io/projected/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-kube-api-access-xb26k\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.392258 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.392239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:30.399858 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.399841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"
Jul 16 00:48:30.408555 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.408530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf"
Jul 16 00:48:30.420658 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.420629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.420758 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.420697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.420758 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.420730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm4p2\" (UniqueName: \"kubernetes.io/projected/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-kube-api-access-jm4p2\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.420897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.420758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-default-certificate\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.420897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.420811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:48:30.420897 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.420849    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 00:48:30.420897 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.420871    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:30.920841362 +0000 UTC m=+252.843665264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : configmap references non-existent config key: service-ca.crt
Jul 16 00:48:30.421107 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.420911    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 00:48:30.421107 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.420941    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:30.92092126 +0000 UTC m=+252.843745107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : secret "router-metrics-certs-default" not found
Jul 16 00:48:30.421107 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.420988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-stats-auth\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.421107 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.421070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.421107 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.421098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9f28\" (UniqueName: \"kubernetes.io/projected/2f04b6ee-46d2-4270-bb18-27c09be9b858-kube-api-access-p9f28\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.421357 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.421145    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs podName:8fd7b54c-919f-48f9-8e14-b37280e324f9 nodeName:}" failed. No retries permitted until 2026-07-16 00:50:32.421124071 +0000 UTC m=+374.343947922 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs") pod "network-metrics-daemon-qjhq2" (UID: "8fd7b54c-919f-48f9-8e14-b37280e324f9") : secret "metrics-daemon-secret" not found
Jul 16 00:48:30.421357 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.421202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.421756 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.421702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.423804 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.423759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.423903 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.423895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-stats-auth\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.423966 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.423910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-default-certificate\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.430377 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.430351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm4p2\" (UniqueName: \"kubernetes.io/projected/3dffb8d6-eb00-4f11-ac83-1f46d79cd485-kube-api-access-jm4p2\") pod \"kube-storage-version-migrator-operator-799cb7f958-769ss\" (UID: \"3dffb8d6-eb00-4f11-ac83-1f46d79cd485\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.430676 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.430656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9f28\" (UniqueName: \"kubernetes.io/projected/2f04b6ee-46d2-4270-bb18-27c09be9b858-kube-api-access-p9f28\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.481481 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.481235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"
Jul 16 00:48:30.538856 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.538659    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-r77qh"]
Jul 16 00:48:30.543636 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:48:30.543581    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7099ab79_8ce0_4762_bfa5_b3ae3d33d65a.slice/crio-33636dd737cd6668f42738987264aefa078c5f7fdcbce6ed594d194e12b60e7a WatchSource:0}: Error finding container 33636dd737cd6668f42738987264aefa078c5f7fdcbce6ed594d194e12b60e7a: Status 404 returned error can't find the container with id 33636dd737cd6668f42738987264aefa078c5f7fdcbce6ed594d194e12b60e7a
Jul 16 00:48:30.553939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.553911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc"]
Jul 16 00:48:30.557184 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:48:30.557159    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a39fba5_407e_4844_bc98_3054f8cbea67.slice/crio-f1d33b683d981334dc25c8f716b250cdcd428f615105441cf30ed649eb680a4a WatchSource:0}: Error finding container f1d33b683d981334dc25c8f716b250cdcd428f615105441cf30ed649eb680a4a: Status 404 returned error can't find the container with id f1d33b683d981334dc25c8f716b250cdcd428f615105441cf30ed649eb680a4a
Jul 16 00:48:30.572881 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.572815    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-kpmvf"]
Jul 16 00:48:30.577273 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:48:30.577241    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0805a9_c09a_4ed8_a5ad_6e8775a38e70.slice/crio-da862b74be151c329ecb4f32c6fadbf8f47aa0fc6864dc4add36903e0ed9ccb0 WatchSource:0}: Error finding container da862b74be151c329ecb4f32c6fadbf8f47aa0fc6864dc4add36903e0ed9ccb0: Status 404 returned error can't find the container with id da862b74be151c329ecb4f32c6fadbf8f47aa0fc6864dc4add36903e0ed9ccb0
Jul 16 00:48:30.621443 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.621417    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss"]
Jul 16 00:48:30.623979 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:48:30.623956    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dffb8d6_eb00_4f11_ac83_1f46d79cd485.slice/crio-ddf9bdd1a8f4a7555c0a2ffca2fc656841b61bf316cf13845de366114196e8a4 WatchSource:0}: Error finding container ddf9bdd1a8f4a7555c0a2ffca2fc656841b61bf316cf13845de366114196e8a4: Status 404 returned error can't find the container with id ddf9bdd1a8f4a7555c0a2ffca2fc656841b61bf316cf13845de366114196e8a4
Jul 16 00:48:30.825533 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.825497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:30.825704 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.825627    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 00:48:30.825704 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.825683    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls podName:f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:31.825668757 +0000 UTC m=+253.748492605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls") pod "cluster-samples-operator-65db858894-pk8rr" (UID: "f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42") : secret "samples-operator-tls" not found
Jul 16 00:48:30.926704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.926627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.926704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:30.926691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:30.926956 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.926814    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:31.926774776 +0000 UTC m=+253.849598622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : configmap references non-existent config key: service-ca.crt
Jul 16 00:48:30.926956 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.926875    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 00:48:30.926956 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:30.926951    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:31.926932738 +0000 UTC m=+253.849756583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : secret "router-metrics-certs-default" not found
Jul 16 00:48:31.387624 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.387542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss" event={"ID":"3dffb8d6-eb00-4f11-ac83-1f46d79cd485","Type":"ContainerStarted","Data":"ddf9bdd1a8f4a7555c0a2ffca2fc656841b61bf316cf13845de366114196e8a4"}
Jul 16 00:48:31.389366 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.389307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc" event={"ID":"4a39fba5-407e-4844-bc98-3054f8cbea67","Type":"ContainerStarted","Data":"f1d33b683d981334dc25c8f716b250cdcd428f615105441cf30ed649eb680a4a"}
Jul 16 00:48:31.391036 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.391009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-r77qh" event={"ID":"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a","Type":"ContainerStarted","Data":"33636dd737cd6668f42738987264aefa078c5f7fdcbce6ed594d194e12b60e7a"}
Jul 16 00:48:31.393306 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.393105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf" event={"ID":"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70","Type":"ContainerStarted","Data":"da862b74be151c329ecb4f32c6fadbf8f47aa0fc6864dc4add36903e0ed9ccb0"}
Jul 16 00:48:31.837094 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.837019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:31.837266 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:31.837165    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 00:48:31.837266 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:31.837232    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls podName:f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:33.837213928 +0000 UTC m=+255.760037778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls") pod "cluster-samples-operator-65db858894-pk8rr" (UID: "f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42") : secret "samples-operator-tls" not found
Jul 16 00:48:31.938254 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.938165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:31.938254 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:31.938231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:31.938475 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:31.938361    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 00:48:31.938475 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:31.938395    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:33.938375169 +0000 UTC m=+255.861199015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : configmap references non-existent config key: service-ca.crt
Jul 16 00:48:31.938475 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:31.938420    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:33.938410972 +0000 UTC m=+255.861234821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : secret "router-metrics-certs-default" not found
Jul 16 00:48:32.398092 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:32.398053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc" event={"ID":"4a39fba5-407e-4844-bc98-3054f8cbea67","Type":"ContainerStarted","Data":"9abb0bf1f841fce424ddd7ce69cd0d7e30c8abb8d8f5e91be7571f4e5d917ce8"}
Jul 16 00:48:32.416059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:32.416009    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-f6ggc" podStartSLOduration=1.305361653 podStartE2EDuration="2.415995114s" totalImagesPullingTime="1.110633461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:32.41465404 +0000 UTC m=+254.337477907" watchObservedRunningTime="2026-07-16 00:48:32.415995114 +0000 UTC m=+254.338818958"
Jul 16 00:48:33.855174 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:33.855144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:33.855605 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:33.855285    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 00:48:33.855605 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:33.855360    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls podName:f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:37.855340543 +0000 UTC m=+259.778164403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls") pod "cluster-samples-operator-65db858894-pk8rr" (UID: "f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42") : secret "samples-operator-tls" not found
Jul 16 00:48:33.956154 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:33.956118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:33.956323 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:33.956173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:33.956323 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:33.956289    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:37.95627107 +0000 UTC m=+259.879094915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : configmap references non-existent config key: service-ca.crt
Jul 16 00:48:33.956323 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:33.956293    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 00:48:33.956437 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:33.956328    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:37.956322017 +0000 UTC m=+259.879145863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : secret "router-metrics-certs-default" not found
Jul 16 00:48:34.406180 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.406146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss" event={"ID":"3dffb8d6-eb00-4f11-ac83-1f46d79cd485","Type":"ContainerStarted","Data":"03ce42837d6b79d5bc46853ff9f24aa34dbd8d82f653dd38d47f5a115ff27a81"}
Jul 16 00:48:34.407710 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.407689    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/0.log"
Jul 16 00:48:34.407870 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.407726    2578 generic.go:356] "Generic (PLEG): container finished" podID="7099ab79-8ce0-4762-bfa5-b3ae3d33d65a" containerID="60ac8cd5aea32aa20d99d9fbe966a2011cce3bd57af97807f4b7702ed5e4a5ce" exitCode=255
Jul 16 00:48:34.407870 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.407821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-r77qh" event={"ID":"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a","Type":"ContainerDied","Data":"60ac8cd5aea32aa20d99d9fbe966a2011cce3bd57af97807f4b7702ed5e4a5ce"}
Jul 16 00:48:34.407999 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.407984    2578 scope.go:117] "RemoveContainer" containerID="60ac8cd5aea32aa20d99d9fbe966a2011cce3bd57af97807f4b7702ed5e4a5ce"
Jul 16 00:48:34.409365 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.409338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf" event={"ID":"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70","Type":"ContainerStarted","Data":"dcb0a71021f0e13c618d2242d7c656e49b928fd801c7b6c6eb185a3bbb8eeedf"}
Jul 16 00:48:34.424967 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:34.424920    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss" podStartSLOduration=1.554559372 podStartE2EDuration="4.424902261s" totalImagesPullingTime="2.870342889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:34.424027797 +0000 UTC m=+256.346851665" watchObservedRunningTime="2026-07-16 00:48:34.424902261 +0000 UTC m=+256.347726129"
Jul 16 00:48:35.181402 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.181331    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf" podStartSLOduration=2.267266294 podStartE2EDuration="5.181307507s" totalImagesPullingTime="2.914041213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:34.4605779 +0000 UTC m=+256.383401773" watchObservedRunningTime="2026-07-16 00:48:35.181307507 +0000 UTC m=+257.104131375"
Jul 16 00:48:35.182250 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.182220    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4ddvq"]
Jul 16 00:48:35.184471 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.184455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.186519 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.186497    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vt48n\""
Jul 16 00:48:35.186599 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.186500    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 00:48:35.186599 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.186579    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 00:48:35.195116 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.195096    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4ddvq"]
Jul 16 00:48:35.369274 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.369243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae57c2bb-c9f0-4051-988c-086cf5f33ded-crio-socket\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.369504 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.369299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgnr2\" (UniqueName: \"kubernetes.io/projected/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-api-access-tgnr2\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.369504 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.369377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.369504 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.369432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.369504 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.369471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae57c2bb-c9f0-4051-988c-086cf5f33ded-data-volume\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.414490 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.414465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:48:35.414860 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.414846    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/0.log"
Jul 16 00:48:35.414921 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.414880    2578 generic.go:356] "Generic (PLEG): container finished" podID="7099ab79-8ce0-4762-bfa5-b3ae3d33d65a" containerID="2278dfa160508eca4e5bee8f7df729febd07029d55cbb6e887b763793bdd4e23" exitCode=255
Jul 16 00:48:35.414974 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.414957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-r77qh" event={"ID":"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a","Type":"ContainerDied","Data":"2278dfa160508eca4e5bee8f7df729febd07029d55cbb6e887b763793bdd4e23"}
Jul 16 00:48:35.415032 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.415019    2578 scope.go:117] "RemoveContainer" containerID="60ac8cd5aea32aa20d99d9fbe966a2011cce3bd57af97807f4b7702ed5e4a5ce"
Jul 16 00:48:35.415270 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.415185    2578 scope.go:117] "RemoveContainer" containerID="2278dfa160508eca4e5bee8f7df729febd07029d55cbb6e887b763793bdd4e23"
Jul 16 00:48:35.415399 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.415374    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-r77qh_openshift-console-operator(7099ab79-8ce0-4762-bfa5-b3ae3d33d65a)\"" pod="openshift-console-operator/console-operator-7866497494-r77qh" podUID="7099ab79-8ce0-4762-bfa5-b3ae3d33d65a"
Jul 16 00:48:35.470779 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.470722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae57c2bb-c9f0-4051-988c-086cf5f33ded-data-volume\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.470910 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.470784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae57c2bb-c9f0-4051-988c-086cf5f33ded-crio-socket\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.470910 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.470849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgnr2\" (UniqueName: \"kubernetes.io/projected/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-api-access-tgnr2\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.470910 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.470889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.471053 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.470911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.471053 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.470920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae57c2bb-c9f0-4051-988c-086cf5f33ded-crio-socket\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.471053 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.470987    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:48:35.471053 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.471033    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.971020338 +0000 UTC m=+257.893844182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : configmap "kube-rbac-proxy" not found
Jul 16 00:48:35.471053 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.471031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae57c2bb-c9f0-4051-988c-086cf5f33ded-data-volume\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.471053 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.471037    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:35.471265 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.471092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.971074981 +0000 UTC m=+257.893898842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:35.479768 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.479742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgnr2\" (UniqueName: \"kubernetes.io/projected/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-api-access-tgnr2\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.975934 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.975902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.975934 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:35.975934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:35.976123 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.976055    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:48:35.976123 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.976059    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:35.976123 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.976106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:36.97609304 +0000 UTC m=+258.898916884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : configmap "kube-rbac-proxy" not found
Jul 16 00:48:35.976123 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:35.976118    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:36.976112465 +0000 UTC m=+258.898936310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:36.419371 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:36.419345    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:48:36.419739 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:36.419650    2578 scope.go:117] "RemoveContainer" containerID="2278dfa160508eca4e5bee8f7df729febd07029d55cbb6e887b763793bdd4e23"
Jul 16 00:48:36.419825 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:36.419787    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-r77qh_openshift-console-operator(7099ab79-8ce0-4762-bfa5-b3ae3d33d65a)\"" pod="openshift-console-operator/console-operator-7866497494-r77qh" podUID="7099ab79-8ce0-4762-bfa5-b3ae3d33d65a"
Jul 16 00:48:36.983653 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:36.983616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:36.983653 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:36.983652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:36.983863 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:36.983743    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:48:36.983863 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:36.983812    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:38.983777976 +0000 UTC m=+260.906601821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : configmap "kube-rbac-proxy" not found
Jul 16 00:48:36.983935 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:36.983860    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:36.983935 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:36.983908    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:38.983895637 +0000 UTC m=+260.906719501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:37.164200 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:37.164174    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ggd7_bc3b94c1-ffa7-4a33-a4b3-1a58d545c186/dns-node-resolver/0.log"
Jul 16 00:48:37.893642 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:37.893584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:37.894188 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:37.893751    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 00:48:37.894188 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:37.893865    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls podName:f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:45.893840755 +0000 UTC m=+267.816664614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls") pod "cluster-samples-operator-65db858894-pk8rr" (UID: "f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42") : secret "samples-operator-tls" not found
Jul 16 00:48:37.953885 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:37.953857    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h8jgz_ba6772b7-dafe-4bcc-ac65-8385c85b1644/node-ca/0.log"
Jul 16 00:48:37.994361 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:37.994317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:37.994361 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:37.994373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:37.994588 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:37.994475    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:45.994459354 +0000 UTC m=+267.917283202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : configmap references non-existent config key: service-ca.crt
Jul 16 00:48:37.994588 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:37.994535    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 00:48:37.994674 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:37.994606    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:45.994590343 +0000 UTC m=+267.917414209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : secret "router-metrics-certs-default" not found
Jul 16 00:48:38.754101 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:38.754077    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84whq_ba6fd493-fc4b-4ebd-a7fd-de201f127040/serve-healthcheck-canary/0.log"
Jul 16 00:48:39.001439 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:39.001406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:39.001439 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:39.001443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:39.001939 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:39.001569    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:48:39.001939 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:39.001575    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:39.001939 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:39.001621    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:43.001607773 +0000 UTC m=+264.924431618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : configmap "kube-rbac-proxy" not found
Jul 16 00:48:39.001939 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:39.001644    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:43.001626939 +0000 UTC m=+264.924450784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:40.392954 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:40.392861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:40.392954 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:40.392928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:40.393350 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:40.393269    2578 scope.go:117] "RemoveContainer" containerID="2278dfa160508eca4e5bee8f7df729febd07029d55cbb6e887b763793bdd4e23"
Jul 16 00:48:40.393438 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:40.393417    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-r77qh_openshift-console-operator(7099ab79-8ce0-4762-bfa5-b3ae3d33d65a)\"" pod="openshift-console-operator/console-operator-7866497494-r77qh" podUID="7099ab79-8ce0-4762-bfa5-b3ae3d33d65a"
Jul 16 00:48:43.036822 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:43.036775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:43.036822 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:43.036823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:43.037265 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:43.036921    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:43.037265 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:43.036944    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:48:43.037265 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:43.036984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:51.036968862 +0000 UTC m=+272.959792706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:48:43.037265 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:43.036998    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm podName:ae57c2bb-c9f0-4051-988c-086cf5f33ded nodeName:}" failed. No retries permitted until 2026-07-16 00:48:51.036992146 +0000 UTC m=+272.959815991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4ddvq" (UID: "ae57c2bb-c9f0-4051-988c-086cf5f33ded") : configmap "kube-rbac-proxy" not found
Jul 16 00:48:45.959302 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:45.959268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:45.961510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:45.961492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pk8rr\" (UID: \"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:46.013017 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:46.012993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"
Jul 16 00:48:46.060666 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:46.060635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:46.060826 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:46.060705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:46.060891 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:46.060871    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle podName:2f04b6ee-46d2-4270-bb18-27c09be9b858 nodeName:}" failed. No retries permitted until 2026-07-16 00:49:02.060849894 +0000 UTC m=+283.983673757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle") pod "router-default-5cb5fd56db-fx8qh" (UID: "2f04b6ee-46d2-4270-bb18-27c09be9b858") : configmap references non-existent config key: service-ca.crt
Jul 16 00:48:46.063221 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:46.063193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f04b6ee-46d2-4270-bb18-27c09be9b858-metrics-certs\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:48:46.133412 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:46.133382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr"]
Jul 16 00:48:46.450545 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:46.450512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr" event={"ID":"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42","Type":"ContainerStarted","Data":"58769a1888ca27cff5522b1e00544320a0762182881d59c1b7c3225f30ef2268"}
Jul 16 00:48:48.459174 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:48.459142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr" event={"ID":"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42","Type":"ContainerStarted","Data":"056a7d2ab696319a6aaf11ac106267ed20ff237f762e28a0afc9e46e2c5c092f"}
Jul 16 00:48:48.459532 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:48.459193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr" event={"ID":"f1c88d9f-411d-4c5c-9a7e-e1e6780a3d42","Type":"ContainerStarted","Data":"4f7929641b7a86e96b43cd368c7a5a27f82c7d6cfdf72eed2e3d8452dfe8229c"}
Jul 16 00:48:48.482765 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:48.482725    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pk8rr" podStartSLOduration=16.789500351 podStartE2EDuration="18.48271124s" totalImagesPullingTime="1.693210889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:48.48190858 +0000 UTC m=+270.404732449" watchObservedRunningTime="2026-07-16 00:48:48.48271124 +0000 UTC m=+270.405535107"
Jul 16 00:48:51.103255 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:51.103219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:51.103834 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:51.103295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:51.103834 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:51.103667    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae57c2bb-c9f0-4051-988c-086cf5f33ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:51.105558 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:51.105536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae57c2bb-c9f0-4051-988c-086cf5f33ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4ddvq\" (UID: \"ae57c2bb-c9f0-4051-988c-086cf5f33ded\") " pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:51.393642 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:51.393546    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4ddvq"
Jul 16 00:48:51.517778 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:51.517748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4ddvq"]
Jul 16 00:48:51.520882 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:48:51.520853    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae57c2bb_c9f0_4051_988c_086cf5f33ded.slice/crio-36f1c7cfcb5f6e4323bbf382f108ed6fc277a4375c3227bb308850c9af3688c5 WatchSource:0}: Error finding container 36f1c7cfcb5f6e4323bbf382f108ed6fc277a4375c3227bb308850c9af3688c5: Status 404 returned error can't find the container with id 36f1c7cfcb5f6e4323bbf382f108ed6fc277a4375c3227bb308850c9af3688c5
Jul 16 00:48:52.475148 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:52.475066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4ddvq" event={"ID":"ae57c2bb-c9f0-4051-988c-086cf5f33ded","Type":"ContainerStarted","Data":"36f1c7cfcb5f6e4323bbf382f108ed6fc277a4375c3227bb308850c9af3688c5"}
Jul 16 00:48:53.626265 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:53.626238    2578 scope.go:117] "RemoveContainer" containerID="2278dfa160508eca4e5bee8f7df729febd07029d55cbb6e887b763793bdd4e23"
Jul 16 00:48:54.484349 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:54.484324    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:48:54.484534 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:54.484403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-r77qh" event={"ID":"7099ab79-8ce0-4762-bfa5-b3ae3d33d65a","Type":"ContainerStarted","Data":"3a795db675c3ae5f7512523aa3d96c2cbd1aca22b877b2c2450162cf3694e931"}
Jul 16 00:48:54.484758 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:54.484734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:54.490550 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:54.490526    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-r77qh"
Jul 16 00:48:54.508477 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:54.508425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-r77qh" podStartSLOduration=21.564106996 podStartE2EDuration="24.508410566s" totalImagesPullingTime="2.94430357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:54.508056873 +0000 UTC m=+276.430880740" watchObservedRunningTime="2026-07-16 00:48:54.508410566 +0000 UTC m=+276.431234437"
Jul 16 00:48:54.730398 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:54.730372    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d8884f6db-5rptb"]
Jul 16 00:48:54.730771 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:48:54.730601    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb" podUID="7573db31-0d42-450b-a007-a718f3ce5103"
Jul 16 00:48:55.488325 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.488296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:48:55.518704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.518663    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:48:55.643866 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.643827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnl4g\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-kube-api-access-cnl4g\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.643888    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7573db31-0d42-450b-a007-a718f3ce5103-ca-trust-extracted\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.643913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-trusted-ca\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.643951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-installation-pull-secrets\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.643982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-image-registry-private-configuration\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644033 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.644020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-registry-certificates\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644297 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.644043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-bound-sa-token\") pod \"7573db31-0d42-450b-a007-a718f3ce5103\" (UID: \"7573db31-0d42-450b-a007-a718f3ce5103\") "
Jul 16 00:48:55.644297 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.644247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7573db31-0d42-450b-a007-a718f3ce5103-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:48:55.644656 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.644606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:48:55.644778 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.644651    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:48:55.646675 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.646606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:48:55.646836 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.646778    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-kube-api-access-cnl4g" (OuterVolumeSpecName: "kube-api-access-cnl4g") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "kube-api-access-cnl4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:48:55.646836 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.646806    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:48:55.646949 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.646886    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7573db31-0d42-450b-a007-a718f3ce5103" (UID: "7573db31-0d42-450b-a007-a718f3ce5103"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:48:55.745121 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745039    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnl4g\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-kube-api-access-cnl4g\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:55.745121 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745076    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7573db31-0d42-450b-a007-a718f3ce5103-ca-trust-extracted\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:55.745121 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745092    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-trusted-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:55.745121 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745106    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-installation-pull-secrets\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:55.745121 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745122    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7573db31-0d42-450b-a007-a718f3ce5103-image-registry-private-configuration\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:55.745643 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745133    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7573db31-0d42-450b-a007-a718f3ce5103-registry-certificates\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:55.745643 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:55.745146    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-bound-sa-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:56.491390 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:56.491355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8884f6db-5rptb"
Jul 16 00:48:56.534075 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:56.534046    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d8884f6db-5rptb"]
Jul 16 00:48:56.539559 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:56.539534    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d8884f6db-5rptb"]
Jul 16 00:48:56.630783 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:56.630747    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7573db31-0d42-450b-a007-a718f3ce5103" path="/var/lib/kubelet/pods/7573db31-0d42-450b-a007-a718f3ce5103/volumes"
Jul 16 00:48:56.653471 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:56.653438    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7573db31-0d42-450b-a007-a718f3ce5103-registry-tls\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:48:57.497633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:48:57.497596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4ddvq" event={"ID":"ae57c2bb-c9f0-4051-988c-086cf5f33ded","Type":"ContainerStarted","Data":"f023af050c13d97b532269f356f0a5275078c610dfe1b11a3fa298257a5de95d"}
Jul 16 00:49:00.140536 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:00.140512    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8kbnj" podUID="0cdc85b9-99ca-4e10-a269-5bdfe9e680ca"
Jul 16 00:49:00.511835 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:00.511480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:49:00.511835 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:00.511748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4ddvq" event={"ID":"ae57c2bb-c9f0-4051-988c-086cf5f33ded","Type":"ContainerStarted","Data":"07ed96355c67c2edff00707ecf298c9b9d7138cdbba162be6b08441e5e7d27ad"}
Jul 16 00:49:02.094088 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:02.094043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:02.094879 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:02.094848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f04b6ee-46d2-4270-bb18-27c09be9b858-service-ca-bundle\") pod \"router-default-5cb5fd56db-fx8qh\" (UID: \"2f04b6ee-46d2-4270-bb18-27c09be9b858\") " pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:02.287256 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:02.287217    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:03.775152 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:03.775125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cb5fd56db-fx8qh"]
Jul 16 00:49:03.777489 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:03.777469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f04b6ee_46d2_4270_bb18_27c09be9b858.slice/crio-98bcf666b48444848c5d4d4cc82748dac72a118700a9d46a472fb4c39e23b0ac WatchSource:0}: Error finding container 98bcf666b48444848c5d4d4cc82748dac72a118700a9d46a472fb4c39e23b0ac: Status 404 returned error can't find the container with id 98bcf666b48444848c5d4d4cc82748dac72a118700a9d46a472fb4c39e23b0ac
Jul 16 00:49:04.009951 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.009881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:49:04.012004 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.011976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cdc85b9-99ca-4e10-a269-5bdfe9e680ca-metrics-tls\") pod \"dns-default-8kbnj\" (UID: \"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca\") " pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:49:04.114497 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.114462    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm4s9\""
Jul 16 00:49:04.122424 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.122403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:49:04.248780 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.248751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8kbnj"]
Jul 16 00:49:04.252426 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:04.252401    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdc85b9_99ca_4e10_a269_5bdfe9e680ca.slice/crio-386081098b06226de31cdc81fa4dfc7e1bef6d3203ac20ffe095f4871d2fa8da WatchSource:0}: Error finding container 386081098b06226de31cdc81fa4dfc7e1bef6d3203ac20ffe095f4871d2fa8da: Status 404 returned error can't find the container with id 386081098b06226de31cdc81fa4dfc7e1bef6d3203ac20ffe095f4871d2fa8da
Jul 16 00:49:04.525838 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.525775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8kbnj" event={"ID":"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca","Type":"ContainerStarted","Data":"386081098b06226de31cdc81fa4dfc7e1bef6d3203ac20ffe095f4871d2fa8da"}
Jul 16 00:49:04.527654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.527632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4ddvq" event={"ID":"ae57c2bb-c9f0-4051-988c-086cf5f33ded","Type":"ContainerStarted","Data":"53db9b9f5c05c0daeea7ed82c3351454afb424f4d00ccd215d2b842a9959b46b"}
Jul 16 00:49:04.529095 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.529068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh" event={"ID":"2f04b6ee-46d2-4270-bb18-27c09be9b858","Type":"ContainerStarted","Data":"ab690c6c6df8000e2fc8fa6a74f988503b3c8638f77fd45e09c0b5d80eebe976"}
Jul 16 00:49:04.529194 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.529114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh" event={"ID":"2f04b6ee-46d2-4270-bb18-27c09be9b858","Type":"ContainerStarted","Data":"98bcf666b48444848c5d4d4cc82748dac72a118700a9d46a472fb4c39e23b0ac"}
Jul 16 00:49:04.553410 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.553351    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4ddvq" podStartSLOduration=17.488305748 podStartE2EDuration="29.553334073s" totalImagesPullingTime="12.065028325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:48:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:04.551728742 +0000 UTC m=+286.474552609" watchObservedRunningTime="2026-07-16 00:49:04.553334073 +0000 UTC m=+286.476157940"
Jul 16 00:49:04.573928 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.573882    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh" podStartSLOduration=34.573870251 podStartE2EDuration="34.573870251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:04.573280863 +0000 UTC m=+286.496104755" watchObservedRunningTime="2026-07-16 00:49:04.573870251 +0000 UTC m=+286.496694117"
Jul 16 00:49:04.593742 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.593715    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75f9459d78-kcfms"]
Jul 16 00:49:04.598025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.598008    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.600804 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.600774    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 00:49:04.600894 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.600808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2sqss\""
Jul 16 00:49:04.600894 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.600816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 00:49:04.600894 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.600867    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 00:49:04.600894 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.600867    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 00:49:04.601097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.601071    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 00:49:04.601243 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.601225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 00:49:04.601319 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.601306    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 00:49:04.610981 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.610962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f9459d78-kcfms"]
Jul 16 00:49:04.714450 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.714418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmd25\" (UniqueName: \"kubernetes.io/projected/a5d879dc-5f90-4686-bb9a-5074b4f188e3-kube-api-access-dmd25\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.714633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.714461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-service-ca\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.714633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.714494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-serving-cert\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.714633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.714548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-oauth-serving-cert\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.714633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.714572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-oauth-config\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.714633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.714615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-config\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.815630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.815309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmd25\" (UniqueName: \"kubernetes.io/projected/a5d879dc-5f90-4686-bb9a-5074b4f188e3-kube-api-access-dmd25\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.815630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.815387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-service-ca\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.815630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.815428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-serving-cert\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.815630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.815476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-oauth-serving-cert\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.815630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.815519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-oauth-config\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.815630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.815577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-config\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.816354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.816260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-oauth-serving-cert\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.816354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.816295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-service-ca\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.816354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.816331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-config\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.818493 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.818470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-serving-cert\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.818611 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.818493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-oauth-config\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.824231 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.824207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmd25\" (UniqueName: \"kubernetes.io/projected/a5d879dc-5f90-4686-bb9a-5074b4f188e3-kube-api-access-dmd25\") pod \"console-75f9459d78-kcfms\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") " pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:04.907279 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:04.907251    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:05.057386 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:05.054868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f9459d78-kcfms"]
Jul 16 00:49:05.059916 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:05.059891    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d879dc_5f90_4686_bb9a_5074b4f188e3.slice/crio-8ac322ea3469a143c863bb4b8a85d2448d2595fbf16ee324eef05e437a72210f WatchSource:0}: Error finding container 8ac322ea3469a143c863bb4b8a85d2448d2595fbf16ee324eef05e437a72210f: Status 404 returned error can't find the container with id 8ac322ea3469a143c863bb4b8a85d2448d2595fbf16ee324eef05e437a72210f
Jul 16 00:49:05.287575 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:05.287538    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:05.290408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:05.290385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:05.534104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:05.534065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f9459d78-kcfms" event={"ID":"a5d879dc-5f90-4686-bb9a-5074b4f188e3","Type":"ContainerStarted","Data":"8ac322ea3469a143c863bb4b8a85d2448d2595fbf16ee324eef05e437a72210f"}
Jul 16 00:49:05.534556 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:05.534413    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:05.535608 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:05.535590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cb5fd56db-fx8qh"
Jul 16 00:49:06.539181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:06.539140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8kbnj" event={"ID":"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca","Type":"ContainerStarted","Data":"3416c4aff9e992eb7c8a38576620d7ec53b645776b76f21d034fd7f1bc54723c"}
Jul 16 00:49:06.539643 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:06.539203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8kbnj" event={"ID":"0cdc85b9-99ca-4e10-a269-5bdfe9e680ca","Type":"ContainerStarted","Data":"49fd05ec79638480c3d861f8ca5b7126fc0bd7aba38c712e027639e78973298c"}
Jul 16 00:49:06.562867 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:06.562813    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8kbnj" podStartSLOduration=251.998418946 podStartE2EDuration="4m13.562779467s" totalImagesPullingTime="1.564360521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:06.561470697 +0000 UTC m=+288.484294565" watchObservedRunningTime="2026-07-16 00:49:06.562779467 +0000 UTC m=+288.485603337"
Jul 16 00:49:07.543681 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:07.543642    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:49:08.774680 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.774648    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-mf2rz"]
Jul 16 00:49:08.785391 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.785369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.788896 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.788786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 00:49:08.788896 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.788819    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 00:49:08.788896 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.788858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 00:49:08.788896 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.788868    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 00:49:08.788896 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.788893    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vtmpt\""
Jul 16 00:49:08.789201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.789096    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 00:49:08.789201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.789126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-mf2rz"]
Jul 16 00:49:08.850064 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.850032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024fc01c-ad59-42eb-b9db-b3b639e20e23-metrics-client-ca\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.850227 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.850119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.850227 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.850160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.850227 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.850205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsjs2\" (UniqueName: \"kubernetes.io/projected/024fc01c-ad59-42eb-b9db-b3b639e20e23-kube-api-access-wsjs2\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.950661 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.950632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsjs2\" (UniqueName: \"kubernetes.io/projected/024fc01c-ad59-42eb-b9db-b3b639e20e23-kube-api-access-wsjs2\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.950856 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.950677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024fc01c-ad59-42eb-b9db-b3b639e20e23-metrics-client-ca\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.950856 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.950725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.950856 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.950757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.951040 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:08.950868    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 00:49:08.951040 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:08.950943    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-tls podName:024fc01c-ad59-42eb-b9db-b3b639e20e23 nodeName:}" failed. No retries permitted until 2026-07-16 00:49:09.450924102 +0000 UTC m=+291.373747972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-tls") pod "prometheus-operator-64785b6675-mf2rz" (UID: "024fc01c-ad59-42eb-b9db-b3b639e20e23") : secret "prometheus-operator-tls" not found
Jul 16 00:49:08.951418 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.951396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024fc01c-ad59-42eb-b9db-b3b639e20e23-metrics-client-ca\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.953080 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.953054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:08.961270 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:08.961252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsjs2\" (UniqueName: \"kubernetes.io/projected/024fc01c-ad59-42eb-b9db-b3b639e20e23-kube-api-access-wsjs2\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:09.454644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:09.454606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:09.456982 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:09.456961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024fc01c-ad59-42eb-b9db-b3b639e20e23-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mf2rz\" (UID: \"024fc01c-ad59-42eb-b9db-b3b639e20e23\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:09.551171 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:09.551135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f9459d78-kcfms" event={"ID":"a5d879dc-5f90-4686-bb9a-5074b4f188e3","Type":"ContainerStarted","Data":"f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0"}
Jul 16 00:49:09.570643 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:09.570598    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75f9459d78-kcfms" podStartSLOduration=2.187502419 podStartE2EDuration="5.57058347s" totalImagesPullingTime="3.383081051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:09.569920369 +0000 UTC m=+291.492744262" watchObservedRunningTime="2026-07-16 00:49:09.57058347 +0000 UTC m=+291.493407338"
Jul 16 00:49:09.695029 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:09.694992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz"
Jul 16 00:49:09.817759 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:09.817724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-mf2rz"]
Jul 16 00:49:09.821370 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:09.821336    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024fc01c_ad59_42eb_b9db_b3b639e20e23.slice/crio-0c2efedbd3ead464f5c900acca843d741045df6549938ec4667c89d8a138f89f WatchSource:0}: Error finding container 0c2efedbd3ead464f5c900acca843d741045df6549938ec4667c89d8a138f89f: Status 404 returned error can't find the container with id 0c2efedbd3ead464f5c900acca843d741045df6549938ec4667c89d8a138f89f
Jul 16 00:49:10.555873 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:10.555840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz" event={"ID":"024fc01c-ad59-42eb-b9db-b3b639e20e23","Type":"ContainerStarted","Data":"0c2efedbd3ead464f5c900acca843d741045df6549938ec4667c89d8a138f89f"}
Jul 16 00:49:11.561134 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:11.561043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz" event={"ID":"024fc01c-ad59-42eb-b9db-b3b639e20e23","Type":"ContainerStarted","Data":"f3dc8c29bb9ff7e5bd2be3093155f13eacd584c75be02ed47e98b09d99a03eab"}
Jul 16 00:49:11.561134 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:11.561095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz" event={"ID":"024fc01c-ad59-42eb-b9db-b3b639e20e23","Type":"ContainerStarted","Data":"e81df187f60a7f95021ddc026f97e991052c0b489ff28d86d7714925306efae9"}
Jul 16 00:49:11.581353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:11.581310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-mf2rz" podStartSLOduration=2.130782356 podStartE2EDuration="3.581295336s" totalImagesPullingTime="1.45051298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:11.580147746 +0000 UTC m=+293.502971639" watchObservedRunningTime="2026-07-16 00:49:11.581295336 +0000 UTC m=+293.504119202"
Jul 16 00:49:13.119890 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.119852    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"]
Jul 16 00:49:13.123499 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.123475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.125892 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.125872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 00:49:13.125999 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.125872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 00:49:13.126844 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.126815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-46r4b\""
Jul 16 00:49:13.133596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.133576    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nhcrn"]
Jul 16 00:49:13.136598 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.136583    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.138810 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.138768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 00:49:13.139139 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.139119    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6mwtn\""
Jul 16 00:49:13.139334 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.139122    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 00:49:13.139449 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.139207    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 00:49:13.140529 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.140507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"]
Jul 16 00:49:13.283236 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-tls\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.283417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng44\" (UniqueName: \"kubernetes.io/projected/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-kube-api-access-qng44\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-textfile\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-sys\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.283726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-root\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-metrics-client-ca\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.283726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-wtmp\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.283726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.283637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprq9\" (UniqueName: \"kubernetes.io/projected/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-kube-api-access-tprq9\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.384541 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.384541 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-metrics-client-ca\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.384541 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.384846 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-wtmp\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.384846 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprq9\" (UniqueName: \"kubernetes.io/projected/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-kube-api-access-tprq9\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.384846 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:13.384702    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 16 00:49:13.384846 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:13.384765    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-tls podName:7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9 nodeName:}" failed. No retries permitted until 2026-07-16 00:49:13.884748334 +0000 UTC m=+295.807572182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-k5np6" (UID: "7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9") : secret "openshift-state-metrics-tls" not found
Jul 16 00:49:13.384846 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-wtmp\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.384846 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-tls\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:13.384862    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng44\" (UniqueName: \"kubernetes.io/projected/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-kube-api-access-qng44\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:13.384917    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-tls podName:b7bdbd81-6b3a-4d04-acbb-7f70549107fc nodeName:}" failed. No retries permitted until 2026-07-16 00:49:13.884899031 +0000 UTC m=+295.807722885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-tls") pod "node-exporter-nhcrn" (UID: "b7bdbd81-6b3a-4d04-acbb-7f70549107fc") : secret "node-exporter-tls" not found
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-textfile\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.384982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-sys\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-sys\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-root\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-root\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385570 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385570 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-metrics-client-ca\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385570 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-textfile\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.385570 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.385552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.387388 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.387358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.387573 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.387558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.396240 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.396210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng44\" (UniqueName: \"kubernetes.io/projected/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-kube-api-access-qng44\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.396966 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.396950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprq9\" (UniqueName: \"kubernetes.io/projected/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-kube-api-access-tprq9\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.888772 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.888733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:13.888994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.888831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-tls\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.891109 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.891082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7bdbd81-6b3a-4d04-acbb-7f70549107fc-node-exporter-tls\") pod \"node-exporter-nhcrn\" (UID: \"b7bdbd81-6b3a-4d04-acbb-7f70549107fc\") " pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:13.891249 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:13.891228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5np6\" (UID: \"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:14.031978 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.031946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"
Jul 16 00:49:14.046111 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.046087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nhcrn"
Jul 16 00:49:14.057725 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:14.057677    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7bdbd81_6b3a_4d04_acbb_7f70549107fc.slice/crio-383ed990c0dbc9c6b70c400d819ac61673488452aed5bba6e20eb6f03f075096 WatchSource:0}: Error finding container 383ed990c0dbc9c6b70c400d819ac61673488452aed5bba6e20eb6f03f075096: Status 404 returned error can't find the container with id 383ed990c0dbc9c6b70c400d819ac61673488452aed5bba6e20eb6f03f075096
Jul 16 00:49:14.175333 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.175205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6"]
Jul 16 00:49:14.177865 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:14.177838    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d27a0e5_a22f_4ee9_a2c3_bb87673ceda9.slice/crio-ba0f7ae947a1d4bd8cea5489abbfd4065f97af45aa0e234aa3f7d884b9091e68 WatchSource:0}: Error finding container ba0f7ae947a1d4bd8cea5489abbfd4065f97af45aa0e234aa3f7d884b9091e68: Status 404 returned error can't find the container with id ba0f7ae947a1d4bd8cea5489abbfd4065f97af45aa0e234aa3f7d884b9091e68
Jul 16 00:49:14.576105 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.576064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6" event={"ID":"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9","Type":"ContainerStarted","Data":"4b827cab32d904b0e2404f8dd68a5be666f41ab4925a1763e9a1e16d7b5542d3"}
Jul 16 00:49:14.576303 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.576148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6" event={"ID":"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9","Type":"ContainerStarted","Data":"5865c29f3d807a27067f6e4bac983b8f430a53e7b5c194e92473fbd533116a95"}
Jul 16 00:49:14.576303 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.576180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6" event={"ID":"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9","Type":"ContainerStarted","Data":"ba0f7ae947a1d4bd8cea5489abbfd4065f97af45aa0e234aa3f7d884b9091e68"}
Jul 16 00:49:14.577612 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.577582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhcrn" event={"ID":"b7bdbd81-6b3a-4d04-acbb-7f70549107fc","Type":"ContainerStarted","Data":"383ed990c0dbc9c6b70c400d819ac61673488452aed5bba6e20eb6f03f075096"}
Jul 16 00:49:14.907865 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.907764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:14.907865 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.907857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:14.913770 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:14.913736    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:15.582856 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:15.582820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6" event={"ID":"7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9","Type":"ContainerStarted","Data":"cf1245b2f36726382359ff1dba5dce8a0c78d35a29d5416b61a0b161810887ea"}
Jul 16 00:49:15.584420 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:15.584395    2578 generic.go:356] "Generic (PLEG): container finished" podID="b7bdbd81-6b3a-4d04-acbb-7f70549107fc" containerID="ef85b2a39aef46dc225be107357219634ca9aa8ee51f229dbcc775f13358880f" exitCode=0
Jul 16 00:49:15.584569 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:15.584480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhcrn" event={"ID":"b7bdbd81-6b3a-4d04-acbb-7f70549107fc","Type":"ContainerDied","Data":"ef85b2a39aef46dc225be107357219634ca9aa8ee51f229dbcc775f13358880f"}
Jul 16 00:49:15.588524 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:15.588503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:49:15.605149 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:15.605105    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5np6" podStartSLOduration=1.694873157 podStartE2EDuration="2.605090334s" totalImagesPullingTime="910.217177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:15.603403137 +0000 UTC m=+297.526227029" watchObservedRunningTime="2026-07-16 00:49:15.605090334 +0000 UTC m=+297.527914226"
Jul 16 00:49:16.590575 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:16.590539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhcrn" event={"ID":"b7bdbd81-6b3a-4d04-acbb-7f70549107fc","Type":"ContainerStarted","Data":"9738aee8cdc92986dd933ec8092991d0ecac1e22f374c2b00fd44a70c5ebf7c2"}
Jul 16 00:49:16.591084 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:16.590593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhcrn" event={"ID":"b7bdbd81-6b3a-4d04-acbb-7f70549107fc","Type":"ContainerStarted","Data":"60c4ff9286a8d99e4e1ce393763db1795576b050287f15fb3dc8ba3c32adc9ce"}
Jul 16 00:49:16.611988 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:16.611940    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nhcrn" podStartSLOduration=2.440371179 podStartE2EDuration="3.611923969s" totalImagesPullingTime="1.103668515s" totalInitContainerRuntime="67.884275ms" isStatefulPod=true podCreationTimestamp="2026-07-16 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:16.610758505 +0000 UTC m=+298.533582372" watchObservedRunningTime="2026-07-16 00:49:16.611923969 +0000 UTC m=+298.534747856"
Jul 16 00:49:16.626419 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:49:16.626377    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qjhq2" podUID="8fd7b54c-919f-48f9-8e14-b37280e324f9"
Jul 16 00:49:17.548843 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:17.548814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8kbnj"
Jul 16 00:49:17.898635 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:17.898565    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"]
Jul 16 00:49:17.902012 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:17.901993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:17.904087 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:17.904065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 16 00:49:17.904195 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:17.904096    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-l6xsh\""
Jul 16 00:49:17.911717 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:17.911697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"]
Jul 16 00:49:18.024712 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.024677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhfm9\" (UniqueName: \"kubernetes.io/projected/a701510d-d625-4177-990e-ba398667d6c5-kube-api-access-jhfm9\") pod \"monitoring-plugin-5f68df7f58-w6nhz\" (UID: \"a701510d-d625-4177-990e-ba398667d6c5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.024910 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.024728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a701510d-d625-4177-990e-ba398667d6c5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-w6nhz\" (UID: \"a701510d-d625-4177-990e-ba398667d6c5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.125275 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.125237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a701510d-d625-4177-990e-ba398667d6c5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-w6nhz\" (UID: \"a701510d-d625-4177-990e-ba398667d6c5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.125451 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.125311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhfm9\" (UniqueName: \"kubernetes.io/projected/a701510d-d625-4177-990e-ba398667d6c5-kube-api-access-jhfm9\") pod \"monitoring-plugin-5f68df7f58-w6nhz\" (UID: \"a701510d-d625-4177-990e-ba398667d6c5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.127653 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.127630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a701510d-d625-4177-990e-ba398667d6c5-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-w6nhz\" (UID: \"a701510d-d625-4177-990e-ba398667d6c5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.134525 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.134503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhfm9\" (UniqueName: \"kubernetes.io/projected/a701510d-d625-4177-990e-ba398667d6c5-kube-api-access-jhfm9\") pod \"monitoring-plugin-5f68df7f58-w6nhz\" (UID: \"a701510d-d625-4177-990e-ba398667d6c5\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.212465 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.212392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:18.346637 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.346609    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"]
Jul 16 00:49:18.349533 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:49:18.349497    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda701510d_d625_4177_990e_ba398667d6c5.slice/crio-f6978a73fccc110fe63d2b56de6198d5fccf692d2879c5d01b33259d042361c5 WatchSource:0}: Error finding container f6978a73fccc110fe63d2b56de6198d5fccf692d2879c5d01b33259d042361c5: Status 404 returned error can't find the container with id f6978a73fccc110fe63d2b56de6198d5fccf692d2879c5d01b33259d042361c5
Jul 16 00:49:18.462751 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.462664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:49:18.463782 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.463757    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:49:18.466331 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.466309    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:49:18.467263 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.467244    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:49:18.473397 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.473381    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 00:49:18.598130 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:18.598099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz" event={"ID":"a701510d-d625-4177-990e-ba398667d6c5","Type":"ContainerStarted","Data":"f6978a73fccc110fe63d2b56de6198d5fccf692d2879c5d01b33259d042361c5"}
Jul 16 00:49:20.608649 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:20.608614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz" event={"ID":"a701510d-d625-4177-990e-ba398667d6c5","Type":"ContainerStarted","Data":"baab2823c6923ab654d70d1b89076fd35eba988c035638364396f2bb76f189c5"}
Jul 16 00:49:20.609068 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:20.608814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:20.613352 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:20.613328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz"
Jul 16 00:49:20.626204 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:20.626159    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-w6nhz" podStartSLOduration=2.257168272 podStartE2EDuration="3.626141889s" totalImagesPullingTime="1.368973617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:20.625727014 +0000 UTC m=+302.548550881" watchObservedRunningTime="2026-07-16 00:49:20.626141889 +0000 UTC m=+302.548965756"
Jul 16 00:49:26.139231 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.139196    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54ccff5997-z2sw8"]
Jul 16 00:49:26.231708 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.231678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ccff5997-z2sw8"]
Jul 16 00:49:26.231892 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.231814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.239528 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.239507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 00:49:26.406554 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-serving-cert\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.406554 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-console-config\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.406554 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-oauth-serving-cert\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.406763 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-oauth-config\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.406763 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52r5\" (UniqueName: \"kubernetes.io/projected/da052ebe-f33a-42a6-8b04-75568a2d628b-kube-api-access-x52r5\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.406763 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-trusted-ca-bundle\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.406884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.406837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-service-ca\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508011 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.507979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52r5\" (UniqueName: \"kubernetes.io/projected/da052ebe-f33a-42a6-8b04-75568a2d628b-kube-api-access-x52r5\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508169 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.508022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-trusted-ca-bundle\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508169 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.508144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-service-ca\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508266 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.508189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-serving-cert\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508266 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.508221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-console-config\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508266 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.508255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-oauth-serving-cert\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.508409 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.508340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-oauth-config\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.509160 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.509044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-service-ca\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.509160 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.509093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-trusted-ca-bundle\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.509160 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.509118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-oauth-serving-cert\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.509160 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.509145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-console-config\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.510900 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.510880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-oauth-config\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.511015 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.510987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-serving-cert\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.515589 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.515571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52r5\" (UniqueName: \"kubernetes.io/projected/da052ebe-f33a-42a6-8b04-75568a2d628b-kube-api-access-x52r5\") pod \"console-54ccff5997-z2sw8\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") " pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.541104 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.541070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:26.778210 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:26.778177    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ccff5997-z2sw8"]
Jul 16 00:49:27.636257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:27.636216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccff5997-z2sw8" event={"ID":"da052ebe-f33a-42a6-8b04-75568a2d628b","Type":"ContainerStarted","Data":"3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068"}
Jul 16 00:49:27.636644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:27.636272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccff5997-z2sw8" event={"ID":"da052ebe-f33a-42a6-8b04-75568a2d628b","Type":"ContainerStarted","Data":"44e11890f10c7b4cfc5433244c35f6f8ed59e96e622c376f5e31c5162bdf2ef1"}
Jul 16 00:49:27.663742 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:27.663695    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54ccff5997-z2sw8" podStartSLOduration=1.66368169 podStartE2EDuration="1.66368169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:27.6625187 +0000 UTC m=+309.585342566" watchObservedRunningTime="2026-07-16 00:49:27.66368169 +0000 UTC m=+309.586505557"
Jul 16 00:49:31.626713 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:31.626679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:49:36.541959 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:36.541929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:36.542399 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:36.541982    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:36.546902 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:36.546878    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:36.671234 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:36.671210    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:49:36.771212 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:36.771180    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75f9459d78-kcfms"]
Jul 16 00:49:59.753595 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:59.753511    2578 generic.go:356] "Generic (PLEG): container finished" podID="bc0805a9-c09a-4ed8-a5ad-6e8775a38e70" containerID="dcb0a71021f0e13c618d2242d7c656e49b928fd801c7b6c6eb185a3bbb8eeedf" exitCode=0
Jul 16 00:49:59.753595 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:59.753580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf" event={"ID":"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70","Type":"ContainerDied","Data":"dcb0a71021f0e13c618d2242d7c656e49b928fd801c7b6c6eb185a3bbb8eeedf"}
Jul 16 00:49:59.753998 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:49:59.753933    2578 scope.go:117] "RemoveContainer" containerID="dcb0a71021f0e13c618d2242d7c656e49b928fd801c7b6c6eb185a3bbb8eeedf"
Jul 16 00:50:00.758864 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:00.758832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kpmvf" event={"ID":"bc0805a9-c09a-4ed8-a5ad-6e8775a38e70","Type":"ContainerStarted","Data":"04e2eb55ae0f66c321015c265fbec8b181fa8c73cd0cad2277c62cd0254196cd"}
Jul 16 00:50:01.802426 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:01.802380    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75f9459d78-kcfms" podUID="a5d879dc-5f90-4686-bb9a-5074b4f188e3" containerName="console" containerID="cri-o://f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0" gracePeriod=15
Jul 16 00:50:02.051987 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.051967    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:50:02.185142 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmd25\" (UniqueName: \"kubernetes.io/projected/a5d879dc-5f90-4686-bb9a-5074b4f188e3-kube-api-access-dmd25\") pod \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") "
Jul 16 00:50:02.185142 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-service-ca\") pod \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") "
Jul 16 00:50:02.185142 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-config\") pod \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") "
Jul 16 00:50:02.185431 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185156    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-oauth-serving-cert\") pod \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") "
Jul 16 00:50:02.185431 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-serving-cert\") pod \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") "
Jul 16 00:50:02.185431 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185302    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-oauth-config\") pod \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\" (UID: \"a5d879dc-5f90-4686-bb9a-5074b4f188e3\") "
Jul 16 00:50:02.185585 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185534    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5d879dc-5f90-4686-bb9a-5074b4f188e3" (UID: "a5d879dc-5f90-4686-bb9a-5074b4f188e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:50:02.185585 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185545    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5d879dc-5f90-4686-bb9a-5074b4f188e3" (UID: "a5d879dc-5f90-4686-bb9a-5074b4f188e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:50:02.185585 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.185555    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-config" (OuterVolumeSpecName: "console-config") pod "a5d879dc-5f90-4686-bb9a-5074b4f188e3" (UID: "a5d879dc-5f90-4686-bb9a-5074b4f188e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:50:02.187513 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.187486    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5d879dc-5f90-4686-bb9a-5074b4f188e3" (UID: "a5d879dc-5f90-4686-bb9a-5074b4f188e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:50:02.187513 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.187501    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d879dc-5f90-4686-bb9a-5074b4f188e3-kube-api-access-dmd25" (OuterVolumeSpecName: "kube-api-access-dmd25") pod "a5d879dc-5f90-4686-bb9a-5074b4f188e3" (UID: "a5d879dc-5f90-4686-bb9a-5074b4f188e3"). InnerVolumeSpecName "kube-api-access-dmd25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:50:02.187681 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.187501    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5d879dc-5f90-4686-bb9a-5074b4f188e3" (UID: "a5d879dc-5f90-4686-bb9a-5074b4f188e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:50:02.286273 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.286236    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmd25\" (UniqueName: \"kubernetes.io/projected/a5d879dc-5f90-4686-bb9a-5074b4f188e3-kube-api-access-dmd25\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:50:02.286273 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.286267    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-service-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:50:02.286273 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.286276    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:50:02.286273 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.286285    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d879dc-5f90-4686-bb9a-5074b4f188e3-oauth-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:50:02.286536 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.286294    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:50:02.286536 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.286302    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d879dc-5f90-4686-bb9a-5074b4f188e3-console-oauth-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:50:02.766915 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.766882    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5d879dc-5f90-4686-bb9a-5074b4f188e3" containerID="f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0" exitCode=0
Jul 16 00:50:02.767076 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.766931    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f9459d78-kcfms"
Jul 16 00:50:02.767076 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.766952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f9459d78-kcfms" event={"ID":"a5d879dc-5f90-4686-bb9a-5074b4f188e3","Type":"ContainerDied","Data":"f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0"}
Jul 16 00:50:02.767076 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.766990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f9459d78-kcfms" event={"ID":"a5d879dc-5f90-4686-bb9a-5074b4f188e3","Type":"ContainerDied","Data":"8ac322ea3469a143c863bb4b8a85d2448d2595fbf16ee324eef05e437a72210f"}
Jul 16 00:50:02.767076 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.767009    2578 scope.go:117] "RemoveContainer" containerID="f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0"
Jul 16 00:50:02.775116 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.775095    2578 scope.go:117] "RemoveContainer" containerID="f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0"
Jul 16 00:50:02.775397 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:50:02.775374    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0\": container with ID starting with f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0 not found: ID does not exist" containerID="f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0"
Jul 16 00:50:02.775443 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.775407    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0"} err="failed to get container status \"f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0\": rpc error: code = NotFound desc = could not find container \"f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0\": container with ID starting with f6b9ab978932dad021cf068c74572d018d0fcae89eef6e614be8c19660f6a7b0 not found: ID does not exist"
Jul 16 00:50:02.783709 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.783686    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75f9459d78-kcfms"]
Jul 16 00:50:02.787350 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:02.787333    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75f9459d78-kcfms"]
Jul 16 00:50:04.631186 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:04.631155    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d879dc-5f90-4686-bb9a-5074b4f188e3" path="/var/lib/kubelet/pods/a5d879dc-5f90-4686-bb9a-5074b4f188e3/volumes"
Jul 16 00:50:09.793664 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:09.793630    2578 generic.go:356] "Generic (PLEG): container finished" podID="3dffb8d6-eb00-4f11-ac83-1f46d79cd485" containerID="03ce42837d6b79d5bc46853ff9f24aa34dbd8d82f653dd38d47f5a115ff27a81" exitCode=0
Jul 16 00:50:09.794103 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:09.793706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss" event={"ID":"3dffb8d6-eb00-4f11-ac83-1f46d79cd485","Type":"ContainerDied","Data":"03ce42837d6b79d5bc46853ff9f24aa34dbd8d82f653dd38d47f5a115ff27a81"}
Jul 16 00:50:09.794103 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:09.794035    2578 scope.go:117] "RemoveContainer" containerID="03ce42837d6b79d5bc46853ff9f24aa34dbd8d82f653dd38d47f5a115ff27a81"
Jul 16 00:50:10.799523 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:10.799493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-769ss" event={"ID":"3dffb8d6-eb00-4f11-ac83-1f46d79cd485","Type":"ContainerStarted","Data":"166201fba066f6ec24f330653e0da2acbaf9623a78071ed35fb5e824c4818b8b"}
Jul 16 00:50:32.440915 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.440876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:50:32.443049 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.443029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd7b54c-919f-48f9-8e14-b37280e324f9-metrics-certs\") pod \"network-metrics-daemon-qjhq2\" (UID: \"8fd7b54c-919f-48f9-8e14-b37280e324f9\") " pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:50:32.530363 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.530338    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b92gb\""
Jul 16 00:50:32.538400 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.538381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjhq2"
Jul 16 00:50:32.666179 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.666149    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjhq2"]
Jul 16 00:50:32.668945 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:50:32.668920    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd7b54c_919f_48f9_8e14_b37280e324f9.slice/crio-28bbff07176cd2b4df7794c4f62d1e4c0415b3ec3ff35b20eb98feb3ded30bbf WatchSource:0}: Error finding container 28bbff07176cd2b4df7794c4f62d1e4c0415b3ec3ff35b20eb98feb3ded30bbf: Status 404 returned error can't find the container with id 28bbff07176cd2b4df7794c4f62d1e4c0415b3ec3ff35b20eb98feb3ded30bbf
Jul 16 00:50:32.670770 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.670752    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:50:32.883526 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:32.883499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjhq2" event={"ID":"8fd7b54c-919f-48f9-8e14-b37280e324f9","Type":"ContainerStarted","Data":"28bbff07176cd2b4df7794c4f62d1e4c0415b3ec3ff35b20eb98feb3ded30bbf"}
Jul 16 00:50:33.889817 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:33.889769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjhq2" event={"ID":"8fd7b54c-919f-48f9-8e14-b37280e324f9","Type":"ContainerStarted","Data":"6bd5356751f46a0f38ea295ce7c19dd20b37f9013803088e9434022eb7d1f647"}
Jul 16 00:50:33.890255 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:33.889842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjhq2" event={"ID":"8fd7b54c-919f-48f9-8e14-b37280e324f9","Type":"ContainerStarted","Data":"85f5a4c6b21fb67309e0612f4899f411fce2e742baa63d65d3498299c587a77a"}
Jul 16 00:50:33.911093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:33.910859    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qjhq2" podStartSLOduration=373.869975407 podStartE2EDuration="6m14.910825468s" totalImagesPullingTime="1.040850061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:33.910461402 +0000 UTC m=+375.833285302" watchObservedRunningTime="2026-07-16 00:50:33.910825468 +0000 UTC m=+375.833649356"
Jul 16 00:50:46.378407 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.378377    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97d74bc69-rdkx4"]
Jul 16 00:50:46.378907 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.378658    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d879dc-5f90-4686-bb9a-5074b4f188e3" containerName="console"
Jul 16 00:50:46.378907 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.378669    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d879dc-5f90-4686-bb9a-5074b4f188e3" containerName="console"
Jul 16 00:50:46.378907 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.378716    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d879dc-5f90-4686-bb9a-5074b4f188e3" containerName="console"
Jul 16 00:50:46.381389 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.381368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.413484 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.413461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97d74bc69-rdkx4"]
Jul 16 00:50:46.431577 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc6l6\" (UniqueName: \"kubernetes.io/projected/837c2345-0f91-4187-a592-906f85676c5d-kube-api-access-pc6l6\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.431691 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-oauth-serving-cert\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.431691 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-serving-cert\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.431691 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-service-ca\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.431691 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-trusted-ca-bundle\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.431691 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-oauth-config\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.431877 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.431699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-console-config\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532617 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc6l6\" (UniqueName: \"kubernetes.io/projected/837c2345-0f91-4187-a592-906f85676c5d-kube-api-access-pc6l6\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532617 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-oauth-serving-cert\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-serving-cert\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-service-ca\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-trusted-ca-bundle\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-oauth-config\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.532889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.532858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-console-config\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.533502 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.533475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-oauth-serving-cert\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.533502 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.533494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-service-ca\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.533905 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.533553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-console-config\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.533905 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.533773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-trusted-ca-bundle\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.535666 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.535644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-serving-cert\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.535753 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.535663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-oauth-config\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.540919 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.540900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc6l6\" (UniqueName: \"kubernetes.io/projected/837c2345-0f91-4187-a592-906f85676c5d-kube-api-access-pc6l6\") pod \"console-97d74bc69-rdkx4\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") " pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.690629 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.690545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:46.825617 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.825583    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97d74bc69-rdkx4"]
Jul 16 00:50:46.828739 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:50:46.828709    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837c2345_0f91_4187_a592_906f85676c5d.slice/crio-44e7e6ddb22d44bbcc8c95838b16e4e2fef23a5d80a735375ad996d6f594ce54 WatchSource:0}: Error finding container 44e7e6ddb22d44bbcc8c95838b16e4e2fef23a5d80a735375ad996d6f594ce54: Status 404 returned error can't find the container with id 44e7e6ddb22d44bbcc8c95838b16e4e2fef23a5d80a735375ad996d6f594ce54
Jul 16 00:50:46.940543 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.940516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97d74bc69-rdkx4" event={"ID":"837c2345-0f91-4187-a592-906f85676c5d","Type":"ContainerStarted","Data":"82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747"}
Jul 16 00:50:46.940717 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.940560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97d74bc69-rdkx4" event={"ID":"837c2345-0f91-4187-a592-906f85676c5d","Type":"ContainerStarted","Data":"44e7e6ddb22d44bbcc8c95838b16e4e2fef23a5d80a735375ad996d6f594ce54"}
Jul 16 00:50:46.960600 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:46.960544    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97d74bc69-rdkx4" podStartSLOduration=0.960530377 podStartE2EDuration="960.530377ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:50:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:46.960111268 +0000 UTC m=+388.882935138" watchObservedRunningTime="2026-07-16 00:50:46.960530377 +0000 UTC m=+388.883354243"
Jul 16 00:50:56.690651 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:56.690610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:56.691087 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:56.690670    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:56.695559 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:56.695536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:56.980762 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:56.980690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:50:57.033928 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:50:57.033889    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ccff5997-z2sw8"]
Jul 16 00:51:22.056271 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.056212    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54ccff5997-z2sw8" podUID="da052ebe-f33a-42a6-8b04-75568a2d628b" containerName="console" containerID="cri-o://3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068" gracePeriod=15
Jul 16 00:51:22.294253 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.294228    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:51:22.375144 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-trusted-ca-bundle\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375144 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375098    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-serving-cert\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375144 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-oauth-config\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-oauth-serving-cert\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-service-ca\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375280    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x52r5\" (UniqueName: \"kubernetes.io/projected/da052ebe-f33a-42a6-8b04-75568a2d628b-kube-api-access-x52r5\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375408 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375311    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-console-config\") pod \"da052ebe-f33a-42a6-8b04-75568a2d628b\" (UID: \"da052ebe-f33a-42a6-8b04-75568a2d628b\") "
Jul 16 00:51:22.375620 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375545    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:51:22.375620 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:51:22.375725 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375613    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-service-ca" (OuterVolumeSpecName: "service-ca") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:51:22.375835 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.375815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-console-config" (OuterVolumeSpecName: "console-config") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:51:22.377179 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.377157    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:51:22.377335 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.377311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da052ebe-f33a-42a6-8b04-75568a2d628b-kube-api-access-x52r5" (OuterVolumeSpecName: "kube-api-access-x52r5") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "kube-api-access-x52r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:51:22.377401 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.377313    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da052ebe-f33a-42a6-8b04-75568a2d628b" (UID: "da052ebe-f33a-42a6-8b04-75568a2d628b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:51:22.476257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476231    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-oauth-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:22.476257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476256    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-service-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:22.476436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476265    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x52r5\" (UniqueName: \"kubernetes.io/projected/da052ebe-f33a-42a6-8b04-75568a2d628b-kube-api-access-x52r5\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:22.476436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476275    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-console-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:22.476436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476283    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da052ebe-f33a-42a6-8b04-75568a2d628b-trusted-ca-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:22.476436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476291    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:22.476436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:22.476300    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da052ebe-f33a-42a6-8b04-75568a2d628b-console-oauth-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:23.073233 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.073198    2578 generic.go:356] "Generic (PLEG): container finished" podID="da052ebe-f33a-42a6-8b04-75568a2d628b" containerID="3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068" exitCode=0
Jul 16 00:51:23.073689 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.073253    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccff5997-z2sw8"
Jul 16 00:51:23.073689 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.073293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccff5997-z2sw8" event={"ID":"da052ebe-f33a-42a6-8b04-75568a2d628b","Type":"ContainerDied","Data":"3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068"}
Jul 16 00:51:23.073689 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.073361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccff5997-z2sw8" event={"ID":"da052ebe-f33a-42a6-8b04-75568a2d628b","Type":"ContainerDied","Data":"44e11890f10c7b4cfc5433244c35f6f8ed59e96e622c376f5e31c5162bdf2ef1"}
Jul 16 00:51:23.073689 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.073396    2578 scope.go:117] "RemoveContainer" containerID="3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068"
Jul 16 00:51:23.081727 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.081700    2578 scope.go:117] "RemoveContainer" containerID="3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068"
Jul 16 00:51:23.081978 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:51:23.081961    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068\": container with ID starting with 3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068 not found: ID does not exist" containerID="3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068"
Jul 16 00:51:23.082032 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.081987    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068"} err="failed to get container status \"3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068\": rpc error: code = NotFound desc = could not find container \"3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068\": container with ID starting with 3128f389b0b9b605fa44f4f02161803067a42a9691e3251be38093a155ea9068 not found: ID does not exist"
Jul 16 00:51:23.090561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.090538    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ccff5997-z2sw8"]
Jul 16 00:51:23.094561 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:23.094543    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54ccff5997-z2sw8"]
Jul 16 00:51:24.630464 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:24.630433    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da052ebe-f33a-42a6-8b04-75568a2d628b" path="/var/lib/kubelet/pods/da052ebe-f33a-42a6-8b04-75568a2d628b/volumes"
Jul 16 00:51:27.267247 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.267211    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"]
Jul 16 00:51:27.267710 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.267588    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da052ebe-f33a-42a6-8b04-75568a2d628b" containerName="console"
Jul 16 00:51:27.267710 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.267605    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="da052ebe-f33a-42a6-8b04-75568a2d628b" containerName="console"
Jul 16 00:51:27.267710 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.267695    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="da052ebe-f33a-42a6-8b04-75568a2d628b" containerName="console"
Jul 16 00:51:27.272071 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.272050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.274888 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.274862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 00:51:27.275662 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.275642    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 00:51:27.275746 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.275675    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztqwl\""
Jul 16 00:51:27.282057 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.282036    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"]
Jul 16 00:51:27.310041 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.310017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnlm\" (UniqueName: \"kubernetes.io/projected/5386ab6e-ad23-4523-844f-811edb5b2e17-kube-api-access-mnnlm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.310140 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.310053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.310140 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.310084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.410401 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.410376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnnlm\" (UniqueName: \"kubernetes.io/projected/5386ab6e-ad23-4523-844f-811edb5b2e17-kube-api-access-mnnlm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.410491 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.410423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.410491 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.410473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.410777 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.410761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.410835 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.410819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.419633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.419606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnnlm\" (UniqueName: \"kubernetes.io/projected/5386ab6e-ad23-4523-844f-811edb5b2e17-kube-api-access-mnnlm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.580961 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.580874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:27.716131 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:27.716076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"]
Jul 16 00:51:27.718153 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:51:27.718130    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5386ab6e_ad23_4523_844f_811edb5b2e17.slice/crio-9a42afd5cc23e8dc48efaca150c39aad28b8fc31916c17353304378bcf054146 WatchSource:0}: Error finding container 9a42afd5cc23e8dc48efaca150c39aad28b8fc31916c17353304378bcf054146: Status 404 returned error can't find the container with id 9a42afd5cc23e8dc48efaca150c39aad28b8fc31916c17353304378bcf054146
Jul 16 00:51:28.094726 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:28.094690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6" event={"ID":"5386ab6e-ad23-4523-844f-811edb5b2e17","Type":"ContainerStarted","Data":"9a42afd5cc23e8dc48efaca150c39aad28b8fc31916c17353304378bcf054146"}
Jul 16 00:51:34.121169 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:34.121129    2578 generic.go:356] "Generic (PLEG): container finished" podID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerID="6348aae62550128d8050ab5534b478ee196780d39584de889a6fe0589c402d4c" exitCode=0
Jul 16 00:51:34.121635 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:34.121173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6" event={"ID":"5386ab6e-ad23-4523-844f-811edb5b2e17","Type":"ContainerDied","Data":"6348aae62550128d8050ab5534b478ee196780d39584de889a6fe0589c402d4c"}
Jul 16 00:51:37.134941 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:37.134909    2578 generic.go:356] "Generic (PLEG): container finished" podID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerID="0e59f30db381c6d98676354170dc4038a9b58b318437ad21ddc60b1fcb5224b1" exitCode=0
Jul 16 00:51:37.135302 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:37.134975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6" event={"ID":"5386ab6e-ad23-4523-844f-811edb5b2e17","Type":"ContainerDied","Data":"0e59f30db381c6d98676354170dc4038a9b58b318437ad21ddc60b1fcb5224b1"}
Jul 16 00:51:45.174430 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:45.174355    2578 generic.go:356] "Generic (PLEG): container finished" podID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerID="70d9195884042c87f811c7ec14b22ab8c1e17982b437c5a8e276efd1fd9aaa11" exitCode=0
Jul 16 00:51:45.174430 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:45.174423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6" event={"ID":"5386ab6e-ad23-4523-844f-811edb5b2e17","Type":"ContainerDied","Data":"70d9195884042c87f811c7ec14b22ab8c1e17982b437c5a8e276efd1fd9aaa11"}
Jul 16 00:51:46.304708 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.304686    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:46.370326 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.370300    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-util\") pod \"5386ab6e-ad23-4523-844f-811edb5b2e17\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") "
Jul 16 00:51:46.370431 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.370353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-bundle\") pod \"5386ab6e-ad23-4523-844f-811edb5b2e17\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") "
Jul 16 00:51:46.370431 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.370426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnnlm\" (UniqueName: \"kubernetes.io/projected/5386ab6e-ad23-4523-844f-811edb5b2e17-kube-api-access-mnnlm\") pod \"5386ab6e-ad23-4523-844f-811edb5b2e17\" (UID: \"5386ab6e-ad23-4523-844f-811edb5b2e17\") "
Jul 16 00:51:46.371105 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.371083    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-bundle" (OuterVolumeSpecName: "bundle") pod "5386ab6e-ad23-4523-844f-811edb5b2e17" (UID: "5386ab6e-ad23-4523-844f-811edb5b2e17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:51:46.372533 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.372509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5386ab6e-ad23-4523-844f-811edb5b2e17-kube-api-access-mnnlm" (OuterVolumeSpecName: "kube-api-access-mnnlm") pod "5386ab6e-ad23-4523-844f-811edb5b2e17" (UID: "5386ab6e-ad23-4523-844f-811edb5b2e17"). InnerVolumeSpecName "kube-api-access-mnnlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:51:46.374503 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.374477    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-util" (OuterVolumeSpecName: "util") pod "5386ab6e-ad23-4523-844f-811edb5b2e17" (UID: "5386ab6e-ad23-4523-844f-811edb5b2e17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:51:46.471317 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.471257    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnnlm\" (UniqueName: \"kubernetes.io/projected/5386ab6e-ad23-4523-844f-811edb5b2e17-kube-api-access-mnnlm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:46.471317 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.471289    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-util\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:46.471317 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:46.471299    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5386ab6e-ad23-4523-844f-811edb5b2e17-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:51:47.183729 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:47.183685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6" event={"ID":"5386ab6e-ad23-4523-844f-811edb5b2e17","Type":"ContainerDied","Data":"9a42afd5cc23e8dc48efaca150c39aad28b8fc31916c17353304378bcf054146"}
Jul 16 00:51:47.183729 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:47.183715    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hgbr6"
Jul 16 00:51:47.183943 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:47.183741    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a42afd5cc23e8dc48efaca150c39aad28b8fc31916c17353304378bcf054146"
Jul 16 00:51:57.251330 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251298    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lz5cg"]
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251560    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="pull"
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251570    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="pull"
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251588    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="extract"
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251594    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="extract"
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251600    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="util"
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251606    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="util"
Jul 16 00:51:57.251805 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.251651    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5386ab6e-ad23-4523-844f-811edb5b2e17" containerName="extract"
Jul 16 00:51:57.254737 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.254719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.257135 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.257117    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 00:51:57.257887 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.257868    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 00:51:57.257949 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.257893    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mjsn9\""
Jul 16 00:51:57.263609 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.263590    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lz5cg"]
Jul 16 00:51:57.356347 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.356317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c7f8\" (UniqueName: \"kubernetes.io/projected/c271fa70-bba6-4d76-9f17-86643cc2e5cb-kube-api-access-8c7f8\") pod \"cert-manager-webhook-6486ffd997-lz5cg\" (UID: \"c271fa70-bba6-4d76-9f17-86643cc2e5cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.356479 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.356358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c271fa70-bba6-4d76-9f17-86643cc2e5cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lz5cg\" (UID: \"c271fa70-bba6-4d76-9f17-86643cc2e5cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.456950 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.456913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7f8\" (UniqueName: \"kubernetes.io/projected/c271fa70-bba6-4d76-9f17-86643cc2e5cb-kube-api-access-8c7f8\") pod \"cert-manager-webhook-6486ffd997-lz5cg\" (UID: \"c271fa70-bba6-4d76-9f17-86643cc2e5cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.457120 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.456958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c271fa70-bba6-4d76-9f17-86643cc2e5cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lz5cg\" (UID: \"c271fa70-bba6-4d76-9f17-86643cc2e5cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.466020 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.465991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c271fa70-bba6-4d76-9f17-86643cc2e5cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lz5cg\" (UID: \"c271fa70-bba6-4d76-9f17-86643cc2e5cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.466149 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.466073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7f8\" (UniqueName: \"kubernetes.io/projected/c271fa70-bba6-4d76-9f17-86643cc2e5cb-kube-api-access-8c7f8\") pod \"cert-manager-webhook-6486ffd997-lz5cg\" (UID: \"c271fa70-bba6-4d76-9f17-86643cc2e5cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.475583 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.475550    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"]
Jul 16 00:51:57.477756 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.477738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.479909 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.479887    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xxrsb\""
Jul 16 00:51:57.488540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.488518    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"]
Jul 16 00:51:57.563927 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.563892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:51:57.659338 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.659300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcn7w\" (UniqueName: \"kubernetes.io/projected/852afa16-4c6b-4753-a2e5-3c017763ef08-kube-api-access-bcn7w\") pod \"cert-manager-cainjector-559cdd8c87-tcjmn\" (UID: \"852afa16-4c6b-4753-a2e5-3c017763ef08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.659513 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.659354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/852afa16-4c6b-4753-a2e5-3c017763ef08-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tcjmn\" (UID: \"852afa16-4c6b-4753-a2e5-3c017763ef08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.692446 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.692377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lz5cg"]
Jul 16 00:51:57.696709 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:51:57.696678    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc271fa70_bba6_4d76_9f17_86643cc2e5cb.slice/crio-d1ecc1cf0b3c2f67b05958400dba436b527b4efa96eb3c1c4435b2a5c9cf7875 WatchSource:0}: Error finding container d1ecc1cf0b3c2f67b05958400dba436b527b4efa96eb3c1c4435b2a5c9cf7875: Status 404 returned error can't find the container with id d1ecc1cf0b3c2f67b05958400dba436b527b4efa96eb3c1c4435b2a5c9cf7875
Jul 16 00:51:57.760590 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.760557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcn7w\" (UniqueName: \"kubernetes.io/projected/852afa16-4c6b-4753-a2e5-3c017763ef08-kube-api-access-bcn7w\") pod \"cert-manager-cainjector-559cdd8c87-tcjmn\" (UID: \"852afa16-4c6b-4753-a2e5-3c017763ef08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.760820 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.760729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/852afa16-4c6b-4753-a2e5-3c017763ef08-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tcjmn\" (UID: \"852afa16-4c6b-4753-a2e5-3c017763ef08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.775503 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.775467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/852afa16-4c6b-4753-a2e5-3c017763ef08-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tcjmn\" (UID: \"852afa16-4c6b-4753-a2e5-3c017763ef08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.775628 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.775537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcn7w\" (UniqueName: \"kubernetes.io/projected/852afa16-4c6b-4753-a2e5-3c017763ef08-kube-api-access-bcn7w\") pod \"cert-manager-cainjector-559cdd8c87-tcjmn\" (UID: \"852afa16-4c6b-4753-a2e5-3c017763ef08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.787361 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.787337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"
Jul 16 00:51:57.919827 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:57.919763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn"]
Jul 16 00:51:57.922777 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:51:57.922747    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod852afa16_4c6b_4753_a2e5_3c017763ef08.slice/crio-adcf4ff72b027f19e4513b5562e866dfca0d8b9a3546b1303fe7bdc8b48ab43f WatchSource:0}: Error finding container adcf4ff72b027f19e4513b5562e866dfca0d8b9a3546b1303fe7bdc8b48ab43f: Status 404 returned error can't find the container with id adcf4ff72b027f19e4513b5562e866dfca0d8b9a3546b1303fe7bdc8b48ab43f
Jul 16 00:51:58.228688 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:58.228600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn" event={"ID":"852afa16-4c6b-4753-a2e5-3c017763ef08","Type":"ContainerStarted","Data":"adcf4ff72b027f19e4513b5562e866dfca0d8b9a3546b1303fe7bdc8b48ab43f"}
Jul 16 00:51:58.230093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:51:58.230061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg" event={"ID":"c271fa70-bba6-4d76-9f17-86643cc2e5cb","Type":"ContainerStarted","Data":"d1ecc1cf0b3c2f67b05958400dba436b527b4efa96eb3c1c4435b2a5c9cf7875"}
Jul 16 00:52:01.244557 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:01.244518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn" event={"ID":"852afa16-4c6b-4753-a2e5-3c017763ef08","Type":"ContainerStarted","Data":"610cb10d7866d8343d3af82c30a2d8719b8db2bf21997b85a3e1ed0cb082c8fd"}
Jul 16 00:52:01.246099 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:01.246072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg" event={"ID":"c271fa70-bba6-4d76-9f17-86643cc2e5cb","Type":"ContainerStarted","Data":"114ba5f09f272bc8255ab9994b7a7bf7efbb7b4356a882814722ae7d345aca3b"}
Jul 16 00:52:01.246229 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:01.246127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:52:01.286653 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:01.286607    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg" podStartSLOduration=1.407037233 podStartE2EDuration="4.286590658s" totalImagesPullingTime="2.879553425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:01.285823386 +0000 UTC m=+463.208647253" watchObservedRunningTime="2026-07-16 00:52:01.286590658 +0000 UTC m=+463.209414524"
Jul 16 00:52:01.286837 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:01.286742    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tcjmn" podStartSLOduration=1.625988221 podStartE2EDuration="4.286737449s" totalImagesPullingTime="2.660749228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:01.265626286 +0000 UTC m=+463.188450153" watchObservedRunningTime="2026-07-16 00:52:01.286737449 +0000 UTC m=+463.209561315"
Jul 16 00:52:07.252174 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:07.252140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lz5cg"
Jul 16 00:52:17.391646 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.391611    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"]
Jul 16 00:52:17.393968 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.393952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.396483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.396463    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:52:17.396697 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.396678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 00:52:17.397293 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.397279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2hjfl\""
Jul 16 00:52:17.404470 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.404449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"]
Jul 16 00:52:17.414358 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.414339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k692x\" (UniqueName: \"kubernetes.io/projected/b6bf25a4-3d29-4de6-b389-db2d105ca6b2-kube-api-access-k692x\") pod \"openshift-lws-operator-fd8ccff4c-4pdf4\" (UID: \"b6bf25a4-3d29-4de6-b389-db2d105ca6b2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.414447 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.414392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6bf25a4-3d29-4de6-b389-db2d105ca6b2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4pdf4\" (UID: \"b6bf25a4-3d29-4de6-b389-db2d105ca6b2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.515779 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.515750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k692x\" (UniqueName: \"kubernetes.io/projected/b6bf25a4-3d29-4de6-b389-db2d105ca6b2-kube-api-access-k692x\") pod \"openshift-lws-operator-fd8ccff4c-4pdf4\" (UID: \"b6bf25a4-3d29-4de6-b389-db2d105ca6b2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.515938 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.515817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6bf25a4-3d29-4de6-b389-db2d105ca6b2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4pdf4\" (UID: \"b6bf25a4-3d29-4de6-b389-db2d105ca6b2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.516158 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.516142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6bf25a4-3d29-4de6-b389-db2d105ca6b2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4pdf4\" (UID: \"b6bf25a4-3d29-4de6-b389-db2d105ca6b2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.524959 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.524935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k692x\" (UniqueName: \"kubernetes.io/projected/b6bf25a4-3d29-4de6-b389-db2d105ca6b2-kube-api-access-k692x\") pod \"openshift-lws-operator-fd8ccff4c-4pdf4\" (UID: \"b6bf25a4-3d29-4de6-b389-db2d105ca6b2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.703078 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.702992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"
Jul 16 00:52:17.827896 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:17.827868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4"]
Jul 16 00:52:17.830211 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:52:17.830185    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6bf25a4_3d29_4de6_b389_db2d105ca6b2.slice/crio-f690ab68e8437572c154e9c225154adb5bd412f3da4bfc325b140847fc061592 WatchSource:0}: Error finding container f690ab68e8437572c154e9c225154adb5bd412f3da4bfc325b140847fc061592: Status 404 returned error can't find the container with id f690ab68e8437572c154e9c225154adb5bd412f3da4bfc325b140847fc061592
Jul 16 00:52:18.314811 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:18.314770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4" event={"ID":"b6bf25a4-3d29-4de6-b389-db2d105ca6b2","Type":"ContainerStarted","Data":"f690ab68e8437572c154e9c225154adb5bd412f3da4bfc325b140847fc061592"}
Jul 16 00:52:21.329858 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:21.329818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4" event={"ID":"b6bf25a4-3d29-4de6-b389-db2d105ca6b2","Type":"ContainerStarted","Data":"b6376b276bbfcb0b7aab1901394effbeee3d1e07d2d61f44d59ed6d58c79e61f"}
Jul 16 00:52:21.358040 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:21.357977    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4pdf4" podStartSLOduration=1.296537233 podStartE2EDuration="4.357955777s" totalImagesPullingTime="3.061418544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:21.357057606 +0000 UTC m=+483.279881474" watchObservedRunningTime="2026-07-16 00:52:21.357955777 +0000 UTC m=+483.280779647"
Jul 16 00:52:23.606167 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.606131    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"]
Jul 16 00:52:23.608603 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.608574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.611192 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.611171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 00:52:23.611283 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.611195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztqwl\""
Jul 16 00:52:23.611757 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.611739    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 00:52:23.618365 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.618342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"]
Jul 16 00:52:23.668383 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.668356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjjj2\" (UniqueName: \"kubernetes.io/projected/f30016a0-da50-4721-995e-b24ab28b6d04-kube-api-access-rjjj2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.668571 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.668402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.668571 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.668434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.769464 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.769422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjjj2\" (UniqueName: \"kubernetes.io/projected/f30016a0-da50-4721-995e-b24ab28b6d04-kube-api-access-rjjj2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.769464 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.769474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.769649 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.769514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.769898 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.769881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.769935 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.769919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.778265 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.778242    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjjj2\" (UniqueName: \"kubernetes.io/projected/f30016a0-da50-4721-995e-b24ab28b6d04-kube-api-access-rjjj2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:23.918299 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:23.918222    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:24.045640 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:24.045616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"]
Jul 16 00:52:24.047586 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:52:24.047563    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30016a0_da50_4721_995e_b24ab28b6d04.slice/crio-a4cfbad80567bc8b8663c360b8c4fcec535d6c2eb68fdfb7faefcf45e2fcd0d9 WatchSource:0}: Error finding container a4cfbad80567bc8b8663c360b8c4fcec535d6c2eb68fdfb7faefcf45e2fcd0d9: Status 404 returned error can't find the container with id a4cfbad80567bc8b8663c360b8c4fcec535d6c2eb68fdfb7faefcf45e2fcd0d9
Jul 16 00:52:24.344551 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:24.344518    2578 generic.go:356] "Generic (PLEG): container finished" podID="f30016a0-da50-4721-995e-b24ab28b6d04" containerID="1120cfee97e3b4a067e66aa16284c121167f3c509459d1f705f631c35ed516a5" exitCode=0
Jul 16 00:52:24.344747 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:24.344579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67" event={"ID":"f30016a0-da50-4721-995e-b24ab28b6d04","Type":"ContainerDied","Data":"1120cfee97e3b4a067e66aa16284c121167f3c509459d1f705f631c35ed516a5"}
Jul 16 00:52:24.344747 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:24.344681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67" event={"ID":"f30016a0-da50-4721-995e-b24ab28b6d04","Type":"ContainerStarted","Data":"a4cfbad80567bc8b8663c360b8c4fcec535d6c2eb68fdfb7faefcf45e2fcd0d9"}
Jul 16 00:52:25.350177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:25.350144    2578 generic.go:356] "Generic (PLEG): container finished" podID="f30016a0-da50-4721-995e-b24ab28b6d04" containerID="e5176971296192241a956c837855a698dfebbfc8bd512461cefc88ea07f3fd3f" exitCode=0
Jul 16 00:52:25.350529 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:25.350208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67" event={"ID":"f30016a0-da50-4721-995e-b24ab28b6d04","Type":"ContainerDied","Data":"e5176971296192241a956c837855a698dfebbfc8bd512461cefc88ea07f3fd3f"}
Jul 16 00:52:26.356702 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:26.356664    2578 generic.go:356] "Generic (PLEG): container finished" podID="f30016a0-da50-4721-995e-b24ab28b6d04" containerID="08c3f909bae100b7a8633d7c6ef3166742797561822931153452ac8b4dd8cd11" exitCode=0
Jul 16 00:52:26.357101 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:26.356716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67" event={"ID":"f30016a0-da50-4721-995e-b24ab28b6d04","Type":"ContainerDied","Data":"08c3f909bae100b7a8633d7c6ef3166742797561822931153452ac8b4dd8cd11"}
Jul 16 00:52:27.482645 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.482623    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:27.602778 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.602753    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjjj2\" (UniqueName: \"kubernetes.io/projected/f30016a0-da50-4721-995e-b24ab28b6d04-kube-api-access-rjjj2\") pod \"f30016a0-da50-4721-995e-b24ab28b6d04\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") "
Jul 16 00:52:27.602921 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.602816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-util\") pod \"f30016a0-da50-4721-995e-b24ab28b6d04\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") "
Jul 16 00:52:27.602921 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.602893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-bundle\") pod \"f30016a0-da50-4721-995e-b24ab28b6d04\" (UID: \"f30016a0-da50-4721-995e-b24ab28b6d04\") "
Jul 16 00:52:27.603569 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.603543    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-bundle" (OuterVolumeSpecName: "bundle") pod "f30016a0-da50-4721-995e-b24ab28b6d04" (UID: "f30016a0-da50-4721-995e-b24ab28b6d04"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:52:27.604831 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.604808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30016a0-da50-4721-995e-b24ab28b6d04-kube-api-access-rjjj2" (OuterVolumeSpecName: "kube-api-access-rjjj2") pod "f30016a0-da50-4721-995e-b24ab28b6d04" (UID: "f30016a0-da50-4721-995e-b24ab28b6d04"). InnerVolumeSpecName "kube-api-access-rjjj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:52:27.608817 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.608785    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-util" (OuterVolumeSpecName: "util") pod "f30016a0-da50-4721-995e-b24ab28b6d04" (UID: "f30016a0-da50-4721-995e-b24ab28b6d04"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:52:27.704264 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.704208    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-util\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:52:27.704264 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.704229    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30016a0-da50-4721-995e-b24ab28b6d04-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:52:27.704264 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:27.704238    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjjj2\" (UniqueName: \"kubernetes.io/projected/f30016a0-da50-4721-995e-b24ab28b6d04-kube-api-access-rjjj2\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:52:28.367187 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:28.367157    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67"
Jul 16 00:52:28.367187 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:28.367163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4f67" event={"ID":"f30016a0-da50-4721-995e-b24ab28b6d04","Type":"ContainerDied","Data":"a4cfbad80567bc8b8663c360b8c4fcec535d6c2eb68fdfb7faefcf45e2fcd0d9"}
Jul 16 00:52:28.367528 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:28.367202    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4cfbad80567bc8b8663c360b8c4fcec535d6c2eb68fdfb7faefcf45e2fcd0d9"
Jul 16 00:52:38.015064 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015026    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"]
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015308    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="extract"
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015318    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="extract"
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015334    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="util"
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015339    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="util"
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015352    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="pull"
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015357    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="pull"
Jul 16 00:52:38.015444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.015406    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30016a0-da50-4721-995e-b24ab28b6d04" containerName="extract"
Jul 16 00:52:38.018168 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.018150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.021268 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.021243    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wdc6\""
Jul 16 00:52:38.021438 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.021417    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 00:52:38.021576 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.021558    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 00:52:38.021842 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.021821    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 00:52:38.021968 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.021955    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 00:52:38.079812 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.079765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"]
Jul 16 00:52:38.091354 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.091330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b693d5d4-5254-493e-a591-fb854d817f02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.091479 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.091358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b693d5d4-5254-493e-a591-fb854d817f02-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.091479 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.091390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mjcv\" (UniqueName: \"kubernetes.io/projected/b693d5d4-5254-493e-a591-fb854d817f02-kube-api-access-2mjcv\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.091560 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.091506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b693d5d4-5254-493e-a591-fb854d817f02-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.091560 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.091543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b693d5d4-5254-493e-a591-fb854d817f02-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.193008 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.192971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mjcv\" (UniqueName: \"kubernetes.io/projected/b693d5d4-5254-493e-a591-fb854d817f02-kube-api-access-2mjcv\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.193181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.193032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b693d5d4-5254-493e-a591-fb854d817f02-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.193181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.193070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b693d5d4-5254-493e-a591-fb854d817f02-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.193181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.193107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b693d5d4-5254-493e-a591-fb854d817f02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.193181 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.193123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b693d5d4-5254-493e-a591-fb854d817f02-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.193530 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.193497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b693d5d4-5254-493e-a591-fb854d817f02-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.195411 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.195381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b693d5d4-5254-493e-a591-fb854d817f02-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.195519 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.195501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b693d5d4-5254-493e-a591-fb854d817f02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.195583 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.195564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b693d5d4-5254-493e-a591-fb854d817f02-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.203515 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.203490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mjcv\" (UniqueName: \"kubernetes.io/projected/b693d5d4-5254-493e-a591-fb854d817f02-kube-api-access-2mjcv\") pod \"opendatahub-operator-controller-manager-795c7898c9-9p66h\" (UID: \"b693d5d4-5254-493e-a591-fb854d817f02\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.327546 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.327450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:38.468238 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:38.468159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"]
Jul 16 00:52:38.473685 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:52:38.473654    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb693d5d4_5254_493e_a591_fb854d817f02.slice/crio-08e50fe452ee5d129d8d0b94a121760b4d5368b530a569924b5c6255a3bc7ba1 WatchSource:0}: Error finding container 08e50fe452ee5d129d8d0b94a121760b4d5368b530a569924b5c6255a3bc7ba1: Status 404 returned error can't find the container with id 08e50fe452ee5d129d8d0b94a121760b4d5368b530a569924b5c6255a3bc7ba1
Jul 16 00:52:39.417490 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:39.417453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h" event={"ID":"b693d5d4-5254-493e-a591-fb854d817f02","Type":"ContainerStarted","Data":"08e50fe452ee5d129d8d0b94a121760b4d5368b530a569924b5c6255a3bc7ba1"}
Jul 16 00:52:41.427930 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:41.427889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h" event={"ID":"b693d5d4-5254-493e-a591-fb854d817f02","Type":"ContainerStarted","Data":"6cb1ada8291f1fdea0dedeb4d1a851ef94c119082e1926a44b13536af6090d1a"}
Jul 16 00:52:43.438324 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:43.438293    2578 generic.go:356] "Generic (PLEG): container finished" podID="b693d5d4-5254-493e-a591-fb854d817f02" containerID="6cb1ada8291f1fdea0dedeb4d1a851ef94c119082e1926a44b13536af6090d1a" exitCode=0
Jul 16 00:52:43.438685 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:43.438353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h" event={"ID":"b693d5d4-5254-493e-a591-fb854d817f02","Type":"ContainerDied","Data":"6cb1ada8291f1fdea0dedeb4d1a851ef94c119082e1926a44b13536af6090d1a"}
Jul 16 00:52:44.443991 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:44.443951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h" event={"ID":"b693d5d4-5254-493e-a591-fb854d817f02","Type":"ContainerStarted","Data":"5fba934428fa52649d66bbfdb12549677b88d50ff469ed2e9d6bf4a45dca242b"}
Jul 16 00:52:44.444353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:44.444166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:44.471038 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:44.470996    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h" podStartSLOduration=3.214307921 podStartE2EDuration="7.470982226s" totalImagesPullingTime="3.226063387s" totalInitContainerRuntime="1.030610918s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:44.4694394 +0000 UTC m=+506.392263267" watchObservedRunningTime="2026-07-16 00:52:44.470982226 +0000 UTC m=+506.393806156"
Jul 16 00:52:55.450387 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:55.450355    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-9p66h"
Jul 16 00:52:58.177377 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.177331    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"]
Jul 16 00:52:58.185095 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.185065    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.187972 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.187954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 00:52:58.188639 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.188622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rnp6v\""
Jul 16 00:52:58.188723 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.188662    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 00:52:58.193053 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.193031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"]
Jul 16 00:52:58.252332 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.252305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsrj7\" (UniqueName: \"kubernetes.io/projected/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-kube-api-access-jsrj7\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.252483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.252339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-tmp\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.252483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.252369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-tls-certs\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.340592 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.340553    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b8t2q"]
Jul 16 00:52:58.342974 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.342959    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.345317 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.345298    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zfttz\""
Jul 16 00:52:58.345447 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.345430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 00:52:58.353136 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.353116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsrj7\" (UniqueName: \"kubernetes.io/projected/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-kube-api-access-jsrj7\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.353240 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.353142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073fe6e6-99fc-4f03-9333-14f46fc17779-cert\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.353240 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.353166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-tmp\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.353240 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.353187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98df5\" (UniqueName: \"kubernetes.io/projected/073fe6e6-99fc-4f03-9333-14f46fc17779-kube-api-access-98df5\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.353240 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.353234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-tls-certs\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.355609 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.355584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-tmp\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.355959 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.355932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-tls-certs\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.357012 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.356991    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b8t2q"]
Jul 16 00:52:58.362537 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.362516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsrj7\" (UniqueName: \"kubernetes.io/projected/0b16e72f-e958-4a4c-963b-c3457f9a8c3a-kube-api-access-jsrj7\") pod \"kube-auth-proxy-5f9949ccdc-csscl\" (UID: \"0b16e72f-e958-4a4c-963b-c3457f9a8c3a\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.454356 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.454272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98df5\" (UniqueName: \"kubernetes.io/projected/073fe6e6-99fc-4f03-9333-14f46fc17779-kube-api-access-98df5\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.454356 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.454345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073fe6e6-99fc-4f03-9333-14f46fc17779-cert\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.454530 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:52:58.454430    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 00:52:58.454530 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:52:58.454498    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073fe6e6-99fc-4f03-9333-14f46fc17779-cert podName:073fe6e6-99fc-4f03-9333-14f46fc17779 nodeName:}" failed. No retries permitted until 2026-07-16 00:52:58.954483166 +0000 UTC m=+520.877307016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/073fe6e6-99fc-4f03-9333-14f46fc17779-cert") pod "odh-model-controller-7998c67dc4-b8t2q" (UID: "073fe6e6-99fc-4f03-9333-14f46fc17779") : secret "odh-model-controller-webhook-cert" not found
Jul 16 00:52:58.467487 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.467456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98df5\" (UniqueName: \"kubernetes.io/projected/073fe6e6-99fc-4f03-9333-14f46fc17779-kube-api-access-98df5\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.495109 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.495087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"
Jul 16 00:52:58.625374 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.625347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl"]
Jul 16 00:52:58.629066 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:52:58.629027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b16e72f_e958_4a4c_963b_c3457f9a8c3a.slice/crio-8a1cb38e66c4869604a6473aaef5b265da5a0f19bf6f30750c6f8acf64b6afea WatchSource:0}: Error finding container 8a1cb38e66c4869604a6473aaef5b265da5a0f19bf6f30750c6f8acf64b6afea: Status 404 returned error can't find the container with id 8a1cb38e66c4869604a6473aaef5b265da5a0f19bf6f30750c6f8acf64b6afea
Jul 16 00:52:58.958258 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.958224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073fe6e6-99fc-4f03-9333-14f46fc17779-cert\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:58.960482 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:58.960464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073fe6e6-99fc-4f03-9333-14f46fc17779-cert\") pod \"odh-model-controller-7998c67dc4-b8t2q\" (UID: \"073fe6e6-99fc-4f03-9333-14f46fc17779\") " pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:59.232412 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.232337    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-99vb9"]
Jul 16 00:52:59.236643 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.236625    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.239258 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.239234    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 00:52:59.239399 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.239310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2bw92\""
Jul 16 00:52:59.247515 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.247488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-99vb9"]
Jul 16 00:52:59.252689 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.252671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:52:59.260988 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.260963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb3beb7-19a2-47fe-819e-652a665f0bcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.261061 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.261046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm45g\" (UniqueName: \"kubernetes.io/projected/0eb3beb7-19a2-47fe-819e-652a665f0bcc-kube-api-access-rm45g\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.361591 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.361542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb3beb7-19a2-47fe-819e-652a665f0bcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.361752 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.361727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm45g\" (UniqueName: \"kubernetes.io/projected/0eb3beb7-19a2-47fe-819e-652a665f0bcc-kube-api-access-rm45g\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.361752 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:52:59.361736    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 00:52:59.361888 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:52:59.361833    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eb3beb7-19a2-47fe-819e-652a665f0bcc-tls-certs podName:0eb3beb7-19a2-47fe-819e-652a665f0bcc nodeName:}" failed. No retries permitted until 2026-07-16 00:52:59.861815294 +0000 UTC m=+521.784639158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0eb3beb7-19a2-47fe-819e-652a665f0bcc-tls-certs") pod "model-serving-api-54d89bd5fc-99vb9" (UID: "0eb3beb7-19a2-47fe-819e-652a665f0bcc") : secret "model-serving-api-tls" not found
Jul 16 00:52:59.370474 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.370446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm45g\" (UniqueName: \"kubernetes.io/projected/0eb3beb7-19a2-47fe-819e-652a665f0bcc-kube-api-access-rm45g\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.389222 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.389198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b8t2q"]
Jul 16 00:52:59.390128 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:52:59.390104    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073fe6e6_99fc_4f03_9333_14f46fc17779.slice/crio-e7ce033676bd2ba3494892c7be8fba4e9efd7c51b59c6f6cb78a8f105fe427ea WatchSource:0}: Error finding container e7ce033676bd2ba3494892c7be8fba4e9efd7c51b59c6f6cb78a8f105fe427ea: Status 404 returned error can't find the container with id e7ce033676bd2ba3494892c7be8fba4e9efd7c51b59c6f6cb78a8f105fe427ea
Jul 16 00:52:59.517087 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.517045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q" event={"ID":"073fe6e6-99fc-4f03-9333-14f46fc17779","Type":"ContainerStarted","Data":"e7ce033676bd2ba3494892c7be8fba4e9efd7c51b59c6f6cb78a8f105fe427ea"}
Jul 16 00:52:59.518339 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.518310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl" event={"ID":"0b16e72f-e958-4a4c-963b-c3457f9a8c3a","Type":"ContainerStarted","Data":"8a1cb38e66c4869604a6473aaef5b265da5a0f19bf6f30750c6f8acf64b6afea"}
Jul 16 00:52:59.773701 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.773613    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"]
Jul 16 00:52:59.776951 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.776936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.781630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.781609    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 00:52:59.781847 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.781831    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 00:52:59.781952 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.781881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-576rm\""
Jul 16 00:52:59.782232 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.782212    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 00:52:59.782737 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.782717    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 00:52:59.798140 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.798120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"]
Jul 16 00:52:59.865338 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.865475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjm2n\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-kube-api-access-jjm2n\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.865475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.865475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99566181-7e74-4551-b107-4468668fa9a5-local-certs\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.865475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.865475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-cacerts\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.865640 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb3beb7-19a2-47fe-819e-652a665f0bcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.865640 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.865536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-istio-token\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.867661 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.867642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb3beb7-19a2-47fe-819e-652a665f0bcc-tls-certs\") pod \"model-serving-api-54d89bd5fc-99vb9\" (UID: \"0eb3beb7-19a2-47fe-819e-652a665f0bcc\") " pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:52:59.966779 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjm2n\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-kube-api-access-jjm2n\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.966779 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.966994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99566181-7e74-4551-b107-4468668fa9a5-local-certs\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.966994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.966994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-cacerts\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.966994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-istio-token\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.966994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.966980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.967688 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.967660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.969943 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.969819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99566181-7e74-4551-b107-4468668fa9a5-local-certs\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.969943 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.969849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-cacerts\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.969943 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.969945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.970325 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.970285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.976483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.976450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjm2n\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-kube-api-access-jjm2n\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:52:59.977614 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:52:59.977592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-istio-token\") pod \"istiod-openshift-gateway-7574459656-7gk7f\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:53:00.087252 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:00.086964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:53:00.147826 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:00.147659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:53:00.262318 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:00.262291    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"]
Jul 16 00:53:00.270048 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:53:00.270016    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99566181_7e74_4551_b107_4468668fa9a5.slice/crio-719ea234b083c4c9b57994f6346fce714aa4eae2d762ac05722848ed63794a6e WatchSource:0}: Error finding container 719ea234b083c4c9b57994f6346fce714aa4eae2d762ac05722848ed63794a6e: Status 404 returned error can't find the container with id 719ea234b083c4c9b57994f6346fce714aa4eae2d762ac05722848ed63794a6e
Jul 16 00:53:00.324659 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:00.324565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-99vb9"]
Jul 16 00:53:00.526241 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:00.526176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9" event={"ID":"0eb3beb7-19a2-47fe-819e-652a665f0bcc","Type":"ContainerStarted","Data":"4c31103ab4a3c93a5d578753238048d7c0bfcb84d9a95dd4312e90df574738d3"}
Jul 16 00:53:00.527733 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:00.527703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" event={"ID":"99566181-7e74-4551-b107-4468668fa9a5","Type":"ContainerStarted","Data":"719ea234b083c4c9b57994f6346fce714aa4eae2d762ac05722848ed63794a6e"}
Jul 16 00:53:03.546075 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.545983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9" event={"ID":"0eb3beb7-19a2-47fe-819e-652a665f0bcc","Type":"ContainerStarted","Data":"7fdfb0826caf1801b90bb519c64379a5dfd9720ec975912c3c7bf13b08767c2d"}
Jul 16 00:53:03.546518 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.546195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:53:03.547666 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.547633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl" event={"ID":"0b16e72f-e958-4a4c-963b-c3457f9a8c3a","Type":"ContainerStarted","Data":"d01f0fbf5b2cdcecac4875b05cdfb759fa379f8b12860fae3ae8c19f29655cdb"}
Jul 16 00:53:03.549199 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.549176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q" event={"ID":"073fe6e6-99fc-4f03-9333-14f46fc17779","Type":"ContainerStarted","Data":"6fcd0ee7fd7d3ba8dd52ff2536549c045fbcf326c5fe387495201847f4c79d7f"}
Jul 16 00:53:03.549356 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.549336    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:53:03.564777 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.564711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9" podStartSLOduration=1.591094599 podStartE2EDuration="4.564691297s" totalImagesPullingTime="2.973596698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:03.56312238 +0000 UTC m=+525.485946270" watchObservedRunningTime="2026-07-16 00:53:03.564691297 +0000 UTC m=+525.487515165"
Jul 16 00:53:03.580246 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.580199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q" podStartSLOduration=1.670638965 podStartE2EDuration="5.5801859s" totalImagesPullingTime="3.909546935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:03.578158953 +0000 UTC m=+525.500982847" watchObservedRunningTime="2026-07-16 00:53:03.5801859 +0000 UTC m=+525.503009767"
Jul 16 00:53:03.595088 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:03.595032    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-csscl" podStartSLOduration=0.92482986 podStartE2EDuration="5.595012334s" totalImagesPullingTime="4.670182474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:03.593198047 +0000 UTC m=+525.516021914" watchObservedRunningTime="2026-07-16 00:53:03.595012334 +0000 UTC m=+525.517836203"
Jul 16 00:53:04.629428 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:04.629376    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:53:04.629731 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:04.629466    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:53:05.563029 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.562978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" event={"ID":"99566181-7e74-4551-b107-4468668fa9a5","Type":"ContainerStarted","Data":"be22407026f492c4232a2747ef2d13219db1a54d5c95f673e543e7c32fd3f0a6"}
Jul 16 00:53:05.564134 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.564099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:53:05.569343 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.569307    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7gk7f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 00:53:05.569473 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.569375    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" podUID="99566181-7e74-4551-b107-4468668fa9a5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 00:53:05.589545 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.589492    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" podStartSLOduration=2.232833616 podStartE2EDuration="6.58947132s" totalImagesPullingTime="4.356637704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:05.586746045 +0000 UTC m=+527.509569913" watchObservedRunningTime="2026-07-16 00:53:05.58947132 +0000 UTC m=+527.512295187"
Jul 16 00:53:05.885328 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.885250    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"]
Jul 16 00:53:05.888667 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.888647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.893049 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.893025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-r7kqd\""
Jul 16 00:53:05.925994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.925967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"]
Jul 16 00:53:05.930176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scpbc\" (UniqueName: \"kubernetes.io/projected/96f3e6d8-71c0-4020-bd11-4e53272a9028-kube-api-access-scpbc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930303 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930303 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930422 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930422 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930422 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930422 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96f3e6d8-71c0-4020-bd11-4e53272a9028-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930628 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:05.930628 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:05.930511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031365 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031365 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96f3e6d8-71c0-4020-bd11-4e53272a9028-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scpbc\" (UniqueName: \"kubernetes.io/projected/96f3e6d8-71c0-4020-bd11-4e53272a9028-kube-api-access-scpbc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.031965 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.031900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.032134 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.032078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.032134 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.032112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.032275 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.032139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.032275 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.032218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96f3e6d8-71c0-4020-bd11-4e53272a9028-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.034219 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.034199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.034459 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.034439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.052618 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.052596    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96f3e6d8-71c0-4020-bd11-4e53272a9028-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.057898 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.057877    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scpbc\" (UniqueName: \"kubernetes.io/projected/96f3e6d8-71c0-4020-bd11-4e53272a9028-kube-api-access-scpbc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4m42gd\" (UID: \"96f3e6d8-71c0-4020-bd11-4e53272a9028\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.199913 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.199836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:06.340159 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.340129    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"]
Jul 16 00:53:06.344162 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:53:06.344131    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f3e6d8_71c0_4020_bd11_4e53272a9028.slice/crio-fa38e5877a566d39e90a1f7459c9ea80816258cbbf9e96246a168933d08e8bc2 WatchSource:0}: Error finding container fa38e5877a566d39e90a1f7459c9ea80816258cbbf9e96246a168933d08e8bc2: Status 404 returned error can't find the container with id fa38e5877a566d39e90a1f7459c9ea80816258cbbf9e96246a168933d08e8bc2
Jul 16 00:53:06.569888 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.569851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd" event={"ID":"96f3e6d8-71c0-4020-bd11-4e53272a9028","Type":"ContainerStarted","Data":"fa38e5877a566d39e90a1f7459c9ea80816258cbbf9e96246a168933d08e8bc2"}
Jul 16 00:53:06.570737 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:06.570700    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:53:08.739136 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.739074    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"]
Jul 16 00:53:08.746302 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.746267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.749644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.749481    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 00:53:08.749644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.749498    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cmp9m\""
Jul 16 00:53:08.750194 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.750171    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"]
Jul 16 00:53:08.753571 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.753551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:08.754697 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.754672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"]
Jul 16 00:53:08.756019 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.755834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 00:53:08.760548 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.760531    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wxlmh\""
Jul 16 00:53:08.772634 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.772614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"]
Jul 16 00:53:08.858399 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.858369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d0c082-aefd-4d61-a9a0-7ab7735e10a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-b69c8\" (UID: \"81d0c082-aefd-4d61-a9a0-7ab7735e10a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.858585 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.858412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxxqm\" (UniqueName: \"kubernetes.io/projected/2bd80188-406c-46c6-953d-c109352a7f89-kube-api-access-kxxqm\") pod \"llmisvc-controller-manager-777c6bd7d5-qg5t6\" (UID: \"2bd80188-406c-46c6-953d-c109352a7f89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:08.858585 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.858496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bd80188-406c-46c6-953d-c109352a7f89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg5t6\" (UID: \"2bd80188-406c-46c6-953d-c109352a7f89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:08.858675 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.858585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7jdr\" (UniqueName: \"kubernetes.io/projected/81d0c082-aefd-4d61-a9a0-7ab7735e10a1-kube-api-access-x7jdr\") pod \"kserve-controller-manager-d6f4b65b8-b69c8\" (UID: \"81d0c082-aefd-4d61-a9a0-7ab7735e10a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.959682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.959650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7jdr\" (UniqueName: \"kubernetes.io/projected/81d0c082-aefd-4d61-a9a0-7ab7735e10a1-kube-api-access-x7jdr\") pod \"kserve-controller-manager-d6f4b65b8-b69c8\" (UID: \"81d0c082-aefd-4d61-a9a0-7ab7735e10a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.959878 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.959702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d0c082-aefd-4d61-a9a0-7ab7735e10a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-b69c8\" (UID: \"81d0c082-aefd-4d61-a9a0-7ab7735e10a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.959878 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.959722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxxqm\" (UniqueName: \"kubernetes.io/projected/2bd80188-406c-46c6-953d-c109352a7f89-kube-api-access-kxxqm\") pod \"llmisvc-controller-manager-777c6bd7d5-qg5t6\" (UID: \"2bd80188-406c-46c6-953d-c109352a7f89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:08.959878 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.959762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bd80188-406c-46c6-953d-c109352a7f89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg5t6\" (UID: \"2bd80188-406c-46c6-953d-c109352a7f89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:08.962279 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.962245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bd80188-406c-46c6-953d-c109352a7f89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qg5t6\" (UID: \"2bd80188-406c-46c6-953d-c109352a7f89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:08.962397 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.962285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d0c082-aefd-4d61-a9a0-7ab7735e10a1-cert\") pod \"kserve-controller-manager-d6f4b65b8-b69c8\" (UID: \"81d0c082-aefd-4d61-a9a0-7ab7735e10a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.971519 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.971497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7jdr\" (UniqueName: \"kubernetes.io/projected/81d0c082-aefd-4d61-a9a0-7ab7735e10a1-kube-api-access-x7jdr\") pod \"kserve-controller-manager-d6f4b65b8-b69c8\" (UID: \"81d0c082-aefd-4d61-a9a0-7ab7735e10a1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:08.971645 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:08.971622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxxqm\" (UniqueName: \"kubernetes.io/projected/2bd80188-406c-46c6-953d-c109352a7f89-kube-api-access-kxxqm\") pod \"llmisvc-controller-manager-777c6bd7d5-qg5t6\" (UID: \"2bd80188-406c-46c6-953d-c109352a7f89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:09.057009 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.056979    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:53:09.057093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.057048    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:53:09.057093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.057078    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:53:09.062850 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.062833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:09.070552 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.070527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:09.223295 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.223267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"]
Jul 16 00:53:09.225385 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:53:09.225355    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d0c082_aefd_4d61_a9a0_7ab7735e10a1.slice/crio-7612bdd4e3ab0d2432e707a010fb1d2500ee666d1b80143c455c363290c383a4 WatchSource:0}: Error finding container 7612bdd4e3ab0d2432e707a010fb1d2500ee666d1b80143c455c363290c383a4: Status 404 returned error can't find the container with id 7612bdd4e3ab0d2432e707a010fb1d2500ee666d1b80143c455c363290c383a4
Jul 16 00:53:09.254843 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.254819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"]
Jul 16 00:53:09.256630 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:53:09.256602    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bd80188_406c_46c6_953d_c109352a7f89.slice/crio-c352096ba46dec79769d45a52b9abefd2e636f4b99638613bac80f9117a6a873 WatchSource:0}: Error finding container c352096ba46dec79769d45a52b9abefd2e636f4b99638613bac80f9117a6a873: Status 404 returned error can't find the container with id c352096ba46dec79769d45a52b9abefd2e636f4b99638613bac80f9117a6a873
Jul 16 00:53:09.585814 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.585758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8" event={"ID":"81d0c082-aefd-4d61-a9a0-7ab7735e10a1","Type":"ContainerStarted","Data":"7612bdd4e3ab0d2432e707a010fb1d2500ee666d1b80143c455c363290c383a4"}
Jul 16 00:53:09.586927 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.586906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6" event={"ID":"2bd80188-406c-46c6-953d-c109352a7f89","Type":"ContainerStarted","Data":"c352096ba46dec79769d45a52b9abefd2e636f4b99638613bac80f9117a6a873"}
Jul 16 00:53:09.588313 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.588294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd" event={"ID":"96f3e6d8-71c0-4020-bd11-4e53272a9028","Type":"ContainerStarted","Data":"497ac6b6e53d53b966079b254fea7a117983c9027011fee2eab2147bf2590243"}
Jul 16 00:53:09.609740 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:09.609697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd" podStartSLOduration=1.901328031 podStartE2EDuration="4.609681307s" totalImagesPullingTime="2.708353276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:09.608295049 +0000 UTC m=+531.531118959" watchObservedRunningTime="2026-07-16 00:53:09.609681307 +0000 UTC m=+531.532505173"
Jul 16 00:53:10.200364 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.200172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:10.206272 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.206082    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:10.382091 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.382056    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"]
Jul 16 00:53:10.382471 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.382261    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" podUID="99566181-7e74-4551-b107-4468668fa9a5" containerName="discovery" containerID="cri-o://be22407026f492c4232a2747ef2d13219db1a54d5c95f673e543e7c32fd3f0a6" gracePeriod=30
Jul 16 00:53:10.599908 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.599871    2578 generic.go:356] "Generic (PLEG): container finished" podID="99566181-7e74-4551-b107-4468668fa9a5" containerID="be22407026f492c4232a2747ef2d13219db1a54d5c95f673e543e7c32fd3f0a6" exitCode=0
Jul 16 00:53:10.600975 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.600951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" event={"ID":"99566181-7e74-4551-b107-4468668fa9a5","Type":"ContainerDied","Data":"be22407026f492c4232a2747ef2d13219db1a54d5c95f673e543e7c32fd3f0a6"}
Jul 16 00:53:10.601084 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.601011    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:10.602108 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.602092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4m42gd"
Jul 16 00:53:10.676926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.676898    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:53:10.776534 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-dns-cert\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.776688 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjm2n\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-kube-api-access-jjm2n\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.776688 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776569    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99566181-7e74-4551-b107-4468668fa9a5-local-certs\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.776688 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776602    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-ca-configmap\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.776838 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776725    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-istio-token\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.776887 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776853    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-kubeconfig\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.776946 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.776934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-cacerts\") pod \"99566181-7e74-4551-b107-4468668fa9a5\" (UID: \"99566181-7e74-4551-b107-4468668fa9a5\") "
Jul 16 00:53:10.777055 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.777025    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:53:10.777241 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.777221    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-ca-configmap\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:10.779148 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.779122    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99566181-7e74-4551-b107-4468668fa9a5-local-certs" (OuterVolumeSpecName: "local-certs") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:10.779341 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.779279    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:53:10.779341 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.779295    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-cacerts" (OuterVolumeSpecName: "cacerts") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:53:10.779461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.779340    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-kube-api-access-jjm2n" (OuterVolumeSpecName: "kube-api-access-jjm2n") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "kube-api-access-jjm2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:53:10.779461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.779360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:53:10.779461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.779367    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "99566181-7e74-4551-b107-4468668fa9a5" (UID: "99566181-7e74-4551-b107-4468668fa9a5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:53:10.878583 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.878551    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-kubeconfig\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:10.878583 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.878581    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-cacerts\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:10.878774 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.878595    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99566181-7e74-4551-b107-4468668fa9a5-istio-csr-dns-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:10.878774 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.878609    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjm2n\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-kube-api-access-jjm2n\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:10.878774 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.878618    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99566181-7e74-4551-b107-4468668fa9a5-local-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:10.878774 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:10.878630    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99566181-7e74-4551-b107-4468668fa9a5-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:53:11.607949 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:11.607919    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"
Jul 16 00:53:11.607949 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:11.607927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f" event={"ID":"99566181-7e74-4551-b107-4468668fa9a5","Type":"ContainerDied","Data":"719ea234b083c4c9b57994f6346fce714aa4eae2d762ac05722848ed63794a6e"}
Jul 16 00:53:11.608468 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:11.608017    2578 scope.go:117] "RemoveContainer" containerID="be22407026f492c4232a2747ef2d13219db1a54d5c95f673e543e7c32fd3f0a6"
Jul 16 00:53:11.638695 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:11.638649    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"]
Jul 16 00:53:11.642606 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:11.642543    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7gk7f"]
Jul 16 00:53:12.615258 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:12.615224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8" event={"ID":"81d0c082-aefd-4d61-a9a0-7ab7735e10a1","Type":"ContainerStarted","Data":"cbf3843c70e7bcd019c3af3884781f89f8f352dc40f2c4d1a7881f50291f918a"}
Jul 16 00:53:12.615738 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:12.615330    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:12.633283 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:12.633257    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99566181-7e74-4551-b107-4468668fa9a5" path="/var/lib/kubelet/pods/99566181-7e74-4551-b107-4468668fa9a5/volumes"
Jul 16 00:53:12.636510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:12.636461    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8" podStartSLOduration=2.019572011 podStartE2EDuration="4.636440583s" totalImagesPullingTime="2.616868572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:12.634116975 +0000 UTC m=+534.556940864" watchObservedRunningTime="2026-07-16 00:53:12.636440583 +0000 UTC m=+534.559264462"
Jul 16 00:53:13.621989 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:13.621955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6" event={"ID":"2bd80188-406c-46c6-953d-c109352a7f89","Type":"ContainerStarted","Data":"63cdd1868ec0c9638f4081a37cad4d1dbf7bbfc4f210f579b3ced309206adb65"}
Jul 16 00:53:13.664603 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:13.664535    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6" podStartSLOduration=2.211379273 podStartE2EDuration="5.664518651s" totalImagesPullingTime="3.453139378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:13.664012826 +0000 UTC m=+535.586836693" watchObservedRunningTime="2026-07-16 00:53:13.664518651 +0000 UTC m=+535.587342518"
Jul 16 00:53:14.556499 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:14.556472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-b8t2q"
Jul 16 00:53:14.558668 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:14.558639    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-99vb9"
Jul 16 00:53:14.632240 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:14.632213    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:43.627618 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:43.627584    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b69c8"
Jul 16 00:53:45.633903 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:45.633875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qg5t6"
Jul 16 00:53:59.071423 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.071383    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xlqfq"]
Jul 16 00:53:59.071978 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.071737    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99566181-7e74-4551-b107-4468668fa9a5" containerName="discovery"
Jul 16 00:53:59.071978 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.071748    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="99566181-7e74-4551-b107-4468668fa9a5" containerName="discovery"
Jul 16 00:53:59.071978 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.071828    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="99566181-7e74-4551-b107-4468668fa9a5" containerName="discovery"
Jul 16 00:53:59.075191 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.075169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:53:59.077808 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.077767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 00:53:59.077937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.077782    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 00:53:59.077937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.077842    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vwsm2\""
Jul 16 00:53:59.086444 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.086423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xlqfq"]
Jul 16 00:53:59.180051 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.180019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phhwj\" (UniqueName: \"kubernetes.io/projected/5f62a03e-cc43-4638-8135-5e470341ddb1-kube-api-access-phhwj\") pod \"kuadrant-operator-catalog-xlqfq\" (UID: \"5f62a03e-cc43-4638-8135-5e470341ddb1\") " pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:53:59.281303 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.281275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phhwj\" (UniqueName: \"kubernetes.io/projected/5f62a03e-cc43-4638-8135-5e470341ddb1-kube-api-access-phhwj\") pod \"kuadrant-operator-catalog-xlqfq\" (UID: \"5f62a03e-cc43-4638-8135-5e470341ddb1\") " pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:53:59.290946 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.290922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phhwj\" (UniqueName: \"kubernetes.io/projected/5f62a03e-cc43-4638-8135-5e470341ddb1-kube-api-access-phhwj\") pod \"kuadrant-operator-catalog-xlqfq\" (UID: \"5f62a03e-cc43-4638-8135-5e470341ddb1\") " pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:53:59.385883 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.385780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:53:59.416273 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.416238    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xlqfq"]
Jul 16 00:53:59.515257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.515232    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xlqfq"]
Jul 16 00:53:59.517702 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:53:59.517677    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f62a03e_cc43_4638_8135_5e470341ddb1.slice/crio-3f6966e742cdbd82670dd804e5630468c5be92edec9d70e50dc14a652fc0fa89 WatchSource:0}: Error finding container 3f6966e742cdbd82670dd804e5630468c5be92edec9d70e50dc14a652fc0fa89: Status 404 returned error can't find the container with id 3f6966e742cdbd82670dd804e5630468c5be92edec9d70e50dc14a652fc0fa89
Jul 16 00:53:59.622331 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.622299    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pfcz"]
Jul 16 00:53:59.625376 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.625349    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:53:59.634577 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.634555    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pfcz"]
Jul 16 00:53:59.684371 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.684295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf2np\" (UniqueName: \"kubernetes.io/projected/06164899-ad61-4e71-be10-3013dfd49e2a-kube-api-access-sf2np\") pod \"kuadrant-operator-catalog-4pfcz\" (UID: \"06164899-ad61-4e71-be10-3013dfd49e2a\") " pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:53:59.785296 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.785265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf2np\" (UniqueName: \"kubernetes.io/projected/06164899-ad61-4e71-be10-3013dfd49e2a-kube-api-access-sf2np\") pod \"kuadrant-operator-catalog-4pfcz\" (UID: \"06164899-ad61-4e71-be10-3013dfd49e2a\") " pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:53:59.794008 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.793968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf2np\" (UniqueName: \"kubernetes.io/projected/06164899-ad61-4e71-be10-3013dfd49e2a-kube-api-access-sf2np\") pod \"kuadrant-operator-catalog-4pfcz\" (UID: \"06164899-ad61-4e71-be10-3013dfd49e2a\") " pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:53:59.834132 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.834101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq" event={"ID":"5f62a03e-cc43-4638-8135-5e470341ddb1","Type":"ContainerStarted","Data":"3f6966e742cdbd82670dd804e5630468c5be92edec9d70e50dc14a652fc0fa89"}
Jul 16 00:53:59.935457 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:53:59.935371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:54:00.072463 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:00.072441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pfcz"]
Jul 16 00:54:00.074300 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:00.074275    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06164899_ad61_4e71_be10_3013dfd49e2a.slice/crio-6c245192c9601b51f9ad82b193e861241a97c042782dbf3134b1eb5d81ed0632 WatchSource:0}: Error finding container 6c245192c9601b51f9ad82b193e861241a97c042782dbf3134b1eb5d81ed0632: Status 404 returned error can't find the container with id 6c245192c9601b51f9ad82b193e861241a97c042782dbf3134b1eb5d81ed0632
Jul 16 00:54:00.841964 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:00.841930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz" event={"ID":"06164899-ad61-4e71-be10-3013dfd49e2a","Type":"ContainerStarted","Data":"6c245192c9601b51f9ad82b193e861241a97c042782dbf3134b1eb5d81ed0632"}
Jul 16 00:54:01.848364 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:01.848331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz" event={"ID":"06164899-ad61-4e71-be10-3013dfd49e2a","Type":"ContainerStarted","Data":"a16ddbfd99439fd5bf9d15d224c9d4776a965bda065aa47288ffbf9245dce259"}
Jul 16 00:54:01.849849 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:01.849817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq" event={"ID":"5f62a03e-cc43-4638-8135-5e470341ddb1","Type":"ContainerStarted","Data":"42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8"}
Jul 16 00:54:01.849961 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:01.849859    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq" podUID="5f62a03e-cc43-4638-8135-5e470341ddb1" containerName="registry-server" containerID="cri-o://42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8" gracePeriod=2
Jul 16 00:54:01.867391 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:01.867348    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz" podStartSLOduration=1.4700602649999999 podStartE2EDuration="2.867333037s" totalImagesPullingTime="1.397272772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:01.865863901 +0000 UTC m=+583.788687796" watchObservedRunningTime="2026-07-16 00:54:01.867333037 +0000 UTC m=+583.790156914"
Jul 16 00:54:01.882874 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:01.882831    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq" podStartSLOduration=0.929683992 podStartE2EDuration="2.882815455s" totalImagesPullingTime="1.953131463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:01.881895917 +0000 UTC m=+583.804719784" watchObservedRunningTime="2026-07-16 00:54:01.882815455 +0000 UTC m=+583.805639321"
Jul 16 00:54:02.099262 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.099195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:54:02.202570 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.202534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phhwj\" (UniqueName: \"kubernetes.io/projected/5f62a03e-cc43-4638-8135-5e470341ddb1-kube-api-access-phhwj\") pod \"5f62a03e-cc43-4638-8135-5e470341ddb1\" (UID: \"5f62a03e-cc43-4638-8135-5e470341ddb1\") "
Jul 16 00:54:02.204713 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.204689    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f62a03e-cc43-4638-8135-5e470341ddb1-kube-api-access-phhwj" (OuterVolumeSpecName: "kube-api-access-phhwj") pod "5f62a03e-cc43-4638-8135-5e470341ddb1" (UID: "5f62a03e-cc43-4638-8135-5e470341ddb1"). InnerVolumeSpecName "kube-api-access-phhwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:02.303403 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.303370    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phhwj\" (UniqueName: \"kubernetes.io/projected/5f62a03e-cc43-4638-8135-5e470341ddb1-kube-api-access-phhwj\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:02.856054 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.856024    2578 generic.go:356] "Generic (PLEG): container finished" podID="5f62a03e-cc43-4638-8135-5e470341ddb1" containerID="42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8" exitCode=0
Jul 16 00:54:02.856540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.856071    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq"
Jul 16 00:54:02.856540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.856101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq" event={"ID":"5f62a03e-cc43-4638-8135-5e470341ddb1","Type":"ContainerDied","Data":"42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8"}
Jul 16 00:54:02.856540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.856147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xlqfq" event={"ID":"5f62a03e-cc43-4638-8135-5e470341ddb1","Type":"ContainerDied","Data":"3f6966e742cdbd82670dd804e5630468c5be92edec9d70e50dc14a652fc0fa89"}
Jul 16 00:54:02.856540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.856166    2578 scope.go:117] "RemoveContainer" containerID="42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8"
Jul 16 00:54:02.864848 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.864831    2578 scope.go:117] "RemoveContainer" containerID="42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8"
Jul 16 00:54:02.865070 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:02.865050    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8\": container with ID starting with 42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8 not found: ID does not exist" containerID="42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8"
Jul 16 00:54:02.865139 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.865083    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8"} err="failed to get container status \"42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8\": rpc error: code = NotFound desc = could not find container \"42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8\": container with ID starting with 42794c9796753e818f31fec3fb87999b02ec859ce63cfebb4e4383eef3e569b8 not found: ID does not exist"
Jul 16 00:54:02.873196 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.873172    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xlqfq"]
Jul 16 00:54:02.879531 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:02.879507    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xlqfq"]
Jul 16 00:54:04.631872 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:04.631844    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f62a03e-cc43-4638-8135-5e470341ddb1" path="/var/lib/kubelet/pods/5f62a03e-cc43-4638-8135-5e470341ddb1/volumes"
Jul 16 00:54:09.936340 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:09.936310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:54:09.936715 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:09.936354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:54:09.958859 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:09.958836    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:54:10.914423 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:10.914394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4pfcz"
Jul 16 00:54:14.632388 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.632357    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"]
Jul 16 00:54:14.632766 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.632670    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f62a03e-cc43-4638-8135-5e470341ddb1" containerName="registry-server"
Jul 16 00:54:14.632766 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.632681    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f62a03e-cc43-4638-8135-5e470341ddb1" containerName="registry-server"
Jul 16 00:54:14.632766 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.632744    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f62a03e-cc43-4638-8135-5e470341ddb1" containerName="registry-server"
Jul 16 00:54:14.635703 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.635688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.638075 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.638056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnl4z\""
Jul 16 00:54:14.643652 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.643630    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"]
Jul 16 00:54:14.704844 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.704818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.704956 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.704904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.705029 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.704986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42n9v\" (UniqueName: \"kubernetes.io/projected/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-kube-api-access-42n9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.806088 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.806060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.806197 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.806120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.806197 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.806161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42n9v\" (UniqueName: \"kubernetes.io/projected/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-kube-api-access-42n9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.806434 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.806417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.806514 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.806495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.815299 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.815276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42n9v\" (UniqueName: \"kubernetes.io/projected/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-kube-api-access-42n9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:14.946044 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:14.945958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:15.076505 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.076433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"]
Jul 16 00:54:15.078918 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:15.078891    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04a32ad_35e8_4a7f_9ac5_f1743cf3435b.slice/crio-227990c1dc1bb083959012fa2d83ed01845f9098ff1f384188341454f2732929 WatchSource:0}: Error finding container 227990c1dc1bb083959012fa2d83ed01845f9098ff1f384188341454f2732929: Status 404 returned error can't find the container with id 227990c1dc1bb083959012fa2d83ed01845f9098ff1f384188341454f2732929
Jul 16 00:54:15.231567 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.231500    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"]
Jul 16 00:54:15.234884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.234868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.243988 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.243784    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"]
Jul 16 00:54:15.310992 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.310965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.311139 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.311004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcxgn\" (UniqueName: \"kubernetes.io/projected/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-kube-api-access-gcxgn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.311139 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.311068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.411546 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.411514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.411717 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.411604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.411717 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.411642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcxgn\" (UniqueName: \"kubernetes.io/projected/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-kube-api-access-gcxgn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.412002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.411983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.412056 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.411993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.420406 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.420388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcxgn\" (UniqueName: \"kubernetes.io/projected/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-kube-api-access-gcxgn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.560449 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.560405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:15.689176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.689154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"]
Jul 16 00:54:15.690722 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:15.690696    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c62c55d_a7d9_41a0_9a2d_a38b105759d9.slice/crio-6365581c58d9b25b2c6d932c5a5e2c0698520b0bd76370e086db06dde2eeb0bc WatchSource:0}: Error finding container 6365581c58d9b25b2c6d932c5a5e2c0698520b0bd76370e086db06dde2eeb0bc: Status 404 returned error can't find the container with id 6365581c58d9b25b2c6d932c5a5e2c0698520b0bd76370e086db06dde2eeb0bc
Jul 16 00:54:15.917362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.917327    2578 generic.go:356] "Generic (PLEG): container finished" podID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerID="a135a2e2839f97b0e3b311cac45c5a030f01324f5517a33a67cc3d8faf8e43ee" exitCode=0
Jul 16 00:54:15.917503 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.917381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf" event={"ID":"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b","Type":"ContainerDied","Data":"a135a2e2839f97b0e3b311cac45c5a030f01324f5517a33a67cc3d8faf8e43ee"}
Jul 16 00:54:15.917503 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.917440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf" event={"ID":"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b","Type":"ContainerStarted","Data":"227990c1dc1bb083959012fa2d83ed01845f9098ff1f384188341454f2732929"}
Jul 16 00:54:15.919028 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.919005    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerID="c199fe5ae379733e9e8d4ce608dc2239a6b95f89ac16cfd8487d4424993a3e25" exitCode=0
Jul 16 00:54:15.919137 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.919058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx" event={"ID":"8c62c55d-a7d9-41a0-9a2d-a38b105759d9","Type":"ContainerDied","Data":"c199fe5ae379733e9e8d4ce608dc2239a6b95f89ac16cfd8487d4424993a3e25"}
Jul 16 00:54:15.919137 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:15.919089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx" event={"ID":"8c62c55d-a7d9-41a0-9a2d-a38b105759d9","Type":"ContainerStarted","Data":"6365581c58d9b25b2c6d932c5a5e2c0698520b0bd76370e086db06dde2eeb0bc"}
Jul 16 00:54:16.029538 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.029506    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"]
Jul 16 00:54:16.032915 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.032899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.041699 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.041672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"]
Jul 16 00:54:16.116574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.116508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.116574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.116535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.116734 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.116575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5phlx\" (UniqueName: \"kubernetes.io/projected/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-kube-api-access-5phlx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.217461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.217431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.217461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.217462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.217681 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.217495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5phlx\" (UniqueName: \"kubernetes.io/projected/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-kube-api-access-5phlx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.217922 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.217899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.218005 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.217940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.226618 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.226598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5phlx\" (UniqueName: \"kubernetes.io/projected/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-kube-api-access-5phlx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.342510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.342478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:16.472923 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.472901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"]
Jul 16 00:54:16.474766 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:16.474737    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bfceeb_6089_48ba_bcf3_3a0b5544bb78.slice/crio-479f346a97775213a442d444ccfbae6e99343f45ee020f7a2109468500238e2d WatchSource:0}: Error finding container 479f346a97775213a442d444ccfbae6e99343f45ee020f7a2109468500238e2d: Status 404 returned error can't find the container with id 479f346a97775213a442d444ccfbae6e99343f45ee020f7a2109468500238e2d
Jul 16 00:54:16.632818 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.632765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"]
Jul 16 00:54:16.636393 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.636371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.645002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.644960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"]
Jul 16 00:54:16.720763 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.720728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n29t\" (UniqueName: \"kubernetes.io/projected/06d27642-3cff-43b2-a43b-103d3beb266a-kube-api-access-7n29t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.721097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.720822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.721097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.720850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.821574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.821548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.821670 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.821630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n29t\" (UniqueName: \"kubernetes.io/projected/06d27642-3cff-43b2-a43b-103d3beb266a-kube-api-access-7n29t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.821739 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.821709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.822014 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.821990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.822137 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.822032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.832021 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.831997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n29t\" (UniqueName: \"kubernetes.io/projected/06d27642-3cff-43b2-a43b-103d3beb266a-kube-api-access-7n29t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:16.925645 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.925615    2578 generic.go:356] "Generic (PLEG): container finished" podID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerID="2169ca3f781a671e496f2f503f7fc403401f9e8019c197b09c4d155c85df0752" exitCode=0
Jul 16 00:54:16.925764 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.925697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf" event={"ID":"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b","Type":"ContainerDied","Data":"2169ca3f781a671e496f2f503f7fc403401f9e8019c197b09c4d155c85df0752"}
Jul 16 00:54:16.927552 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.927523    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerID="c75dc71ba0df81d0056b732e5107ee0c729788ed72e9bdab302bfe8bd6856782" exitCode=0
Jul 16 00:54:16.927633 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.927601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx" event={"ID":"8c62c55d-a7d9-41a0-9a2d-a38b105759d9","Type":"ContainerDied","Data":"c75dc71ba0df81d0056b732e5107ee0c729788ed72e9bdab302bfe8bd6856782"}
Jul 16 00:54:16.929147 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.929128    2578 generic.go:356] "Generic (PLEG): container finished" podID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerID="eec2fe5e2c3d84b25f77df9ee1ced65df55122642a705ad40b6bdcc9f45b1999" exitCode=0
Jul 16 00:54:16.929241 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.929150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr" event={"ID":"95bfceeb-6089-48ba-bcf3-3a0b5544bb78","Type":"ContainerDied","Data":"eec2fe5e2c3d84b25f77df9ee1ced65df55122642a705ad40b6bdcc9f45b1999"}
Jul 16 00:54:16.929241 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.929188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr" event={"ID":"95bfceeb-6089-48ba-bcf3-3a0b5544bb78","Type":"ContainerStarted","Data":"479f346a97775213a442d444ccfbae6e99343f45ee020f7a2109468500238e2d"}
Jul 16 00:54:16.948614 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:16.948325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:17.104215 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.104125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"]
Jul 16 00:54:17.128879 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:17.128850    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d27642_3cff_43b2_a43b_103d3beb266a.slice/crio-6c9a478fa52b094c8b9dfbbb0fba9f28ee155b45cd05451ad8f1e85e23cdb67c WatchSource:0}: Error finding container 6c9a478fa52b094c8b9dfbbb0fba9f28ee155b45cd05451ad8f1e85e23cdb67c: Status 404 returned error can't find the container with id 6c9a478fa52b094c8b9dfbbb0fba9f28ee155b45cd05451ad8f1e85e23cdb67c
Jul 16 00:54:17.935582 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.935552    2578 generic.go:356] "Generic (PLEG): container finished" podID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerID="151828bc688d0322777c26e6de0876154d9f9f18a6063ba88d092d8313b31f9f" exitCode=0
Jul 16 00:54:17.935974 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.935635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr" event={"ID":"95bfceeb-6089-48ba-bcf3-3a0b5544bb78","Type":"ContainerDied","Data":"151828bc688d0322777c26e6de0876154d9f9f18a6063ba88d092d8313b31f9f"}
Jul 16 00:54:17.937881 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.937855    2578 generic.go:356] "Generic (PLEG): container finished" podID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerID="1d8c6a73b13e735e54ab9bae16f352f26de6799151bfb39dc9a330ed2dabc80e" exitCode=0
Jul 16 00:54:17.937967 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.937936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf" event={"ID":"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b","Type":"ContainerDied","Data":"1d8c6a73b13e735e54ab9bae16f352f26de6799151bfb39dc9a330ed2dabc80e"}
Jul 16 00:54:17.939328 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.939310    2578 generic.go:356] "Generic (PLEG): container finished" podID="06d27642-3cff-43b2-a43b-103d3beb266a" containerID="985faf2489e4563d01fb27c4f91b199c0d81c0806967c3acb97a478befd6ac1d" exitCode=0
Jul 16 00:54:17.939417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.939390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk" event={"ID":"06d27642-3cff-43b2-a43b-103d3beb266a","Type":"ContainerDied","Data":"985faf2489e4563d01fb27c4f91b199c0d81c0806967c3acb97a478befd6ac1d"}
Jul 16 00:54:17.939474 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.939430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk" event={"ID":"06d27642-3cff-43b2-a43b-103d3beb266a","Type":"ContainerStarted","Data":"6c9a478fa52b094c8b9dfbbb0fba9f28ee155b45cd05451ad8f1e85e23cdb67c"}
Jul 16 00:54:17.941681 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.941657    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerID="5bc57c79107f3a18f489258bdd3c8e595db82173c795a15e23b4a5bfd62d407c" exitCode=0
Jul 16 00:54:17.941811 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:17.941704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx" event={"ID":"8c62c55d-a7d9-41a0-9a2d-a38b105759d9","Type":"ContainerDied","Data":"5bc57c79107f3a18f489258bdd3c8e595db82173c795a15e23b4a5bfd62d407c"}
Jul 16 00:54:18.500865 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.500838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:54:18.500993 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.500879    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:54:18.504440 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.504425    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:54:18.504542 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.504449    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:54:18.948284 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.948249    2578 generic.go:356] "Generic (PLEG): container finished" podID="06d27642-3cff-43b2-a43b-103d3beb266a" containerID="dfdbd847933c261cb4cc3986c73da9f8c7c498dbcb8029fd1de0726a4891bb82" exitCode=0
Jul 16 00:54:18.948750 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.948336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk" event={"ID":"06d27642-3cff-43b2-a43b-103d3beb266a","Type":"ContainerDied","Data":"dfdbd847933c261cb4cc3986c73da9f8c7c498dbcb8029fd1de0726a4891bb82"}
Jul 16 00:54:18.950685 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.950666    2578 generic.go:356] "Generic (PLEG): container finished" podID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerID="cd50dcee9d5fbabf263f846fbcdd899e9777a12400b50a920d04b77a2c8c88eb" exitCode=0
Jul 16 00:54:18.950825 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:18.950744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr" event={"ID":"95bfceeb-6089-48ba-bcf3-3a0b5544bb78","Type":"ContainerDied","Data":"cd50dcee9d5fbabf263f846fbcdd899e9777a12400b50a920d04b77a2c8c88eb"}
Jul 16 00:54:19.091977 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.091954    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:19.140229 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.140203    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-util\") pod \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") "
Jul 16 00:54:19.140325 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.140313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-bundle\") pod \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") "
Jul 16 00:54:19.140373 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.140344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcxgn\" (UniqueName: \"kubernetes.io/projected/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-kube-api-access-gcxgn\") pod \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\" (UID: \"8c62c55d-a7d9-41a0-9a2d-a38b105759d9\") "
Jul 16 00:54:19.140873 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.140834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-bundle" (OuterVolumeSpecName: "bundle") pod "8c62c55d-a7d9-41a0-9a2d-a38b105759d9" (UID: "8c62c55d-a7d9-41a0-9a2d-a38b105759d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:19.142539 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.142513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-kube-api-access-gcxgn" (OuterVolumeSpecName: "kube-api-access-gcxgn") pod "8c62c55d-a7d9-41a0-9a2d-a38b105759d9" (UID: "8c62c55d-a7d9-41a0-9a2d-a38b105759d9"). InnerVolumeSpecName "kube-api-access-gcxgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:19.146396 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.146370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-util" (OuterVolumeSpecName: "util") pod "8c62c55d-a7d9-41a0-9a2d-a38b105759d9" (UID: "8c62c55d-a7d9-41a0-9a2d-a38b105759d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:19.180025 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.180009    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:19.241555 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.241492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-util\") pod \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") "
Jul 16 00:54:19.241555 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.241524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-bundle\") pod \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") "
Jul 16 00:54:19.241688 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.241580    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42n9v\" (UniqueName: \"kubernetes.io/projected/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-kube-api-access-42n9v\") pod \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\" (UID: \"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b\") "
Jul 16 00:54:19.241888 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.241871    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcxgn\" (UniqueName: \"kubernetes.io/projected/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-kube-api-access-gcxgn\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:19.241926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.241894    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-util\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:19.241926 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.241908    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c62c55d-a7d9-41a0-9a2d-a38b105759d9-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:19.242111 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.242086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-bundle" (OuterVolumeSpecName: "bundle") pod "c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" (UID: "c04a32ad-35e8-4a7f-9ac5-f1743cf3435b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:19.243630 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.243605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-kube-api-access-42n9v" (OuterVolumeSpecName: "kube-api-access-42n9v") pod "c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" (UID: "c04a32ad-35e8-4a7f-9ac5-f1743cf3435b"). InnerVolumeSpecName "kube-api-access-42n9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:19.247065 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.247046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-util" (OuterVolumeSpecName: "util") pod "c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" (UID: "c04a32ad-35e8-4a7f-9ac5-f1743cf3435b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:19.343078 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.343055    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-util\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:19.343078 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.343075    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:19.343233 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.343085    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42n9v\" (UniqueName: \"kubernetes.io/projected/c04a32ad-35e8-4a7f-9ac5-f1743cf3435b-kube-api-access-42n9v\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:19.958634 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.958603    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf"
Jul 16 00:54:19.961097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.958609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf" event={"ID":"c04a32ad-35e8-4a7f-9ac5-f1743cf3435b","Type":"ContainerDied","Data":"227990c1dc1bb083959012fa2d83ed01845f9098ff1f384188341454f2732929"}
Jul 16 00:54:19.961097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.958762    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="227990c1dc1bb083959012fa2d83ed01845f9098ff1f384188341454f2732929"
Jul 16 00:54:19.961097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.960831    2578 generic.go:356] "Generic (PLEG): container finished" podID="06d27642-3cff-43b2-a43b-103d3beb266a" containerID="71fc5ada1af6ef38c939410520aded0280121b52714aefba2ea855e5479745ce" exitCode=0
Jul 16 00:54:19.961097 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.960944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk" event={"ID":"06d27642-3cff-43b2-a43b-103d3beb266a","Type":"ContainerDied","Data":"71fc5ada1af6ef38c939410520aded0280121b52714aefba2ea855e5479745ce"}
Jul 16 00:54:19.963088 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.963067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx"
Jul 16 00:54:19.963197 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.963088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx" event={"ID":"8c62c55d-a7d9-41a0-9a2d-a38b105759d9","Type":"ContainerDied","Data":"6365581c58d9b25b2c6d932c5a5e2c0698520b0bd76370e086db06dde2eeb0bc"}
Jul 16 00:54:19.963197 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:19.963125    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6365581c58d9b25b2c6d932c5a5e2c0698520b0bd76370e086db06dde2eeb0bc"
Jul 16 00:54:20.099358 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.099338    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:20.149059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.149038    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-bundle\") pod \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") "
Jul 16 00:54:20.149185 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.149093    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5phlx\" (UniqueName: \"kubernetes.io/projected/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-kube-api-access-5phlx\") pod \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") "
Jul 16 00:54:20.149185 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.149116    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-util\") pod \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\" (UID: \"95bfceeb-6089-48ba-bcf3-3a0b5544bb78\") "
Jul 16 00:54:20.149568 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.149542    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-bundle" (OuterVolumeSpecName: "bundle") pod "95bfceeb-6089-48ba-bcf3-3a0b5544bb78" (UID: "95bfceeb-6089-48ba-bcf3-3a0b5544bb78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:20.151166 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.151142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-kube-api-access-5phlx" (OuterVolumeSpecName: "kube-api-access-5phlx") pod "95bfceeb-6089-48ba-bcf3-3a0b5544bb78" (UID: "95bfceeb-6089-48ba-bcf3-3a0b5544bb78"). InnerVolumeSpecName "kube-api-access-5phlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:20.154884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.154858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-util" (OuterVolumeSpecName: "util") pod "95bfceeb-6089-48ba-bcf3-3a0b5544bb78" (UID: "95bfceeb-6089-48ba-bcf3-3a0b5544bb78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:20.249916 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.249843    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:20.249916 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.249866    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5phlx\" (UniqueName: \"kubernetes.io/projected/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-kube-api-access-5phlx\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:20.249916 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.249874    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bfceeb-6089-48ba-bcf3-3a0b5544bb78-util\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:20.970177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.970094    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr"
Jul 16 00:54:20.970177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.970115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr" event={"ID":"95bfceeb-6089-48ba-bcf3-3a0b5544bb78","Type":"ContainerDied","Data":"479f346a97775213a442d444ccfbae6e99343f45ee020f7a2109468500238e2d"}
Jul 16 00:54:20.970177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:20.970160    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="479f346a97775213a442d444ccfbae6e99343f45ee020f7a2109468500238e2d"
Jul 16 00:54:21.096530 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.096508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:21.158223 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.158198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n29t\" (UniqueName: \"kubernetes.io/projected/06d27642-3cff-43b2-a43b-103d3beb266a-kube-api-access-7n29t\") pod \"06d27642-3cff-43b2-a43b-103d3beb266a\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") "
Jul 16 00:54:21.158371 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.158231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-bundle\") pod \"06d27642-3cff-43b2-a43b-103d3beb266a\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") "
Jul 16 00:54:21.158371 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.158283    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-util\") pod \"06d27642-3cff-43b2-a43b-103d3beb266a\" (UID: \"06d27642-3cff-43b2-a43b-103d3beb266a\") "
Jul 16 00:54:21.158773 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.158742    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-bundle" (OuterVolumeSpecName: "bundle") pod "06d27642-3cff-43b2-a43b-103d3beb266a" (UID: "06d27642-3cff-43b2-a43b-103d3beb266a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:21.160187 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.160158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d27642-3cff-43b2-a43b-103d3beb266a-kube-api-access-7n29t" (OuterVolumeSpecName: "kube-api-access-7n29t") pod "06d27642-3cff-43b2-a43b-103d3beb266a" (UID: "06d27642-3cff-43b2-a43b-103d3beb266a"). InnerVolumeSpecName "kube-api-access-7n29t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:21.163744 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.163724    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-util" (OuterVolumeSpecName: "util") pod "06d27642-3cff-43b2-a43b-103d3beb266a" (UID: "06d27642-3cff-43b2-a43b-103d3beb266a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:21.259617 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.259545    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-util\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:21.259617 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.259569    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n29t\" (UniqueName: \"kubernetes.io/projected/06d27642-3cff-43b2-a43b-103d3beb266a-kube-api-access-7n29t\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:21.259617 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.259580    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06d27642-3cff-43b2-a43b-103d3beb266a-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:21.976682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.976658    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk"
Jul 16 00:54:21.977064 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.976652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk" event={"ID":"06d27642-3cff-43b2-a43b-103d3beb266a","Type":"ContainerDied","Data":"6c9a478fa52b094c8b9dfbbb0fba9f28ee155b45cd05451ad8f1e85e23cdb67c"}
Jul 16 00:54:21.977064 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:21.976784    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c9a478fa52b094c8b9dfbbb0fba9f28ee155b45cd05451ad8f1e85e23cdb67c"
Jul 16 00:54:33.033771 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.033739    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"]
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034079    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034091    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034101    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034106    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034114    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034119    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034127    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034132    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034138    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034143    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034149    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034154    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034162    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034167    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034178    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034183    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="util"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034192    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034197    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034202    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034207    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="extract"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034213    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034218    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034225    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="pull"
Jul 16 00:54:33.034226 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034230    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="pull"
Jul 16 00:54:33.034950 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034280    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d27642-3cff-43b2-a43b-103d3beb266a" containerName="extract"
Jul 16 00:54:33.034950 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034287    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c04a32ad-35e8-4a7f-9ac5-f1743cf3435b" containerName="extract"
Jul 16 00:54:33.034950 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034294    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95bfceeb-6089-48ba-bcf3-3a0b5544bb78" containerName="extract"
Jul 16 00:54:33.034950 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.034299    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c62c55d-a7d9-41a0-9a2d-a38b105759d9" containerName="extract"
Jul 16 00:54:33.038539 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.038521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.041257 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.041233    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2wr9j\""
Jul 16 00:54:33.049679 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.049656    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"]
Jul 16 00:54:33.166382 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.166327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb897c4-7545-4ab9-942e-5136e6ad840c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.166569 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.166418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbz52\" (UniqueName: \"kubernetes.io/projected/fdb897c4-7545-4ab9-942e-5136e6ad840c-kube-api-access-qbz52\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.267418 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.267383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbz52\" (UniqueName: \"kubernetes.io/projected/fdb897c4-7545-4ab9-942e-5136e6ad840c-kube-api-access-qbz52\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.267587 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.267475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb897c4-7545-4ab9-942e-5136e6ad840c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.267883 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.267856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb897c4-7545-4ab9-942e-5136e6ad840c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.278705 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.278671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbz52\" (UniqueName: \"kubernetes.io/projected/fdb897c4-7545-4ab9-942e-5136e6ad840c-kube-api-access-qbz52\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.348521 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.348419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:33.487494 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:33.487469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"]
Jul 16 00:54:33.489152 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:33.489124    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb897c4_7545_4ab9_942e_5136e6ad840c.slice/crio-21bf96748b27e56062e75baddfb37fc6c7a6888dc295bbb50fdecb551bad3f28 WatchSource:0}: Error finding container 21bf96748b27e56062e75baddfb37fc6c7a6888dc295bbb50fdecb551bad3f28: Status 404 returned error can't find the container with id 21bf96748b27e56062e75baddfb37fc6c7a6888dc295bbb50fdecb551bad3f28
Jul 16 00:54:34.039365 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.039333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9" event={"ID":"fdb897c4-7545-4ab9-942e-5136e6ad840c","Type":"ContainerStarted","Data":"21bf96748b27e56062e75baddfb37fc6c7a6888dc295bbb50fdecb551bad3f28"}
Jul 16 00:54:34.155093 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.155057    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6479b996d7-84bpj"]
Jul 16 00:54:34.159827 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.159805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.183562 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.183534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6479b996d7-84bpj"]
Jul 16 00:54:34.278242 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d288563f-17e9-467b-9486-590cba4d0373-console-oauth-config\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.278428 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-trusted-ca-bundle\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.278428 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2nfg\" (UniqueName: \"kubernetes.io/projected/d288563f-17e9-467b-9486-590cba4d0373-kube-api-access-n2nfg\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.278428 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-service-ca\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.278428 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-oauth-serving-cert\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.278654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-console-config\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.278654 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.278566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d288563f-17e9-467b-9486-590cba4d0373-console-serving-cert\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d288563f-17e9-467b-9486-590cba4d0373-console-serving-cert\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379704 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d288563f-17e9-467b-9486-590cba4d0373-console-oauth-config\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379933 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-trusted-ca-bundle\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379933 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nfg\" (UniqueName: \"kubernetes.io/projected/d288563f-17e9-467b-9486-590cba4d0373-kube-api-access-n2nfg\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379933 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-service-ca\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379933 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-oauth-serving-cert\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.379933 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.379897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-console-config\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.380644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.380612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-service-ca\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.380644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.380633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-console-config\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.380840 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.380672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-oauth-serving-cert\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.380840 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.380739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d288563f-17e9-467b-9486-590cba4d0373-trusted-ca-bundle\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.382176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.382157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d288563f-17e9-467b-9486-590cba4d0373-console-serving-cert\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.382452 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.382436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d288563f-17e9-467b-9486-590cba4d0373-console-oauth-config\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.398873 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.398855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2nfg\" (UniqueName: \"kubernetes.io/projected/d288563f-17e9-467b-9486-590cba4d0373-kube-api-access-n2nfg\") pod \"console-6479b996d7-84bpj\" (UID: \"d288563f-17e9-467b-9486-590cba4d0373\") " pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.472742 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.472705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:34.655001 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:34.654978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6479b996d7-84bpj"]
Jul 16 00:54:34.655758 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:34.655735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd288563f_17e9_467b_9486_590cba4d0373.slice/crio-eb0e5df17454dc4551a3bbd3d3574d55c169ba1a1d785fd4475cfba62709a48d WatchSource:0}: Error finding container eb0e5df17454dc4551a3bbd3d3574d55c169ba1a1d785fd4475cfba62709a48d: Status 404 returned error can't find the container with id eb0e5df17454dc4551a3bbd3d3574d55c169ba1a1d785fd4475cfba62709a48d
Jul 16 00:54:35.046029 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.045994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6479b996d7-84bpj" event={"ID":"d288563f-17e9-467b-9486-590cba4d0373","Type":"ContainerStarted","Data":"5719327466f95b237143e514e46ae85591f06862991cd7a68dce81e3d5f67d75"}
Jul 16 00:54:35.046391 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.046041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6479b996d7-84bpj" event={"ID":"d288563f-17e9-467b-9486-590cba4d0373","Type":"ContainerStarted","Data":"eb0e5df17454dc4551a3bbd3d3574d55c169ba1a1d785fd4475cfba62709a48d"}
Jul 16 00:54:35.077767 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.077720    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6479b996d7-84bpj" podStartSLOduration=1.077706103 podStartE2EDuration="1.077706103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:35.076254183 +0000 UTC m=+616.999078074" watchObservedRunningTime="2026-07-16 00:54:35.077706103 +0000 UTC m=+617.000529967"
Jul 16 00:54:35.610606 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.610575    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"]
Jul 16 00:54:35.618403 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.618376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:35.621016 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.620995    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b9bm4\""
Jul 16 00:54:35.627425 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.627400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"]
Jul 16 00:54:35.794917 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.794881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6vl7\" (UniqueName: \"kubernetes.io/projected/93994bb8-008a-4580-a66f-832a03dc8e64-kube-api-access-b6vl7\") pod \"authorino-operator-75cc8d5cb7-lchhm\" (UID: \"93994bb8-008a-4580-a66f-832a03dc8e64\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:35.895937 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.895828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vl7\" (UniqueName: \"kubernetes.io/projected/93994bb8-008a-4580-a66f-832a03dc8e64-kube-api-access-b6vl7\") pod \"authorino-operator-75cc8d5cb7-lchhm\" (UID: \"93994bb8-008a-4580-a66f-832a03dc8e64\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:35.905737 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.905707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6vl7\" (UniqueName: \"kubernetes.io/projected/93994bb8-008a-4580-a66f-832a03dc8e64-kube-api-access-b6vl7\") pod \"authorino-operator-75cc8d5cb7-lchhm\" (UID: \"93994bb8-008a-4580-a66f-832a03dc8e64\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:35.930734 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:35.930699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:36.081254 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:36.081222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"]
Jul 16 00:54:36.083549 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:36.083510    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93994bb8_008a_4580_a66f_832a03dc8e64.slice/crio-7039e3daa619081f0e9d9072584f0e5f344a38ff6e6a64ded0bbe24a5ca8b98a WatchSource:0}: Error finding container 7039e3daa619081f0e9d9072584f0e5f344a38ff6e6a64ded0bbe24a5ca8b98a: Status 404 returned error can't find the container with id 7039e3daa619081f0e9d9072584f0e5f344a38ff6e6a64ded0bbe24a5ca8b98a
Jul 16 00:54:37.065970 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:37.065922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm" event={"ID":"93994bb8-008a-4580-a66f-832a03dc8e64","Type":"ContainerStarted","Data":"7039e3daa619081f0e9d9072584f0e5f344a38ff6e6a64ded0bbe24a5ca8b98a"}
Jul 16 00:54:39.959581 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:39.959503    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"]
Jul 16 00:54:39.963458 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:39.963437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:39.966207 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:39.966188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dxx9d\""
Jul 16 00:54:39.977423 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:39.977400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"]
Jul 16 00:54:40.083266 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.083236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9" event={"ID":"fdb897c4-7545-4ab9-942e-5136e6ad840c","Type":"ContainerStarted","Data":"30a189c0f06fae796d219ff958cbd2aa1f6eec3c80dbdcd473aa9f5edf565499"}
Jul 16 00:54:40.083438 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.083333    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:40.084870 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.084846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm" event={"ID":"93994bb8-008a-4580-a66f-832a03dc8e64","Type":"ContainerStarted","Data":"eac88da75149954554017fd8443b30e280e6cd6e043fd6f0674d67c5adaa4223"}
Jul 16 00:54:40.084975 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.084969    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:40.111880 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.111842    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9" podStartSLOduration=1.042973147 podStartE2EDuration="7.11183072s" totalImagesPullingTime="6.068857573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:40.109051806 +0000 UTC m=+622.031875672" watchObservedRunningTime="2026-07-16 00:54:40.11183072 +0000 UTC m=+622.034654587"
Jul 16 00:54:40.127035 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.126995    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm" podStartSLOduration=1.6655788089999999 podStartE2EDuration="5.126983231s" totalImagesPullingTime="3.461404422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:40.124813442 +0000 UTC m=+622.047637324" watchObservedRunningTime="2026-07-16 00:54:40.126983231 +0000 UTC m=+622.049807135"
Jul 16 00:54:40.137524 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.137496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trkfb\" (UniqueName: \"kubernetes.io/projected/95f66f0b-a0ac-474d-8295-8ae583c3e851-kube-api-access-trkfb\") pod \"limitador-operator-controller-manager-859d7b78bd-94vs7\" (UID: \"95f66f0b-a0ac-474d-8295-8ae583c3e851\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:40.238511 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.238371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trkfb\" (UniqueName: \"kubernetes.io/projected/95f66f0b-a0ac-474d-8295-8ae583c3e851-kube-api-access-trkfb\") pod \"limitador-operator-controller-manager-859d7b78bd-94vs7\" (UID: \"95f66f0b-a0ac-474d-8295-8ae583c3e851\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:40.247487 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.247466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trkfb\" (UniqueName: \"kubernetes.io/projected/95f66f0b-a0ac-474d-8295-8ae583c3e851-kube-api-access-trkfb\") pod \"limitador-operator-controller-manager-859d7b78bd-94vs7\" (UID: \"95f66f0b-a0ac-474d-8295-8ae583c3e851\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:40.273334 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.273312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:40.409719 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:40.409694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"]
Jul 16 00:54:40.411568 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:40.411542    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f66f0b_a0ac_474d_8295_8ae583c3e851.slice/crio-72307178f0dfd85ad1987ddc5d4288357849adc20ad9323efb811945fc00e384 WatchSource:0}: Error finding container 72307178f0dfd85ad1987ddc5d4288357849adc20ad9323efb811945fc00e384: Status 404 returned error can't find the container with id 72307178f0dfd85ad1987ddc5d4288357849adc20ad9323efb811945fc00e384
Jul 16 00:54:41.093007 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:41.092967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7" event={"ID":"95f66f0b-a0ac-474d-8295-8ae583c3e851","Type":"ContainerStarted","Data":"72307178f0dfd85ad1987ddc5d4288357849adc20ad9323efb811945fc00e384"}
Jul 16 00:54:43.105961 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:43.105926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7" event={"ID":"95f66f0b-a0ac-474d-8295-8ae583c3e851","Type":"ContainerStarted","Data":"1b4041f4ea28b6eba5b49abdf1276b02d93e835045c8a84d9a97126b7dd0cf16"}
Jul 16 00:54:43.106349 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:43.106071    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:43.131050 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:43.131002    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7" podStartSLOduration=2.423370552 podStartE2EDuration="4.130986528s" totalImagesPullingTime="1.707615976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:43.129408892 +0000 UTC m=+625.052232785" watchObservedRunningTime="2026-07-16 00:54:43.130986528 +0000 UTC m=+625.053810448"
Jul 16 00:54:44.473827 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:44.473775    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:44.474317 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:44.473860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:44.478574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:44.478552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:45.121464 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:45.121429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6479b996d7-84bpj"
Jul 16 00:54:45.174220 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:45.174190    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97d74bc69-rdkx4"]
Jul 16 00:54:51.095123 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:51.095093    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:51.095628 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:51.095181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lchhm"
Jul 16 00:54:52.907747 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.907717    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"]
Jul 16 00:54:52.908175 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.907925    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" containerName="manager" containerID="cri-o://30a189c0f06fae796d219ff958cbd2aa1f6eec3c80dbdcd473aa9f5edf565499" gracePeriod=2
Jul 16 00:54:52.920150 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.920123    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"]
Jul 16 00:54:52.925667 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.925627    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fdb897c4-7545-4ab9-942e-5136e6ad840c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:52.934637 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.934615    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"]
Jul 16 00:54:52.935035 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.935022    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" containerName="manager"
Jul 16 00:54:52.935087 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.935037    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" containerName="manager"
Jul 16 00:54:52.935123 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.935092    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" containerName="manager"
Jul 16 00:54:52.938167 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.938146    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"]
Jul 16 00:54:52.938374 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.938345    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" containerName="manager" containerID="cri-o://1b4041f4ea28b6eba5b49abdf1276b02d93e835045c8a84d9a97126b7dd0cf16" gracePeriod=2
Jul 16 00:54:52.938462 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.938390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:52.940341 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.940314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:52.940553 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.940524    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:52.944017 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.943998    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"]
Jul 16 00:54:52.944745 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.944707    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:52.946725 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.946704    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:52.960806 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.960727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"]
Jul 16 00:54:52.963198 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.963179    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"]
Jul 16 00:54:52.963498 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.963487    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" containerName="manager"
Jul 16 00:54:52.963539 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.963499    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" containerName="manager"
Jul 16 00:54:52.963584 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.963561    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" containerName="manager"
Jul 16 00:54:52.971497 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.971458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:54:52.977379 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:52.977329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"]
Jul 16 00:54:52.981918 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.981884    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:52.984097 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.984029    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:52.986471 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:52.986447    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:53.045345 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.045319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2lt\" (UniqueName: \"kubernetes.io/projected/152cd166-ac1a-4a7e-b4b5-52d781fedb48-kube-api-access-zj2lt\") pod \"limitador-operator-controller-manager-859d7b78bd-8djdv\" (UID: \"152cd166-ac1a-4a7e-b4b5-52d781fedb48\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:54:53.045551 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.045513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tpkds\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.045634 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.045554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nmd8\" (UniqueName: \"kubernetes.io/projected/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-kube-api-access-4nmd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tpkds\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.085831 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.085775    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"]
Jul 16 00:54:53.089442 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.089423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.118600 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.118569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"]
Jul 16 00:54:53.136975 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:53.136939    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:53.138719 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:53.138695    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:53.146151 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.146127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dscnl\" (UniqueName: \"kubernetes.io/projected/2d2faf30-d3f7-41b5-b686-5235edd9083f-kube-api-access-dscnl\") pod \"kuadrant-operator-controller-manager-86878c769f-5tth2\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.146261 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.146165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tpkds\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.146261 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.146183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nmd8\" (UniqueName: \"kubernetes.io/projected/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-kube-api-access-4nmd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tpkds\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.146353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.146279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2faf30-d3f7-41b5-b686-5235edd9083f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5tth2\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.146353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.146324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2lt\" (UniqueName: \"kubernetes.io/projected/152cd166-ac1a-4a7e-b4b5-52d781fedb48-kube-api-access-zj2lt\") pod \"limitador-operator-controller-manager-859d7b78bd-8djdv\" (UID: \"152cd166-ac1a-4a7e-b4b5-52d781fedb48\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:54:53.146583 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.146562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tpkds\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.157641 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.157616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2lt\" (UniqueName: \"kubernetes.io/projected/152cd166-ac1a-4a7e-b4b5-52d781fedb48-kube-api-access-zj2lt\") pod \"limitador-operator-controller-manager-859d7b78bd-8djdv\" (UID: \"152cd166-ac1a-4a7e-b4b5-52d781fedb48\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:54:53.157920 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.157878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nmd8\" (UniqueName: \"kubernetes.io/projected/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-kube-api-access-4nmd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tpkds\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.162725 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.162702    2578 generic.go:356] "Generic (PLEG): container finished" podID="95f66f0b-a0ac-474d-8295-8ae583c3e851" containerID="1b4041f4ea28b6eba5b49abdf1276b02d93e835045c8a84d9a97126b7dd0cf16" exitCode=0
Jul 16 00:54:53.164578 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.164461    2578 generic.go:356] "Generic (PLEG): container finished" podID="fdb897c4-7545-4ab9-942e-5136e6ad840c" containerID="30a189c0f06fae796d219ff958cbd2aa1f6eec3c80dbdcd473aa9f5edf565499" exitCode=0
Jul 16 00:54:53.188218 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.188200    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:53.190229 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.190214    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:53.190335 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:53.190318    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:53.192101 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:53.192081    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:53.194011 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:53.193987    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:53.195690 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:53.195674    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:53.246891 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.246863    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbz52\" (UniqueName: \"kubernetes.io/projected/fdb897c4-7545-4ab9-942e-5136e6ad840c-kube-api-access-qbz52\") pod \"fdb897c4-7545-4ab9-942e-5136e6ad840c\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") "
Jul 16 00:54:53.247040 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.246923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb897c4-7545-4ab9-942e-5136e6ad840c-extensions-socket-volume\") pod \"fdb897c4-7545-4ab9-942e-5136e6ad840c\" (UID: \"fdb897c4-7545-4ab9-942e-5136e6ad840c\") "
Jul 16 00:54:53.247040 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.246951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trkfb\" (UniqueName: \"kubernetes.io/projected/95f66f0b-a0ac-474d-8295-8ae583c3e851-kube-api-access-trkfb\") pod \"95f66f0b-a0ac-474d-8295-8ae583c3e851\" (UID: \"95f66f0b-a0ac-474d-8295-8ae583c3e851\") "
Jul 16 00:54:53.247199 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.247176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dscnl\" (UniqueName: \"kubernetes.io/projected/2d2faf30-d3f7-41b5-b686-5235edd9083f-kube-api-access-dscnl\") pod \"kuadrant-operator-controller-manager-86878c769f-5tth2\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.247274 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.247257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2faf30-d3f7-41b5-b686-5235edd9083f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5tth2\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.247504 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.247456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb897c4-7545-4ab9-942e-5136e6ad840c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fdb897c4-7545-4ab9-942e-5136e6ad840c" (UID: "fdb897c4-7545-4ab9-942e-5136e6ad840c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:53.247661 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.247643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2faf30-d3f7-41b5-b686-5235edd9083f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5tth2\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.249567 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.249547    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb897c4-7545-4ab9-942e-5136e6ad840c-kube-api-access-qbz52" (OuterVolumeSpecName: "kube-api-access-qbz52") pod "fdb897c4-7545-4ab9-942e-5136e6ad840c" (UID: "fdb897c4-7545-4ab9-942e-5136e6ad840c"). InnerVolumeSpecName "kube-api-access-qbz52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:53.249645 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.249574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f66f0b-a0ac-474d-8295-8ae583c3e851-kube-api-access-trkfb" (OuterVolumeSpecName: "kube-api-access-trkfb") pod "95f66f0b-a0ac-474d-8295-8ae583c3e851" (UID: "95f66f0b-a0ac-474d-8295-8ae583c3e851"). InnerVolumeSpecName "kube-api-access-trkfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:53.259819 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.259784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dscnl\" (UniqueName: \"kubernetes.io/projected/2d2faf30-d3f7-41b5-b686-5235edd9083f-kube-api-access-dscnl\") pod \"kuadrant-operator-controller-manager-86878c769f-5tth2\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.348685 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.348659    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbz52\" (UniqueName: \"kubernetes.io/projected/fdb897c4-7545-4ab9-942e-5136e6ad840c-kube-api-access-qbz52\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:53.348685 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.348686    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdb897c4-7545-4ab9-942e-5136e6ad840c-extensions-socket-volume\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:53.348892 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.348698    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trkfb\" (UniqueName: \"kubernetes.io/projected/95f66f0b-a0ac-474d-8295-8ae583c3e851-kube-api-access-trkfb\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:54:53.351553 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.351527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:53.358483 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.358457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:54:53.399832 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.399782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:53.512331 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.512265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"]
Jul 16 00:54:53.516182 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:53.516147    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adf5470_d7a2_45ce_8b0e_7ce71e76ccec.slice/crio-3c78443765425ac62b23cd81ebe3827aa4c824b7db831d059ed5064666e7e692 WatchSource:0}: Error finding container 3c78443765425ac62b23cd81ebe3827aa4c824b7db831d059ed5064666e7e692: Status 404 returned error can't find the container with id 3c78443765425ac62b23cd81ebe3827aa4c824b7db831d059ed5064666e7e692
Jul 16 00:54:53.532029 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.531991    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"]
Jul 16 00:54:53.534326 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:53.534298    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152cd166_ac1a_4a7e_b4b5_52d781fedb48.slice/crio-5b54d921a6ea58c9e01583f444d192d468ed6f895d96070a37057ed8de0eb0dc WatchSource:0}: Error finding container 5b54d921a6ea58c9e01583f444d192d468ed6f895d96070a37057ed8de0eb0dc: Status 404 returned error can't find the container with id 5b54d921a6ea58c9e01583f444d192d468ed6f895d96070a37057ed8de0eb0dc
Jul 16 00:54:53.572048 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:53.572023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"]
Jul 16 00:54:53.573497 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:54:53.573475    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2faf30_d3f7_41b5_b686_5235edd9083f.slice/crio-c20ac3ac44ef80abbf5837104e1b387e1648ea7ca27b0b943aa89e2dae7a60e6 WatchSource:0}: Error finding container c20ac3ac44ef80abbf5837104e1b387e1648ea7ca27b0b943aa89e2dae7a60e6: Status 404 returned error can't find the container with id c20ac3ac44ef80abbf5837104e1b387e1648ea7ca27b0b943aa89e2dae7a60e6
Jul 16 00:54:54.172149 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.172122    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:54.172568 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.172174    2578 scope.go:117] "RemoveContainer" containerID="30a189c0f06fae796d219ff958cbd2aa1f6eec3c80dbdcd473aa9f5edf565499"
Jul 16 00:54:54.174046 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.174017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2" event={"ID":"2d2faf30-d3f7-41b5-b686-5235edd9083f","Type":"ContainerStarted","Data":"207a15aa592965f72f334fb4c41e797ea30f25be30308c59fffe0aad8347bbb6"}
Jul 16 00:54:54.174167 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.174077    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:54:54.174167 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.174095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2" event={"ID":"2d2faf30-d3f7-41b5-b686-5235edd9083f","Type":"ContainerStarted","Data":"c20ac3ac44ef80abbf5837104e1b387e1648ea7ca27b0b943aa89e2dae7a60e6"}
Jul 16 00:54:54.175209 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:54.175177    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:54.176002 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.175975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds" event={"ID":"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec","Type":"ContainerStarted","Data":"3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e"}
Jul 16 00:54:54.176200 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.176024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds" event={"ID":"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec","Type":"ContainerStarted","Data":"3c78443765425ac62b23cd81ebe3827aa4c824b7db831d059ed5064666e7e692"}
Jul 16 00:54:54.176200 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.176052    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:54:54.177034 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:54.177008    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:54.177417 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.177398    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:54.178812 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:54.178769    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:54.178943 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.178919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv" event={"ID":"152cd166-ac1a-4a7e-b4b5-52d781fedb48","Type":"ContainerStarted","Data":"0fab1646e11334be6822feb5653e423847985f557b60b27ceffe7988a500311d"}
Jul 16 00:54:54.179046 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.178965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv" event={"ID":"152cd166-ac1a-4a7e-b4b5-52d781fedb48","Type":"ContainerStarted","Data":"5b54d921a6ea58c9e01583f444d192d468ed6f895d96070a37057ed8de0eb0dc"}
Jul 16 00:54:54.179046 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.178989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:54:54.180680 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:54.180647    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:54.182513 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.182499    2578 scope.go:117] "RemoveContainer" containerID="1b4041f4ea28b6eba5b49abdf1276b02d93e835045c8a84d9a97126b7dd0cf16"
Jul 16 00:54:54.204477 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.204426    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds" podStartSLOduration=2.204407887 podStartE2EDuration="2.204407887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:54.202524999 +0000 UTC m=+636.125348865" watchObservedRunningTime="2026-07-16 00:54:54.204407887 +0000 UTC m=+636.127231758"
Jul 16 00:54:54.222338 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.222296    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2" podStartSLOduration=1.222281768 podStartE2EDuration="1.222281768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:54.220271387 +0000 UTC m=+636.143095253" watchObservedRunningTime="2026-07-16 00:54:54.222281768 +0000 UTC m=+636.145105635"
Jul 16 00:54:54.222448 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:54.222341    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gcsz9\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gcsz9"
Jul 16 00:54:54.241369 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.241324    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv" podStartSLOduration=2.2413086 podStartE2EDuration="2.2413086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:54.239759755 +0000 UTC m=+636.162583623" watchObservedRunningTime="2026-07-16 00:54:54.2413086 +0000 UTC m=+636.164132468"
Jul 16 00:54:54.241979 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:54:54.241955    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-94vs7\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-94vs7"
Jul 16 00:54:54.633783 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.633744    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f66f0b-a0ac-474d-8295-8ae583c3e851" path="/var/lib/kubelet/pods/95f66f0b-a0ac-474d-8295-8ae583c3e851/volumes"
Jul 16 00:54:54.634196 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:54:54.634179    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdb897c4-7545-4ab9-942e-5136e6ad840c" path="/var/lib/kubelet/pods/fdb897c4-7545-4ab9-942e-5136e6ad840c/volumes"
Jul 16 00:55:05.189672 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.189643    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8djdv"
Jul 16 00:55:05.190228 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.189724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 00:55:05.190228 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.189768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:55:05.263027 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.262992    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"]
Jul 16 00:55:05.263593 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.263562    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds" podUID="9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" containerName="manager" containerID="cri-o://3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e" gracePeriod=10
Jul 16 00:55:05.518411 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.518383    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:55:05.653869 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.653838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nmd8\" (UniqueName: \"kubernetes.io/projected/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-kube-api-access-4nmd8\") pod \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") "
Jul 16 00:55:05.654041 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.653933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-extensions-socket-volume\") pod \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\" (UID: \"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec\") "
Jul 16 00:55:05.654340 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.654311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" (UID: "9adf5470-d7a2-45ce-8b0e-7ce71e76ccec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:55:05.655949 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.655930    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-kube-api-access-4nmd8" (OuterVolumeSpecName: "kube-api-access-4nmd8") pod "9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" (UID: "9adf5470-d7a2-45ce-8b0e-7ce71e76ccec"). InnerVolumeSpecName "kube-api-access-4nmd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:55:05.755208 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.755124    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nmd8\" (UniqueName: \"kubernetes.io/projected/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-kube-api-access-4nmd8\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:05.755208 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:05.755156    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec-extensions-socket-volume\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:06.249863 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.249828    2578 generic.go:356] "Generic (PLEG): container finished" podID="9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" containerID="3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e" exitCode=0
Jul 16 00:55:06.250321 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.249868    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"
Jul 16 00:55:06.250321 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.249903    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds" event={"ID":"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec","Type":"ContainerDied","Data":"3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e"}
Jul 16 00:55:06.250321 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.249958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds" event={"ID":"9adf5470-d7a2-45ce-8b0e-7ce71e76ccec","Type":"ContainerDied","Data":"3c78443765425ac62b23cd81ebe3827aa4c824b7db831d059ed5064666e7e692"}
Jul 16 00:55:06.250321 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.249993    2578 scope.go:117] "RemoveContainer" containerID="3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e"
Jul 16 00:55:06.259467 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.259451    2578 scope.go:117] "RemoveContainer" containerID="3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e"
Jul 16 00:55:06.259743 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:55:06.259696    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e\": container with ID starting with 3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e not found: ID does not exist" containerID="3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e"
Jul 16 00:55:06.259743 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.259725    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e"} err="failed to get container status \"3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e\": rpc error: code = NotFound desc = could not find container \"3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e\": container with ID starting with 3d83e24f9302a513b6ab8963f7dbf2a4455890967d7bbbd4f66443bf507b870e not found: ID does not exist"
Jul 16 00:55:06.280412 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.280388    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"]
Jul 16 00:55:06.282450 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.282429    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tpkds"]
Jul 16 00:55:06.632385 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:06.632352    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" path="/var/lib/kubelet/pods/9adf5470-d7a2-45ce-8b0e-7ce71e76ccec/volumes"
Jul 16 00:55:10.199304 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.199259    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-97d74bc69-rdkx4" podUID="837c2345-0f91-4187-a592-906f85676c5d" containerName="console" containerID="cri-o://82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747" gracePeriod=15
Jul 16 00:55:10.457890 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.457824    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:55:10.597397 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-oauth-serving-cert\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597422    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-serving-cert\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-oauth-config\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-service-ca\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-console-config\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597596 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc6l6\" (UniqueName: \"kubernetes.io/projected/837c2345-0f91-4187-a592-906f85676c5d-kube-api-access-pc6l6\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597893 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-trusted-ca-bundle\") pod \"837c2345-0f91-4187-a592-906f85676c5d\" (UID: \"837c2345-0f91-4187-a592-906f85676c5d\") "
Jul 16 00:55:10.597955 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597820    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:55:10.597955 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:55:10.598066 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.597957    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-console-config" (OuterVolumeSpecName: "console-config") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:55:10.598123 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.598086    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-oauth-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:10.598123 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.598098    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-service-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:10.598123 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.598106    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-console-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:10.598285 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.598139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:55:10.599967 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.599947    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/837c2345-0f91-4187-a592-906f85676c5d-kube-api-access-pc6l6" (OuterVolumeSpecName: "kube-api-access-pc6l6") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "kube-api-access-pc6l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:55:10.600102 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.600083    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:55:10.600149 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.600108    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "837c2345-0f91-4187-a592-906f85676c5d" (UID: "837c2345-0f91-4187-a592-906f85676c5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:55:10.699438 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.699392    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc6l6\" (UniqueName: \"kubernetes.io/projected/837c2345-0f91-4187-a592-906f85676c5d-kube-api-access-pc6l6\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:10.699438 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.699428    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/837c2345-0f91-4187-a592-906f85676c5d-trusted-ca-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:10.699438 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.699437    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:10.699438 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:10.699450    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/837c2345-0f91-4187-a592-906f85676c5d-console-oauth-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:11.281621 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.281587    2578 generic.go:356] "Generic (PLEG): container finished" podID="837c2345-0f91-4187-a592-906f85676c5d" containerID="82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747" exitCode=0
Jul 16 00:55:11.282055 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.281649    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97d74bc69-rdkx4"
Jul 16 00:55:11.282055 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.281674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97d74bc69-rdkx4" event={"ID":"837c2345-0f91-4187-a592-906f85676c5d","Type":"ContainerDied","Data":"82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747"}
Jul 16 00:55:11.282055 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.281730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97d74bc69-rdkx4" event={"ID":"837c2345-0f91-4187-a592-906f85676c5d","Type":"ContainerDied","Data":"44e7e6ddb22d44bbcc8c95838b16e4e2fef23a5d80a735375ad996d6f594ce54"}
Jul 16 00:55:11.282055 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.281756    2578 scope.go:117] "RemoveContainer" containerID="82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747"
Jul 16 00:55:11.290614 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.290597    2578 scope.go:117] "RemoveContainer" containerID="82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747"
Jul 16 00:55:11.290885 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:55:11.290855    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747\": container with ID starting with 82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747 not found: ID does not exist" containerID="82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747"
Jul 16 00:55:11.290980 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.290883    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747"} err="failed to get container status \"82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747\": rpc error: code = NotFound desc = could not find container \"82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747\": container with ID starting with 82ef0733e26189749d737ff5cde0c761125d74eeac0a9c43672cd1aa2cf03747 not found: ID does not exist"
Jul 16 00:55:11.305480 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.305461    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97d74bc69-rdkx4"]
Jul 16 00:55:11.309465 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:11.309447    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97d74bc69-rdkx4"]
Jul 16 00:55:12.632440 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:12.632406    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="837c2345-0f91-4187-a592-906f85676c5d" path="/var/lib/kubelet/pods/837c2345-0f91-4187-a592-906f85676c5d/volumes"
Jul 16 00:55:21.598981 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.598951    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"]
Jul 16 00:55:21.599381 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.599309    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="837c2345-0f91-4187-a592-906f85676c5d" containerName="console"
Jul 16 00:55:21.599381 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.599319    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="837c2345-0f91-4187-a592-906f85676c5d" containerName="console"
Jul 16 00:55:21.599381 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.599339    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" containerName="manager"
Jul 16 00:55:21.599381 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.599344    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" containerName="manager"
Jul 16 00:55:21.599543 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.599442    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="837c2345-0f91-4187-a592-906f85676c5d" containerName="console"
Jul 16 00:55:21.599543 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.599457    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9adf5470-d7a2-45ce-8b0e-7ce71e76ccec" containerName="manager"
Jul 16 00:55:21.602629 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.602610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.605197 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.605176    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xxp4q\""
Jul 16 00:55:21.618598 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.618574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"]
Jul 16 00:55:21.701882 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.701843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702045 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.701935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702045 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.701982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702155 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.702044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702155 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.702071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs5c2\" (UniqueName: \"kubernetes.io/projected/6cb2a4bb-a239-42d8-b964-45f181b12cba-kube-api-access-xs5c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702155 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.702142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702260 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.702180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb2a4bb-a239-42d8-b964-45f181b12cba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702260 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.702210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.702326 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.702274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.803778 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.803740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.803983 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.803855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.803983 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.803899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.803983 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.803918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.803983 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.803959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804210 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804210 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs5c2\" (UniqueName: \"kubernetes.io/projected/6cb2a4bb-a239-42d8-b964-45f181b12cba-kube-api-access-xs5c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804210 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804210 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb2a4bb-a239-42d8-b964-45f181b12cba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804420 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804420 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804531 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804637 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.804735 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.804718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb2a4bb-a239-42d8-b964-45f181b12cba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.806222 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.806202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.806334 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.806317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.812567 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.812540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb2a4bb-a239-42d8-b964-45f181b12cba-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.812737 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.812719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs5c2\" (UniqueName: \"kubernetes.io/projected/6cb2a4bb-a239-42d8-b964-45f181b12cba-kube-api-access-xs5c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hzn8\" (UID: \"6cb2a4bb-a239-42d8-b964-45f181b12cba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:21.913469 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:21.913386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:22.052999 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.052975    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"]
Jul 16 00:55:22.054966 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:55:22.054935    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb2a4bb_a239_42d8_b964_45f181b12cba.slice/crio-ce52489f47f3f404e4439f8b0f1856473b57e98ced17ddb97d16acf26138546f WatchSource:0}: Error finding container ce52489f47f3f404e4439f8b0f1856473b57e98ced17ddb97d16acf26138546f: Status 404 returned error can't find the container with id ce52489f47f3f404e4439f8b0f1856473b57e98ced17ddb97d16acf26138546f
Jul 16 00:55:22.057135 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.057105    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:55:22.057223 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.057165    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:55:22.057223 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.057193    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:55:22.343482 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.343446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" event={"ID":"6cb2a4bb-a239-42d8-b964-45f181b12cba","Type":"ContainerStarted","Data":"8f4177139041cd27b43a38dafc91d510e6386bbc391b516ecea2fe2cbe49a578"}
Jul 16 00:55:22.343682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.343499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" event={"ID":"6cb2a4bb-a239-42d8-b964-45f181b12cba","Type":"ContainerStarted","Data":"ce52489f47f3f404e4439f8b0f1856473b57e98ced17ddb97d16acf26138546f"}
Jul 16 00:55:22.365076 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.365030    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" podStartSLOduration=1.365015068 podStartE2EDuration="1.365015068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:22.363119879 +0000 UTC m=+664.285943763" watchObservedRunningTime="2026-07-16 00:55:22.365015068 +0000 UTC m=+664.287839015"
Jul 16 00:55:22.914062 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:22.914030    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:23.919282 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:23.919253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:24.199783 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.199709    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7b9lh"]
Jul 16 00:55:24.202365 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.202349    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:24.205014 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.204985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlcw9\""
Jul 16 00:55:24.210176 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.210078    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7b9lh"]
Jul 16 00:55:24.330249 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.330221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-666fg\" (UniqueName: \"kubernetes.io/projected/c273d947-5892-4e11-9d7b-7aa14ac6b864-kube-api-access-666fg\") pod \"authorino-58cd955675-7b9lh\" (UID: \"c273d947-5892-4e11-9d7b-7aa14ac6b864\") " pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:24.355924 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.355893    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:24.358620 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.357098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:55:24.431384 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.431349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-666fg\" (UniqueName: \"kubernetes.io/projected/c273d947-5892-4e11-9d7b-7aa14ac6b864-kube-api-access-666fg\") pod \"authorino-58cd955675-7b9lh\" (UID: \"c273d947-5892-4e11-9d7b-7aa14ac6b864\") " pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:24.458420 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.458357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-666fg\" (UniqueName: \"kubernetes.io/projected/c273d947-5892-4e11-9d7b-7aa14ac6b864-kube-api-access-666fg\") pod \"authorino-58cd955675-7b9lh\" (UID: \"c273d947-5892-4e11-9d7b-7aa14ac6b864\") " pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:24.512929 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.512901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:24.646644 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:24.646611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7b9lh"]
Jul 16 00:55:24.649864 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:55:24.649837    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc273d947_5892_4e11_9d7b_7aa14ac6b864.slice/crio-bebc8901ea7583263d09eff6b9c8b78f8051e7acf1652a28d8386315f6c93ea9 WatchSource:0}: Error finding container bebc8901ea7583263d09eff6b9c8b78f8051e7acf1652a28d8386315f6c93ea9: Status 404 returned error can't find the container with id bebc8901ea7583263d09eff6b9c8b78f8051e7acf1652a28d8386315f6c93ea9
Jul 16 00:55:25.367944 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:25.367416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7b9lh" event={"ID":"c273d947-5892-4e11-9d7b-7aa14ac6b864","Type":"ContainerStarted","Data":"bebc8901ea7583263d09eff6b9c8b78f8051e7acf1652a28d8386315f6c93ea9"}
Jul 16 00:55:28.387032 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:28.386992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7b9lh" event={"ID":"c273d947-5892-4e11-9d7b-7aa14ac6b864","Type":"ContainerStarted","Data":"998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88"}
Jul 16 00:55:28.403936 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:28.403889    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7b9lh" podStartSLOduration=1.5273671370000002 podStartE2EDuration="4.403874733s" totalImagesPullingTime="2.876507596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:28.403042848 +0000 UTC m=+670.325866715" watchObservedRunningTime="2026-07-16 00:55:28.403874733 +0000 UTC m=+670.326698600"
Jul 16 00:55:29.660540 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:29.660509    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7b9lh"]
Jul 16 00:55:30.398319 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:30.398282    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7b9lh" podUID="c273d947-5892-4e11-9d7b-7aa14ac6b864" containerName="authorino" containerID="cri-o://998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88" gracePeriod=30
Jul 16 00:55:30.647889 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:30.647867    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:30.685202 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:30.685141    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-666fg\" (UniqueName: \"kubernetes.io/projected/c273d947-5892-4e11-9d7b-7aa14ac6b864-kube-api-access-666fg\") pod \"c273d947-5892-4e11-9d7b-7aa14ac6b864\" (UID: \"c273d947-5892-4e11-9d7b-7aa14ac6b864\") "
Jul 16 00:55:30.687185 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:30.687149    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c273d947-5892-4e11-9d7b-7aa14ac6b864-kube-api-access-666fg" (OuterVolumeSpecName: "kube-api-access-666fg") pod "c273d947-5892-4e11-9d7b-7aa14ac6b864" (UID: "c273d947-5892-4e11-9d7b-7aa14ac6b864"). InnerVolumeSpecName "kube-api-access-666fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:55:30.786062 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:30.786037    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-666fg\" (UniqueName: \"kubernetes.io/projected/c273d947-5892-4e11-9d7b-7aa14ac6b864-kube-api-access-666fg\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:31.405183 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.405147    2578 generic.go:356] "Generic (PLEG): container finished" podID="c273d947-5892-4e11-9d7b-7aa14ac6b864" containerID="998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88" exitCode=0
Jul 16 00:55:31.405353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.405195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7b9lh"
Jul 16 00:55:31.405353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.405227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7b9lh" event={"ID":"c273d947-5892-4e11-9d7b-7aa14ac6b864","Type":"ContainerDied","Data":"998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88"}
Jul 16 00:55:31.405353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.405275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7b9lh" event={"ID":"c273d947-5892-4e11-9d7b-7aa14ac6b864","Type":"ContainerDied","Data":"bebc8901ea7583263d09eff6b9c8b78f8051e7acf1652a28d8386315f6c93ea9"}
Jul 16 00:55:31.405353 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.405293    2578 scope.go:117] "RemoveContainer" containerID="998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88"
Jul 16 00:55:31.415694 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.415671    2578 scope.go:117] "RemoveContainer" containerID="998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88"
Jul 16 00:55:31.416010 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:55:31.415968    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88\": container with ID starting with 998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88 not found: ID does not exist" containerID="998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88"
Jul 16 00:55:31.416114 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.416019    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88"} err="failed to get container status \"998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88\": rpc error: code = NotFound desc = could not find container \"998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88\": container with ID starting with 998e7ad69d5437ec0dc498ddb6d50913ecc34ee8d5d6e233f1fe166747debf88 not found: ID does not exist"
Jul 16 00:55:31.428682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.428659    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7b9lh"]
Jul 16 00:55:31.432851 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:31.432824    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7b9lh"]
Jul 16 00:55:32.632536 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:32.632507    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c273d947-5892-4e11-9d7b-7aa14ac6b864" path="/var/lib/kubelet/pods/c273d947-5892-4e11-9d7b-7aa14ac6b864/volumes"
Jul 16 00:55:52.533544 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.530686    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bf8ccc488-ns746"]
Jul 16 00:55:52.533544 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.531592    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c273d947-5892-4e11-9d7b-7aa14ac6b864" containerName="authorino"
Jul 16 00:55:52.533544 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.531615    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c273d947-5892-4e11-9d7b-7aa14ac6b864" containerName="authorino"
Jul 16 00:55:52.533544 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.531816    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c273d947-5892-4e11-9d7b-7aa14ac6b864" containerName="authorino"
Jul 16 00:55:52.538858 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.538836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:52.541287 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.541250    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlcw9\""
Jul 16 00:55:52.542682 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.542661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bf8ccc488-ns746"]
Jul 16 00:55:52.685134 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.685103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbds8\" (UniqueName: \"kubernetes.io/projected/620aa1de-d3ed-4d3b-be62-4d07f9176922-kube-api-access-qbds8\") pod \"authorino-bf8ccc488-ns746\" (UID: \"620aa1de-d3ed-4d3b-be62-4d07f9176922\") " pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:52.715697 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.715668    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bf8ccc488-ns746"]
Jul 16 00:55:52.715931 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:55:52.715913    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qbds8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-bf8ccc488-ns746" podUID="620aa1de-d3ed-4d3b-be62-4d07f9176922"
Jul 16 00:55:52.744292 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.744267    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64b6cc794d-s92nl"]
Jul 16 00:55:52.748191 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.748171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:52.750436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.750418    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 00:55:52.757195 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.757174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64b6cc794d-s92nl"]
Jul 16 00:55:52.786021 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.785958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbds8\" (UniqueName: \"kubernetes.io/projected/620aa1de-d3ed-4d3b-be62-4d07f9176922-kube-api-access-qbds8\") pod \"authorino-bf8ccc488-ns746\" (UID: \"620aa1de-d3ed-4d3b-be62-4d07f9176922\") " pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:52.793716 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.793690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbds8\" (UniqueName: \"kubernetes.io/projected/620aa1de-d3ed-4d3b-be62-4d07f9176922-kube-api-access-qbds8\") pod \"authorino-bf8ccc488-ns746\" (UID: \"620aa1de-d3ed-4d3b-be62-4d07f9176922\") " pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:52.887080 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.887039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83b14534-a327-45a8-85f0-244a9bb6f9f4-tls-cert\") pod \"authorino-64b6cc794d-s92nl\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") " pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:52.887248 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.887159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr795\" (UniqueName: \"kubernetes.io/projected/83b14534-a327-45a8-85f0-244a9bb6f9f4-kube-api-access-pr795\") pod \"authorino-64b6cc794d-s92nl\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") " pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:52.988569 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.988532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83b14534-a327-45a8-85f0-244a9bb6f9f4-tls-cert\") pod \"authorino-64b6cc794d-s92nl\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") " pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:52.988736 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.988615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr795\" (UniqueName: \"kubernetes.io/projected/83b14534-a327-45a8-85f0-244a9bb6f9f4-kube-api-access-pr795\") pod \"authorino-64b6cc794d-s92nl\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") " pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:52.990994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.990977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83b14534-a327-45a8-85f0-244a9bb6f9f4-tls-cert\") pod \"authorino-64b6cc794d-s92nl\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") " pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:52.996862 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:52.996842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr795\" (UniqueName: \"kubernetes.io/projected/83b14534-a327-45a8-85f0-244a9bb6f9f4-kube-api-access-pr795\") pod \"authorino-64b6cc794d-s92nl\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") " pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:53.057272 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.057208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:55:53.196370 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.196344    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64b6cc794d-s92nl"]
Jul 16 00:55:53.197968 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:55:53.197938    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83b14534_a327_45a8_85f0_244a9bb6f9f4.slice/crio-747e422b6c755f7501e5f1dd43018f0ab2f510e7e11f721eed6993e4d872df8b WatchSource:0}: Error finding container 747e422b6c755f7501e5f1dd43018f0ab2f510e7e11f721eed6993e4d872df8b: Status 404 returned error can't find the container with id 747e422b6c755f7501e5f1dd43018f0ab2f510e7e11f721eed6993e4d872df8b
Jul 16 00:55:53.199362 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.199344    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:55:53.524085 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.524056    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:53.524085 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.524058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6cc794d-s92nl" event={"ID":"83b14534-a327-45a8-85f0-244a9bb6f9f4","Type":"ContainerStarted","Data":"747e422b6c755f7501e5f1dd43018f0ab2f510e7e11f721eed6993e4d872df8b"}
Jul 16 00:55:53.532939 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.532921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:53.695250 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.695224    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbds8\" (UniqueName: \"kubernetes.io/projected/620aa1de-d3ed-4d3b-be62-4d07f9176922-kube-api-access-qbds8\") pod \"620aa1de-d3ed-4d3b-be62-4d07f9176922\" (UID: \"620aa1de-d3ed-4d3b-be62-4d07f9176922\") "
Jul 16 00:55:53.697193 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.697170    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620aa1de-d3ed-4d3b-be62-4d07f9176922-kube-api-access-qbds8" (OuterVolumeSpecName: "kube-api-access-qbds8") pod "620aa1de-d3ed-4d3b-be62-4d07f9176922" (UID: "620aa1de-d3ed-4d3b-be62-4d07f9176922"). InnerVolumeSpecName "kube-api-access-qbds8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:55:53.797074 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:53.796998    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbds8\" (UniqueName: \"kubernetes.io/projected/620aa1de-d3ed-4d3b-be62-4d07f9176922-kube-api-access-qbds8\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:55:54.531021 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:54.530984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6cc794d-s92nl" event={"ID":"83b14534-a327-45a8-85f0-244a9bb6f9f4","Type":"ContainerStarted","Data":"6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a"}
Jul 16 00:55:54.531246 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:54.531128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf8ccc488-ns746"
Jul 16 00:55:54.549606 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:54.549548    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64b6cc794d-s92nl" podStartSLOduration=2.159077585 podStartE2EDuration="2.549529708s" totalImagesPullingTime="390.452123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:54.547447971 +0000 UTC m=+696.470271837" watchObservedRunningTime="2026-07-16 00:55:54.549529708 +0000 UTC m=+696.472353574"
Jul 16 00:55:54.580341 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:54.580309    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bf8ccc488-ns746"]
Jul 16 00:55:54.585692 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:54.585657    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-bf8ccc488-ns746"]
Jul 16 00:55:54.633317 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:55:54.633285    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="620aa1de-d3ed-4d3b-be62-4d07f9176922" path="/var/lib/kubelet/pods/620aa1de-d3ed-4d3b-be62-4d07f9176922/volumes"
Jul 16 00:56:39.788510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:39.787885    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hzn8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:57882->10.133.0.49:15021: read: connection reset by peer" start-of-body=
Jul 16 00:56:39.788510 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:39.787948    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" podUID="6cb2a4bb-a239-42d8-b964-45f181b12cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:57882->10.133.0.49:15021: read: connection reset by peer"
Jul 16 00:56:40.780784 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:40.780751    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cb2a4bb-a239-42d8-b964-45f181b12cba" containerID="8f4177139041cd27b43a38dafc91d510e6386bbc391b516ecea2fe2cbe49a578" exitCode=0
Jul 16 00:56:40.780970 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:40.780803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" event={"ID":"6cb2a4bb-a239-42d8-b964-45f181b12cba","Type":"ContainerDied","Data":"8f4177139041cd27b43a38dafc91d510e6386bbc391b516ecea2fe2cbe49a578"}
Jul 16 00:56:40.781214 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:40.781199    2578 scope.go:117] "RemoveContainer" containerID="8f4177139041cd27b43a38dafc91d510e6386bbc391b516ecea2fe2cbe49a578"
Jul 16 00:56:40.782291 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:40.782262    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:56:40.782406 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:40.782330    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:56:40.782406 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:40.782363    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 00:56:41.787611 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:41.787572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" event={"ID":"6cb2a4bb-a239-42d8-b964-45f181b12cba","Type":"ContainerStarted","Data":"6cd5ca5675ec1dacfef3aabd1507a834f25a4d41a7c39c32acceeff875f24d48"}
Jul 16 00:56:41.914457 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:41.914425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:56:41.914637 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:41.914585    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hzn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 00:56:41.914710 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:41.914656    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" podUID="6cb2a4bb-a239-42d8-b964-45f181b12cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 00:56:42.914471 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:42.914433    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hzn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 00:56:42.914903 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:42.914485    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" podUID="6cb2a4bb-a239-42d8-b964-45f181b12cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 00:56:43.913897 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:43.913862    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hzn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 00:56:43.914065 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:43.913920    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" podUID="6cb2a4bb-a239-42d8-b964-45f181b12cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 00:56:44.914406 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:44.914370    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hzn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 00:56:44.914809 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:44.914424    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8" podUID="6cb2a4bb-a239-42d8-b964-45f181b12cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 00:56:45.917476 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:45.917445    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:56:45.917884 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:45.917819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:56:45.918506 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:56:45.918488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hzn8"
Jul 16 00:57:30.485732 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.485700    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"]
Jul 16 00:57:30.489598 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.489576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.492197 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.492181    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 00:57:30.492363 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.492339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n7pbs\""
Jul 16 00:57:30.492895 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.492881    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 00:57:30.492955 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.492928    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 16 00:57:30.509357 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.509336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"]
Jul 16 00:57:30.639994 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.639958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8x99\" (UniqueName: \"kubernetes.io/projected/8b639d2a-64fb-419c-b3ce-4439f594ddd9-kube-api-access-g8x99\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.640159 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.639997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.640159 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.640150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.640246 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.640170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b639d2a-64fb-419c-b3ce-4439f594ddd9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.640246 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.640214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.640326 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.640278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.741586 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.741502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8x99\" (UniqueName: \"kubernetes.io/projected/8b639d2a-64fb-419c-b3ce-4439f594ddd9-kube-api-access-g8x99\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.741586 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.741541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.741586 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.741585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.741882 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.741603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b639d2a-64fb-419c-b3ce-4439f594ddd9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.741882 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.741623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.741882 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.741668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.742039 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.742007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.742177 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.742151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.742283 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.742264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.743955 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.743929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b639d2a-64fb-419c-b3ce-4439f594ddd9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.744222 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.744205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b639d2a-64fb-419c-b3ce-4439f594ddd9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.750082 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.750038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8x99\" (UniqueName: \"kubernetes.io/projected/8b639d2a-64fb-419c-b3ce-4439f594ddd9-kube-api-access-g8x99\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l\" (UID: \"8b639d2a-64fb-419c-b3ce-4439f594ddd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.799767 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.799745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:30.937447 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:30.937418    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"]
Jul 16 00:57:30.939081 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:57:30.939054    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b639d2a_64fb_419c_b3ce_4439f594ddd9.slice/crio-c316d7d428f414bcc1997381d7053bd9a1db81c76e555ef57fb9523497b6baac WatchSource:0}: Error finding container c316d7d428f414bcc1997381d7053bd9a1db81c76e555ef57fb9523497b6baac: Status 404 returned error can't find the container with id c316d7d428f414bcc1997381d7053bd9a1db81c76e555ef57fb9523497b6baac
Jul 16 00:57:31.050437 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:31.050400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l" event={"ID":"8b639d2a-64fb-419c-b3ce-4439f594ddd9","Type":"ContainerStarted","Data":"c316d7d428f414bcc1997381d7053bd9a1db81c76e555ef57fb9523497b6baac"}
Jul 16 00:57:32.059122 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:32.059087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l" event={"ID":"8b639d2a-64fb-419c-b3ce-4439f594ddd9","Type":"ContainerStarted","Data":"11a3728339c174ec7c4cd4bcf8936922301ff2e1003c5ce719731541a9916d3c"}
Jul 16 00:57:32.080059 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:32.080017    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l" podStartSLOduration=1.045196228 podStartE2EDuration="2.080002111s" totalImagesPullingTime="1.034805883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:57:32.077698179 +0000 UTC m=+794.000522047" watchObservedRunningTime="2026-07-16 00:57:32.080002111 +0000 UTC m=+794.002825977"
Jul 16 00:57:40.800047 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:40.800017    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:40.800469 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:40.800069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:40.812461 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:40.812438    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:57:41.125260 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:57:41.125180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l"
Jul 16 00:58:00.520202 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.520167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"]
Jul 16 00:58:00.525404 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.525381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.527753 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.527726    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 00:58:00.535957 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.535936    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"]
Jul 16 00:58:00.609243 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.609216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be317fc6-913a-41c2-a75e-d3ff0f598d47-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.609367 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.609283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.609367 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.609342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.609456 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.609417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.609494 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.609459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.609536 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.609488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqcpw\" (UniqueName: \"kubernetes.io/projected/be317fc6-913a-41c2-a75e-d3ff0f598d47-kube-api-access-qqcpw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.710847 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.710813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711030 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.710863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711030 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.710883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711030 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.710900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqcpw\" (UniqueName: \"kubernetes.io/projected/be317fc6-913a-41c2-a75e-d3ff0f598d47-kube-api-access-qqcpw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711030 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.710964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be317fc6-913a-41c2-a75e-d3ff0f598d47-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711030 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.711020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711404 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.711359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711453 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.711402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.711495 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.711477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.713305 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.713284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be317fc6-913a-41c2-a75e-d3ff0f598d47-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.713486 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.713468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be317fc6-913a-41c2-a75e-d3ff0f598d47-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.719068 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.719046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqcpw\" (UniqueName: \"kubernetes.io/projected/be317fc6-913a-41c2-a75e-d3ff0f598d47-kube-api-access-qqcpw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc\" (UID: \"be317fc6-913a-41c2-a75e-d3ff0f598d47\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.836873 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.836751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:00.974534 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:00.974498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"]
Jul 16 00:58:00.976547 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:58:00.976519    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe317fc6_913a_41c2_a75e_d3ff0f598d47.slice/crio-72cdcee50fcfec0232a332cc03ba789b85b1e1b8989cc1650c8e029855e5ec7d WatchSource:0}: Error finding container 72cdcee50fcfec0232a332cc03ba789b85b1e1b8989cc1650c8e029855e5ec7d: Status 404 returned error can't find the container with id 72cdcee50fcfec0232a332cc03ba789b85b1e1b8989cc1650c8e029855e5ec7d
Jul 16 00:58:01.232475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:01.232422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc" event={"ID":"be317fc6-913a-41c2-a75e-d3ff0f598d47","Type":"ContainerStarted","Data":"4285ce6febd0bb0329c66e83755e23c237c3cfca1236a0af5b6e80f57a0d2323"}
Jul 16 00:58:01.232475 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:01.232480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc" event={"ID":"be317fc6-913a-41c2-a75e-d3ff0f598d47","Type":"ContainerStarted","Data":"72cdcee50fcfec0232a332cc03ba789b85b1e1b8989cc1650c8e029855e5ec7d"}
Jul 16 00:58:01.252211 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:01.252153    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc" podStartSLOduration=1.075554835 podStartE2EDuration="1.252135879s" totalImagesPullingTime="176.581044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:58:01.25175392 +0000 UTC m=+823.174577786" watchObservedRunningTime="2026-07-16 00:58:01.252135879 +0000 UTC m=+823.174959745"
Jul 16 00:58:10.837869 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:10.837823    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:10.838384 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:10.837890    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:10.851030 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:10.851002    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:11.300203 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:11.300176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc"
Jul 16 00:58:59.174857 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.174822    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-764bfb59d9-249k4"]
Jul 16 00:58:59.178291 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.178274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.187931 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.187908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-764bfb59d9-249k4"]
Jul 16 00:58:59.238162 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.238131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tm9s\" (UniqueName: \"kubernetes.io/projected/239f04cf-9a8b-4b84-9e36-46530fb30436-kube-api-access-2tm9s\") pod \"authorino-764bfb59d9-249k4\" (UID: \"239f04cf-9a8b-4b84-9e36-46530fb30436\") " pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.238312 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.238248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/239f04cf-9a8b-4b84-9e36-46530fb30436-tls-cert\") pod \"authorino-764bfb59d9-249k4\" (UID: \"239f04cf-9a8b-4b84-9e36-46530fb30436\") " pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.339549 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.339519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/239f04cf-9a8b-4b84-9e36-46530fb30436-tls-cert\") pod \"authorino-764bfb59d9-249k4\" (UID: \"239f04cf-9a8b-4b84-9e36-46530fb30436\") " pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.339709 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.339564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tm9s\" (UniqueName: \"kubernetes.io/projected/239f04cf-9a8b-4b84-9e36-46530fb30436-kube-api-access-2tm9s\") pod \"authorino-764bfb59d9-249k4\" (UID: \"239f04cf-9a8b-4b84-9e36-46530fb30436\") " pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.341955 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.341933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/239f04cf-9a8b-4b84-9e36-46530fb30436-tls-cert\") pod \"authorino-764bfb59d9-249k4\" (UID: \"239f04cf-9a8b-4b84-9e36-46530fb30436\") " pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.347574 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.347548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tm9s\" (UniqueName: \"kubernetes.io/projected/239f04cf-9a8b-4b84-9e36-46530fb30436-kube-api-access-2tm9s\") pod \"authorino-764bfb59d9-249k4\" (UID: \"239f04cf-9a8b-4b84-9e36-46530fb30436\") " pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.488201 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.488132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-764bfb59d9-249k4"
Jul 16 00:58:59.644318 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:58:59.644290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-764bfb59d9-249k4"]
Jul 16 00:58:59.645820 ip-10-0-142-236 kubenswrapper[2578]: W0716 00:58:59.645783    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod239f04cf_9a8b_4b84_9e36_46530fb30436.slice/crio-19c554f754b3451efc29516b8a0e3b8302f3cfa85666ca802407a7105f862263 WatchSource:0}: Error finding container 19c554f754b3451efc29516b8a0e3b8302f3cfa85666ca802407a7105f862263: Status 404 returned error can't find the container with id 19c554f754b3451efc29516b8a0e3b8302f3cfa85666ca802407a7105f862263
Jul 16 00:59:00.556764 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.556723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-764bfb59d9-249k4" event={"ID":"239f04cf-9a8b-4b84-9e36-46530fb30436","Type":"ContainerStarted","Data":"b0d28a96eab2ad90508c446e84a906f3fc554695066eff4196c8ffb5ac705e5f"}
Jul 16 00:59:00.557278 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.556776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-764bfb59d9-249k4" event={"ID":"239f04cf-9a8b-4b84-9e36-46530fb30436","Type":"ContainerStarted","Data":"19c554f754b3451efc29516b8a0e3b8302f3cfa85666ca802407a7105f862263"}
Jul 16 00:59:00.575723 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.575675    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-764bfb59d9-249k4" podStartSLOduration=1.1218069449999999 podStartE2EDuration="1.575656199s" totalImagesPullingTime="453.849254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:59:00.573751369 +0000 UTC m=+882.496575238" watchObservedRunningTime="2026-07-16 00:59:00.575656199 +0000 UTC m=+882.498480087"
Jul 16 00:59:00.606275 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.606238    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64b6cc794d-s92nl"]
Jul 16 00:59:00.606503 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.606466    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-64b6cc794d-s92nl" podUID="83b14534-a327-45a8-85f0-244a9bb6f9f4" containerName="authorino" containerID="cri-o://6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a" gracePeriod=30
Jul 16 00:59:00.691246 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:59:00.691215    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83b14534_a327_45a8_85f0_244a9bb6f9f4.slice/crio-6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 00:59:00.878227 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.878194    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:59:00.952401 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.952372    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr795\" (UniqueName: \"kubernetes.io/projected/83b14534-a327-45a8-85f0-244a9bb6f9f4-kube-api-access-pr795\") pod \"83b14534-a327-45a8-85f0-244a9bb6f9f4\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") "
Jul 16 00:59:00.952589 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.952448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83b14534-a327-45a8-85f0-244a9bb6f9f4-tls-cert\") pod \"83b14534-a327-45a8-85f0-244a9bb6f9f4\" (UID: \"83b14534-a327-45a8-85f0-244a9bb6f9f4\") "
Jul 16 00:59:00.954547 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.954517    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b14534-a327-45a8-85f0-244a9bb6f9f4-kube-api-access-pr795" (OuterVolumeSpecName: "kube-api-access-pr795") pod "83b14534-a327-45a8-85f0-244a9bb6f9f4" (UID: "83b14534-a327-45a8-85f0-244a9bb6f9f4"). InnerVolumeSpecName "kube-api-access-pr795". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:59:00.963514 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:00.963484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b14534-a327-45a8-85f0-244a9bb6f9f4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "83b14534-a327-45a8-85f0-244a9bb6f9f4" (UID: "83b14534-a327-45a8-85f0-244a9bb6f9f4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:59:01.054252 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.054215    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr795\" (UniqueName: \"kubernetes.io/projected/83b14534-a327-45a8-85f0-244a9bb6f9f4-kube-api-access-pr795\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:59:01.054252 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.054251    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83b14534-a327-45a8-85f0-244a9bb6f9f4-tls-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 00:59:01.563612 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.563577    2578 generic.go:356] "Generic (PLEG): container finished" podID="83b14534-a327-45a8-85f0-244a9bb6f9f4" containerID="6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a" exitCode=0
Jul 16 00:59:01.563612 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.563614    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6cc794d-s92nl"
Jul 16 00:59:01.564127 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.563662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6cc794d-s92nl" event={"ID":"83b14534-a327-45a8-85f0-244a9bb6f9f4","Type":"ContainerDied","Data":"6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a"}
Jul 16 00:59:01.564127 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.563700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6cc794d-s92nl" event={"ID":"83b14534-a327-45a8-85f0-244a9bb6f9f4","Type":"ContainerDied","Data":"747e422b6c755f7501e5f1dd43018f0ab2f510e7e11f721eed6993e4d872df8b"}
Jul 16 00:59:01.564127 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.563716    2578 scope.go:117] "RemoveContainer" containerID="6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a"
Jul 16 00:59:01.574262 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.574246    2578 scope.go:117] "RemoveContainer" containerID="6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a"
Jul 16 00:59:01.574544 ip-10-0-142-236 kubenswrapper[2578]: E0716 00:59:01.574525    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a\": container with ID starting with 6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a not found: ID does not exist" containerID="6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a"
Jul 16 00:59:01.574619 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.574556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a"} err="failed to get container status \"6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a\": rpc error: code = NotFound desc = could not find container \"6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a\": container with ID starting with 6ef0f4c1c646086ff26079da9b50063768f26c6872145ce561662ea51668253a not found: ID does not exist"
Jul 16 00:59:01.586436 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.586412    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64b6cc794d-s92nl"]
Jul 16 00:59:01.588575 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:01.588557    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64b6cc794d-s92nl"]
Jul 16 00:59:02.634611 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:02.634573    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b14534-a327-45a8-85f0-244a9bb6f9f4" path="/var/lib/kubelet/pods/83b14534-a327-45a8-85f0-244a9bb6f9f4/volumes"
Jul 16 00:59:18.537212 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:18.537180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:59:18.539224 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:18.539200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 00:59:18.540754 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:18.540733    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 00:59:18.542852 ip-10-0-142-236 kubenswrapper[2578]: I0716 00:59:18.542835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:04:18.575776 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:04:18.575751    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:04:18.578342 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:04:18.578200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:04:18.579320 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:04:18.579301    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:04:18.581760 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:04:18.581741    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:05:01.003086 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:01.003043    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"]
Jul 16 01:05:01.003683 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:01.003306    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2" podUID="2d2faf30-d3f7-41b5-b686-5235edd9083f" containerName="manager" containerID="cri-o://207a15aa592965f72f334fb4c41e797ea30f25be30308c59fffe0aad8347bbb6" gracePeriod=10
Jul 16 01:05:04.589227 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.589187    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d2faf30-d3f7-41b5-b686-5235edd9083f" containerID="207a15aa592965f72f334fb4c41e797ea30f25be30308c59fffe0aad8347bbb6" exitCode=0
Jul 16 01:05:04.589568 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.589252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2" event={"ID":"2d2faf30-d3f7-41b5-b686-5235edd9083f","Type":"ContainerDied","Data":"207a15aa592965f72f334fb4c41e797ea30f25be30308c59fffe0aad8347bbb6"}
Jul 16 01:05:04.655025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.655002    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 01:05:04.661710 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.661687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dscnl\" (UniqueName: \"kubernetes.io/projected/2d2faf30-d3f7-41b5-b686-5235edd9083f-kube-api-access-dscnl\") pod \"2d2faf30-d3f7-41b5-b686-5235edd9083f\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") "
Jul 16 01:05:04.661850 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.661774    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2faf30-d3f7-41b5-b686-5235edd9083f-extensions-socket-volume\") pod \"2d2faf30-d3f7-41b5-b686-5235edd9083f\" (UID: \"2d2faf30-d3f7-41b5-b686-5235edd9083f\") "
Jul 16 01:05:04.662139 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.662119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d2faf30-d3f7-41b5-b686-5235edd9083f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2d2faf30-d3f7-41b5-b686-5235edd9083f" (UID: "2d2faf30-d3f7-41b5-b686-5235edd9083f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:05:04.663628 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.663603    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d2faf30-d3f7-41b5-b686-5235edd9083f-kube-api-access-dscnl" (OuterVolumeSpecName: "kube-api-access-dscnl") pod "2d2faf30-d3f7-41b5-b686-5235edd9083f" (UID: "2d2faf30-d3f7-41b5-b686-5235edd9083f"). InnerVolumeSpecName "kube-api-access-dscnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:05:04.763242 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.763157    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dscnl\" (UniqueName: \"kubernetes.io/projected/2d2faf30-d3f7-41b5-b686-5235edd9083f-kube-api-access-dscnl\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:05:04.763242 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:04.763187    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2faf30-d3f7-41b5-b686-5235edd9083f-extensions-socket-volume\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:05:05.596230 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:05.596196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2" event={"ID":"2d2faf30-d3f7-41b5-b686-5235edd9083f","Type":"ContainerDied","Data":"c20ac3ac44ef80abbf5837104e1b387e1648ea7ca27b0b943aa89e2dae7a60e6"}
Jul 16 01:05:05.596680 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:05.596234    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"
Jul 16 01:05:05.596680 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:05.596264    2578 scope.go:117] "RemoveContainer" containerID="207a15aa592965f72f334fb4c41e797ea30f25be30308c59fffe0aad8347bbb6"
Jul 16 01:05:05.619472 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:05.619447    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"]
Jul 16 01:05:05.622589 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:05.622565    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tth2"]
Jul 16 01:05:06.632622 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:05:06.632588    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d2faf30-d3f7-41b5-b686-5235edd9083f" path="/var/lib/kubelet/pods/2d2faf30-d3f7-41b5-b686-5235edd9083f/volumes"
Jul 16 01:06:02.209149 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209116    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"]
Jul 16 01:06:02.209625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209516    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d2faf30-d3f7-41b5-b686-5235edd9083f" containerName="manager"
Jul 16 01:06:02.209625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209526    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d2faf30-d3f7-41b5-b686-5235edd9083f" containerName="manager"
Jul 16 01:06:02.209625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209539    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b14534-a327-45a8-85f0-244a9bb6f9f4" containerName="authorino"
Jul 16 01:06:02.209625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209545    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b14534-a327-45a8-85f0-244a9bb6f9f4" containerName="authorino"
Jul 16 01:06:02.209625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209606    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b14534-a327-45a8-85f0-244a9bb6f9f4" containerName="authorino"
Jul 16 01:06:02.209625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.209616    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d2faf30-d3f7-41b5-b686-5235edd9083f" containerName="manager"
Jul 16 01:06:02.212651 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.212635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.215136 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.215117    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2wr9j\""
Jul 16 01:06:02.224263 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.224241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"]
Jul 16 01:06:02.293351 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.293315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhztn\" (UniqueName: \"kubernetes.io/projected/8ec4eaa1-c90d-471a-8593-a996a1c46225-kube-api-access-mhztn\") pod \"kuadrant-operator-controller-manager-86878c769f-ct5rx\" (UID: \"8ec4eaa1-c90d-471a-8593-a996a1c46225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.293555 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.293371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ec4eaa1-c90d-471a-8593-a996a1c46225-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ct5rx\" (UID: \"8ec4eaa1-c90d-471a-8593-a996a1c46225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.394133 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.394091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhztn\" (UniqueName: \"kubernetes.io/projected/8ec4eaa1-c90d-471a-8593-a996a1c46225-kube-api-access-mhztn\") pod \"kuadrant-operator-controller-manager-86878c769f-ct5rx\" (UID: \"8ec4eaa1-c90d-471a-8593-a996a1c46225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.394133 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.394135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ec4eaa1-c90d-471a-8593-a996a1c46225-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ct5rx\" (UID: \"8ec4eaa1-c90d-471a-8593-a996a1c46225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.394454 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.394439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ec4eaa1-c90d-471a-8593-a996a1c46225-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ct5rx\" (UID: \"8ec4eaa1-c90d-471a-8593-a996a1c46225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.403173 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.403153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhztn\" (UniqueName: \"kubernetes.io/projected/8ec4eaa1-c90d-471a-8593-a996a1c46225-kube-api-access-mhztn\") pod \"kuadrant-operator-controller-manager-86878c769f-ct5rx\" (UID: \"8ec4eaa1-c90d-471a-8593-a996a1c46225\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.523478 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.523448    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.662994 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.662967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"]
Jul 16 01:06:02.665117 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:06:02.665089    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec4eaa1_c90d_471a_8593_a996a1c46225.slice/crio-57ca066e906e9c4a7603e18371e61644dbf662a8646930376634907d0f1a6882 WatchSource:0}: Error finding container 57ca066e906e9c4a7603e18371e61644dbf662a8646930376634907d0f1a6882: Status 404 returned error can't find the container with id 57ca066e906e9c4a7603e18371e61644dbf662a8646930376634907d0f1a6882
Jul 16 01:06:02.899996 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.899912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx" event={"ID":"8ec4eaa1-c90d-471a-8593-a996a1c46225","Type":"ContainerStarted","Data":"db174933a7069c4a907559a8fe58fcfbb56202ab6477ffcdfaa39ed484e53431"}
Jul 16 01:06:02.899996 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.899961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx" event={"ID":"8ec4eaa1-c90d-471a-8593-a996a1c46225","Type":"ContainerStarted","Data":"57ca066e906e9c4a7603e18371e61644dbf662a8646930376634907d0f1a6882"}
Jul 16 01:06:02.900178 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.900012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:06:02.927024 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:02.926971    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx" podStartSLOduration=0.926955515 podStartE2EDuration="926.955515ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:06:02.924658547 +0000 UTC m=+1304.847482413" watchObservedRunningTime="2026-07-16 01:06:02.926955515 +0000 UTC m=+1304.849779382"
Jul 16 01:06:13.907371 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:06:13.907339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ct5rx"
Jul 16 01:09:18.610495 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:09:18.610386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:09:18.613854 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:09:18.613834    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:09:18.615520 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:09:18.615498    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:09:18.618830 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:09:18.618808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:12:31.036510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.036479    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"]
Jul 16 01:12:31.040413 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.040389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.043096 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.043071    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f9c9a9ad-openshift-default-dockercfg-l5b5x\""
Jul 16 01:12:31.067351 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.067329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"]
Jul 16 01:12:31.154680 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-token\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-credential-socket\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-certs\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f36e985-1be7-4c9c-8861-6d1d370c7502-istiod-ca-cert\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-podinfo\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b4jp\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-kube-api-access-6b4jp\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-data\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.154905 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-envoy\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.155320 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.154932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-socket\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.255897 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.255857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b4jp\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-kube-api-access-6b4jp\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256062 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.255918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-data\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256062 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.255947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-envoy\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256062 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.255984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-socket\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256062 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-token\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-credential-socket\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-certs\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f36e985-1be7-4c9c-8861-6d1d370c7502-istiod-ca-cert\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-podinfo\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256521 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-data\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256521 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-socket\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256632 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-certs\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.256672 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.256631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-credential-socket\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.257199 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.257177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f36e985-1be7-4c9c-8861-6d1d370c7502-istiod-ca-cert\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.258425 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.258403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-envoy\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.258683 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.258665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-podinfo\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.273674 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.273643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-token\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.273867 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.273847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b4jp\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-kube-api-access-6b4jp\") pod \"e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") " pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.353384 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.353292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:31.504887 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.504859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"]
Jul 16 01:12:31.506388 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:12:31.506364    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f36e985_1be7_4c9c_8861_6d1d370c7502.slice/crio-1d766da9eb0291f33872fff117033a9e3ef07ec45c2b12120488d787a63a7674 WatchSource:0}: Error finding container 1d766da9eb0291f33872fff117033a9e3ef07ec45c2b12120488d787a63a7674: Status 404 returned error can't find the container with id 1d766da9eb0291f33872fff117033a9e3ef07ec45c2b12120488d787a63a7674
Jul 16 01:12:31.508570 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.508535    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:31.508641 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.508607    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:31.508641 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:31.508638    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:32.055269 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:32.055233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x" event={"ID":"7f36e985-1be7-4c9c-8861-6d1d370c7502","Type":"ContainerStarted","Data":"c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d"}
Jul 16 01:12:32.055663 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:32.055293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x" event={"ID":"7f36e985-1be7-4c9c-8861-6d1d370c7502","Type":"ContainerStarted","Data":"1d766da9eb0291f33872fff117033a9e3ef07ec45c2b12120488d787a63a7674"}
Jul 16 01:12:32.081390 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:32.081337    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x" podStartSLOduration=1.081321508 podStartE2EDuration="1.081321508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:32.079024958 +0000 UTC m=+1694.001848825" watchObservedRunningTime="2026-07-16 01:12:32.081321508 +0000 UTC m=+1694.004145375"
Jul 16 01:12:32.354482 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:32.354402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:32.359331 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:32.359309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:33.061123 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:33.061096    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:33.061903 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:33.061886    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:37.408269 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:37.408230    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"]
Jul 16 01:12:37.408775 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:37.408421    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x" podUID="7f36e985-1be7-4c9c-8861-6d1d370c7502" containerName="istio-proxy" containerID="cri-o://c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d" gracePeriod=30
Jul 16 01:12:43.552655 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.552628    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:43.673138 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673048    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b4jp\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-kube-api-access-6b4jp\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673138 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-data\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673372 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673146    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-socket\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673372 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673187    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f36e985-1be7-4c9c-8861-6d1d370c7502-istiod-ca-cert\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673372 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673213    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-envoy\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673372 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-token\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673585 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673476    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:43.673648 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673617    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f36e985-1be7-4c9c-8861-6d1d370c7502-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:12:43.673726 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-certs\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673785 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673744    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-credential-socket\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.673785 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.673770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-podinfo\") pod \"7f36e985-1be7-4c9c-8861-6d1d370c7502\" (UID: \"7f36e985-1be7-4c9c-8861-6d1d370c7502\") "
Jul 16 01:12:43.674070 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:43.674070 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674057    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:43.674236 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674186    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.674292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674244    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.674292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674259    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.674292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:43.674292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.674274    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f36e985-1be7-4c9c-8861-6d1d370c7502-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.675752 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.675729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-kube-api-access-6b4jp" (OuterVolumeSpecName: "kube-api-access-6b4jp") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "kube-api-access-6b4jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:12:43.676338 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.676307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:43.676424 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.676334    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:12:43.676424 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.676338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f36e985-1be7-4c9c-8861-6d1d370c7502" (UID: "7f36e985-1be7-4c9c-8861-6d1d370c7502"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:12:43.775102 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.775070    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b4jp\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-kube-api-access-6b4jp\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.775102 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.775106    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.775295 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.775116    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.775295 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.775124    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f36e985-1be7-4c9c-8861-6d1d370c7502-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:43.775295 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:43.775132    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f36e985-1be7-4c9c-8861-6d1d370c7502-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:44.112618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.112586    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"]
Jul 16 01:12:44.113015 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.113002    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f36e985-1be7-4c9c-8861-6d1d370c7502" containerName="istio-proxy"
Jul 16 01:12:44.113073 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.113016    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f36e985-1be7-4c9c-8861-6d1d370c7502" containerName="istio-proxy"
Jul 16 01:12:44.113109 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.113089    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f36e985-1be7-4c9c-8861-6d1d370c7502" containerName="istio-proxy"
Jul 16 01:12:44.115473 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.115440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.118051 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.118024    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-389a944b-gw-openshift-default-dockercfg-wwljj\""
Jul 16 01:12:44.121835 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.121808    2578 generic.go:356] "Generic (PLEG): container finished" podID="7f36e985-1be7-4c9c-8861-6d1d370c7502" containerID="c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d" exitCode=0
Jul 16 01:12:44.121959 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.121865    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"
Jul 16 01:12:44.121959 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.121902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x" event={"ID":"7f36e985-1be7-4c9c-8861-6d1d370c7502","Type":"ContainerDied","Data":"c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d"}
Jul 16 01:12:44.122064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.121969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x" event={"ID":"7f36e985-1be7-4c9c-8861-6d1d370c7502","Type":"ContainerDied","Data":"1d766da9eb0291f33872fff117033a9e3ef07ec45c2b12120488d787a63a7674"}
Jul 16 01:12:44.122064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.122003    2578 scope.go:117] "RemoveContainer" containerID="c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d"
Jul 16 01:12:44.129980 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.129953    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"]
Jul 16 01:12:44.136700 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.136658    2578 scope.go:117] "RemoveContainer" containerID="c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d"
Jul 16 01:12:44.137103 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:12:44.137081    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d\": container with ID starting with c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d not found: ID does not exist" containerID="c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d"
Jul 16 01:12:44.137221 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.137116    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d"} err="failed to get container status \"c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d\": rpc error: code = NotFound desc = could not find container \"c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d\": container with ID starting with c56f3f08fadc9674446c018071f8ad8ae8a5c44a9bbf2dce89952e960ad9bb7d not found: ID does not exist"
Jul 16 01:12:44.168440 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.168413    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"]
Jul 16 01:12:44.176984 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.176956    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f9c9a9ad-openshift-default-d9c59c95f-xhp9x"]
Jul 16 01:12:44.180528 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-credential-socket\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.180634 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-envoy\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.180634 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istiod-ca-cert\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.180731 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qv6\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-kube-api-access-b9qv6\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.180813 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-podinfo\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.180876 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-data\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.180932 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.180897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-token\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.181022 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.181006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-socket\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.181080 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.181059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-certs\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282530 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-certs\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-credential-socket\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-envoy\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istiod-ca-cert\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qv6\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-kube-api-access-b9qv6\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-podinfo\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-data\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.282705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-token\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.283137 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.282752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-socket\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.283137 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.283006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-certs\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.283137 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.283085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-credential-socket\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.283346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.283325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-socket\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.283424 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.283401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istiod-ca-cert\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.283468 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.283436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-data\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.284973 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.284951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-envoy\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.285143 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.285125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-podinfo\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.294414 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.294390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-token\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.294414 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.294408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qv6\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-kube-api-access-b9qv6\") pod \"e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") " pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.429990 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.429928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:44.576840 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.576815    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"]
Jul 16 01:12:44.578274 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:12:44.578249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70bb6fb_d162_4c4c_8fb3_3256bdab90d0.slice/crio-e12260af8f25ac4aae94bb9e5337f93604844dbb5fc0da33fec1d76520bf85e0 WatchSource:0}: Error finding container e12260af8f25ac4aae94bb9e5337f93604844dbb5fc0da33fec1d76520bf85e0: Status 404 returned error can't find the container with id e12260af8f25ac4aae94bb9e5337f93604844dbb5fc0da33fec1d76520bf85e0
Jul 16 01:12:44.580303 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.580273    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:44.580395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.580341    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:44.580395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.580369    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:44.633886 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:44.633854    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f36e985-1be7-4c9c-8861-6d1d370c7502" path="/var/lib/kubelet/pods/7f36e985-1be7-4c9c-8861-6d1d370c7502/volumes"
Jul 16 01:12:45.130588 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:45.130547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws" event={"ID":"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0","Type":"ContainerStarted","Data":"86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0"}
Jul 16 01:12:45.130811 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:45.130605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws" event={"ID":"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0","Type":"ContainerStarted","Data":"e12260af8f25ac4aae94bb9e5337f93604844dbb5fc0da33fec1d76520bf85e0"}
Jul 16 01:12:45.162096 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:45.162007    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws" podStartSLOduration=1.161988929 podStartE2EDuration="1.161988929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:45.159196879 +0000 UTC m=+1707.082020747" watchObservedRunningTime="2026-07-16 01:12:45.161988929 +0000 UTC m=+1707.084812861"
Jul 16 01:12:45.430213 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:45.430136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:45.435368 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:45.435345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:46.138115 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:46.138076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:46.139036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:46.139014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:50.017745 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:50.017718    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"]
Jul 16 01:12:50.018141 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:50.017903    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws" podUID="c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" containerName="istio-proxy" containerID="cri-o://86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0" gracePeriod=30
Jul 16 01:12:55.479894 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.479869    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:55.501933 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.501902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-credential-socket\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502083 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.501943    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-data\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502083 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.501974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-podinfo\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502083 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502058    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-certs\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502270 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502102    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istiod-ca-cert\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502270 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-token\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502270 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-envoy\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502270 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9qv6\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-kube-api-access-b9qv6\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502270 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502148    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:55.502491 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-socket\") pod \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\" (UID: \"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0\") "
Jul 16 01:12:55.502491 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:55.502569 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502527    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.502569 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502543    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.502882 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.502853    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:55.503099 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.503065    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:55.503320 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.503297    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:12:55.505403 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.505379    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:12:55.505502 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.505429    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-kube-api-access-b9qv6" (OuterVolumeSpecName: "kube-api-access-b9qv6") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "kube-api-access-b9qv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:12:55.505502 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.505443    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:12:55.505609 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.505503    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" (UID: "c70bb6fb-d162-4c4c-8fb3-3256bdab90d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.602996    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.603021    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.603030    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.603037    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.603046    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.603054    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:55.603064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:55.603061    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9qv6\" (UniqueName: \"kubernetes.io/projected/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0-kube-api-access-b9qv6\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:12:56.200345 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.200313    2578 generic.go:356] "Generic (PLEG): container finished" podID="c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" containerID="86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0" exitCode=0
Jul 16 01:12:56.200503 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.200381    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"
Jul 16 01:12:56.200503 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.200401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws" event={"ID":"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0","Type":"ContainerDied","Data":"86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0"}
Jul 16 01:12:56.200503 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.200454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws" event={"ID":"c70bb6fb-d162-4c4c-8fb3-3256bdab90d0","Type":"ContainerDied","Data":"e12260af8f25ac4aae94bb9e5337f93604844dbb5fc0da33fec1d76520bf85e0"}
Jul 16 01:12:56.200503 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.200476    2578 scope.go:117] "RemoveContainer" containerID="86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0"
Jul 16 01:12:56.210526 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.210510    2578 scope.go:117] "RemoveContainer" containerID="86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0"
Jul 16 01:12:56.210758 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:12:56.210739    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0\": container with ID starting with 86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0 not found: ID does not exist" containerID="86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0"
Jul 16 01:12:56.210849 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.210770    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0"} err="failed to get container status \"86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0\": rpc error: code = NotFound desc = could not find container \"86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0\": container with ID starting with 86c5dc0c25b5bf8d261f34949d824dd03bf8fc19f91dbc822edba788caf839f0 not found: ID does not exist"
Jul 16 01:12:56.225577 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.225557    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"]
Jul 16 01:12:56.229878 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.229859    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-389a944b-gw-openshift-default-7fcd485dbc-mvwws"]
Jul 16 01:12:56.435686 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.435654    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"]
Jul 16 01:12:56.436091 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.436074    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" containerName="istio-proxy"
Jul 16 01:12:56.436091 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.436091    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" containerName="istio-proxy"
Jul 16 01:12:56.436258 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.436156    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" containerName="istio-proxy"
Jul 16 01:12:56.439948 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.439921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.442923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.442900    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f122a48d-openshift-default-dockercfg-5nzhn\""
Jul 16 01:12:56.453763 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.453708    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"]
Jul 16 01:12:56.509617 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-credential-socket\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-envoy\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2fz\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-kube-api-access-4p2fz\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-socket\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78469b29-029d-4295-9691-ccfc5389f242-istio-podinfo\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-istio-token\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78469b29-029d-4295-9691-ccfc5389f242-istiod-ca-cert\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.509935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-certs\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.510160 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.509976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-data\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611016 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.610986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78469b29-029d-4295-9691-ccfc5389f242-istiod-ca-cert\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611016 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-certs\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-data\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-credential-socket\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-envoy\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2fz\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-kube-api-access-4p2fz\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-socket\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78469b29-029d-4295-9691-ccfc5389f242-istio-podinfo\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-istio-token\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-certs\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-data\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.611897 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-credential-socket\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.612028 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78469b29-029d-4295-9691-ccfc5389f242-istiod-ca-cert\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.612028 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.611966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-socket\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.613936 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.613913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-envoy\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.614186 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.614167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78469b29-029d-4295-9691-ccfc5389f242-istio-podinfo\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.619953 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.619931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-istio-token\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.620252 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.620232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2fz\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-kube-api-access-4p2fz\") pod \"e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") " pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.634074 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.634050    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c70bb6fb-d162-4c4c-8fb3-3256bdab90d0" path="/var/lib/kubelet/pods/c70bb6fb-d162-4c4c-8fb3-3256bdab90d0/volumes"
Jul 16 01:12:56.751637 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.751564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:56.895384 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.895359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"]
Jul 16 01:12:56.896768 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:12:56.896736    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78469b29_029d_4295_9691_ccfc5389f242.slice/crio-d08267d99541cfd5617ee11e91e6191f91e0ac464e23a40eb181c7c802486340 WatchSource:0}: Error finding container d08267d99541cfd5617ee11e91e6191f91e0ac464e23a40eb181c7c802486340: Status 404 returned error can't find the container with id d08267d99541cfd5617ee11e91e6191f91e0ac464e23a40eb181c7c802486340
Jul 16 01:12:56.898946 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.898916    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:56.899018 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.898981    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:56.899018 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:56.899006    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:12:57.208208 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:57.208176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9" event={"ID":"78469b29-029d-4295-9691-ccfc5389f242","Type":"ContainerStarted","Data":"f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6"}
Jul 16 01:12:57.208428 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:57.208235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9" event={"ID":"78469b29-029d-4295-9691-ccfc5389f242","Type":"ContainerStarted","Data":"d08267d99541cfd5617ee11e91e6191f91e0ac464e23a40eb181c7c802486340"}
Jul 16 01:12:57.235612 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:57.235554    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9" podStartSLOduration=1.235538186 podStartE2EDuration="1.235538186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:57.233112333 +0000 UTC m=+1719.155936221" watchObservedRunningTime="2026-07-16 01:12:57.235538186 +0000 UTC m=+1719.158362053"
Jul 16 01:12:57.751805 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:57.751754    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:57.757206 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:57.757186    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:58.216226 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:58.216199    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:12:58.217221 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:12:58.217205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:13:02.137849 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:02.137811    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"]
Jul 16 01:13:02.138367 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:02.138072    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9" podUID="78469b29-029d-4295-9691-ccfc5389f242" containerName="istio-proxy" containerID="cri-o://f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6" gracePeriod=30
Jul 16 01:13:07.902389 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:07.902328    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:13:08.019853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.019815    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-socket\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.019866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p2fz\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-kube-api-access-4p2fz\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.019886    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78469b29-029d-4295-9691-ccfc5389f242-istio-podinfo\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.019913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-credential-socket\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.019939    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-istio-token\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.019988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-envoy\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020019    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-certs\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020349 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020072    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-data\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020349 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:13:08.020349 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020153    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78469b29-029d-4295-9691-ccfc5389f242-istiod-ca-cert\") pod \"78469b29-029d-4295-9691-ccfc5389f242\" (UID: \"78469b29-029d-4295-9691-ccfc5389f242\") "
Jul 16 01:13:08.020349 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020279    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:13:08.020587 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:13:08.020652 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020590    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.020652 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020607    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.020652 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020621    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.020823 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.020772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78469b29-029d-4295-9691-ccfc5389f242-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:13:08.021144 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.021115    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-data" (OuterVolumeSpecName: "istio-data") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:13:08.022071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.022044    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-kube-api-access-4p2fz" (OuterVolumeSpecName: "kube-api-access-4p2fz") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "kube-api-access-4p2fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:13:08.022194 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.022173    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:13:08.022194 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.022180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78469b29-029d-4295-9691-ccfc5389f242-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:13:08.022293 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.022200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-istio-token" (OuterVolumeSpecName: "istio-token") pod "78469b29-029d-4295-9691-ccfc5389f242" (UID: "78469b29-029d-4295-9691-ccfc5389f242"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:13:08.121865 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.121822    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.121865 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.121861    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78469b29-029d-4295-9691-ccfc5389f242-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.121865 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.121873    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78469b29-029d-4295-9691-ccfc5389f242-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.122082 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.121886    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p2fz\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-kube-api-access-4p2fz\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.122082 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.121900    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78469b29-029d-4295-9691-ccfc5389f242-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.122082 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.121912    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78469b29-029d-4295-9691-ccfc5389f242-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:13:08.288754 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.288719    2578 generic.go:356] "Generic (PLEG): container finished" podID="78469b29-029d-4295-9691-ccfc5389f242" containerID="f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6" exitCode=0
Jul 16 01:13:08.288934 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.288765    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"
Jul 16 01:13:08.288934 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.288818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9" event={"ID":"78469b29-029d-4295-9691-ccfc5389f242","Type":"ContainerDied","Data":"f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6"}
Jul 16 01:13:08.288934 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.288871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9" event={"ID":"78469b29-029d-4295-9691-ccfc5389f242","Type":"ContainerDied","Data":"d08267d99541cfd5617ee11e91e6191f91e0ac464e23a40eb181c7c802486340"}
Jul 16 01:13:08.288934 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.288896    2578 scope.go:117] "RemoveContainer" containerID="f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6"
Jul 16 01:13:08.298387 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.298362    2578 scope.go:117] "RemoveContainer" containerID="f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6"
Jul 16 01:13:08.298644 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:13:08.298625    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6\": container with ID starting with f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6 not found: ID does not exist" containerID="f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6"
Jul 16 01:13:08.298692 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.298653    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6"} err="failed to get container status \"f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6\": rpc error: code = NotFound desc = could not find container \"f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6\": container with ID starting with f7970349179f2764df67ea3a2e16ca00138e1ef3c1f3ed89b61725a6bc0238c6 not found: ID does not exist"
Jul 16 01:13:08.314033 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.314011    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"]
Jul 16 01:13:08.322092 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.322074    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f122a48d-openshift-default-554485d5f5-88kb9"]
Jul 16 01:13:08.635071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:13:08.634993    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78469b29-029d-4295-9691-ccfc5389f242" path="/var/lib/kubelet/pods/78469b29-029d-4295-9691-ccfc5389f242/volumes"
Jul 16 01:14:18.646952 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:18.646924    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:14:18.650495 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:18.650476    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:14:18.658527 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:18.658507    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:14:18.661922 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:18.661900    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:14:46.029014 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.028978    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"]
Jul 16 01:14:46.029484 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.029408    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78469b29-029d-4295-9691-ccfc5389f242" containerName="istio-proxy"
Jul 16 01:14:46.029484 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.029420    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="78469b29-029d-4295-9691-ccfc5389f242" containerName="istio-proxy"
Jul 16 01:14:46.029600 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.029492    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="78469b29-029d-4295-9691-ccfc5389f242" containerName="istio-proxy"
Jul 16 01:14:46.031555 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.031535    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.034611 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.034584    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-54ada037-openshift-default-dockercfg-79cqk\""
Jul 16 01:14:46.057198 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.057172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"]
Jul 16 01:14:46.090935 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.090907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whs6j\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-kube-api-access-whs6j\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091081 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.090949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-token\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091081 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.090974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-data\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091199 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.091087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-podinfo\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091199 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.091130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-certs\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091199 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.091192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-credential-socket\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091315 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.091211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-envoy\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091315 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.091237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istiod-ca-cert\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.091315 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.091278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-socket\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.191731 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.191695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-data\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.191954 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.191751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-podinfo\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.191954 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.191857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-certs\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.191954 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.191912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-credential-socket\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.191954 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.191937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-envoy\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192139 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.191960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istiod-ca-cert\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192139 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-socket\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192139 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whs6j\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-kube-api-access-whs6j\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192139 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-token\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192354 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-data\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192354 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-certs\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192354 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-credential-socket\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192518 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-socket\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.192936 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.192912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istiod-ca-cert\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.194136 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.194118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-envoy\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.194463 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.194447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-podinfo\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.200065 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.200045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whs6j\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-kube-api-access-whs6j\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.200150 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.200107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-token\") pod \"e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") " pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.345129 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.345045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:46.482586 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.482552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"]
Jul 16 01:14:46.484453 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:14:46.484420    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b1b075_586e_445f_98a5_88c09a1ee8d6.slice/crio-7a57b757b1ff5cada54b072cb8e160971f044222e890e6f12679b798b5b90542 WatchSource:0}: Error finding container 7a57b757b1ff5cada54b072cb8e160971f044222e890e6f12679b798b5b90542: Status 404 returned error can't find the container with id 7a57b757b1ff5cada54b072cb8e160971f044222e890e6f12679b798b5b90542
Jul 16 01:14:46.486669 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.486637    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:14:46.486767 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.486715    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:14:46.486767 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.486761    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:14:46.825493 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.825458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" event={"ID":"d1b1b075-586e-445f-98a5-88c09a1ee8d6","Type":"ContainerStarted","Data":"632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"}
Jul 16 01:14:46.825648 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.825514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" event={"ID":"d1b1b075-586e-445f-98a5-88c09a1ee8d6","Type":"ContainerStarted","Data":"7a57b757b1ff5cada54b072cb8e160971f044222e890e6f12679b798b5b90542"}
Jul 16 01:14:46.848438 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:46.848378    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podStartSLOduration=0.848355216 podStartE2EDuration="848.355216ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:14:46.845164903 +0000 UTC m=+1828.767988794" watchObservedRunningTime="2026-07-16 01:14:46.848355216 +0000 UTC m=+1828.771179084"
Jul 16 01:14:47.345861 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:47.345830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:47.351088 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:47.351067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:47.831805 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:47.831759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:14:47.832951 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:14:47.832928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:15:03.434030 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.433991    2578 patch_prober.go:28] interesting pod/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:59152->10.133.0.60:15021: read: connection reset by peer" start-of-body=
Jul 16 01:15:03.434425 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.434078    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:59152->10.133.0.60:15021: read: connection reset by peer"
Jul 16 01:15:03.924690 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.924658    2578 generic.go:356] "Generic (PLEG): container finished" podID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerID="632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7" exitCode=0
Jul 16 01:15:03.924876 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.924731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" event={"ID":"d1b1b075-586e-445f-98a5-88c09a1ee8d6","Type":"ContainerDied","Data":"632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"}
Jul 16 01:15:03.925136 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.925121    2578 scope.go:117] "RemoveContainer" containerID="632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"
Jul 16 01:15:03.926166 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.926137    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:15:03.926228 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.926212    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:15:03.926263 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:03.926245    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:15:04.934331 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:04.933392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" event={"ID":"d1b1b075-586e-445f-98a5-88c09a1ee8d6","Type":"ContainerStarted","Data":"e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49"}
Jul 16 01:15:05.346174 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:05.346129    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:15:05.346393 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:05.346270    2578 patch_prober.go:28] interesting pod/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 01:15:05.346393 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:05.346315    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 01:15:06.346437 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:06.346393    2578 patch_prober.go:28] interesting pod/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 01:15:06.346978 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:06.346460    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 01:15:07.345815 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:07.345755    2578 patch_prober.go:28] interesting pod/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 01:15:07.346029 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:07.345850    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 01:15:08.346780 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:08.346732    2578 patch_prober.go:28] interesting pod/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 01:15:08.347302 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:08.346825    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 01:15:08.405518 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:08.405486    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"]
Jul 16 01:15:08.405704 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:08.405682    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy" containerID="cri-o://e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49" gracePeriod=30
Jul 16 01:15:13.968205 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:13.968179    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:15:13.996512 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:13.996443    2578 generic.go:356] "Generic (PLEG): container finished" podID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerID="e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49" exitCode=0
Jul 16 01:15:13.996512 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:13.996497    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"
Jul 16 01:15:13.996814 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:13.996533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" event={"ID":"d1b1b075-586e-445f-98a5-88c09a1ee8d6","Type":"ContainerDied","Data":"e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49"}
Jul 16 01:15:13.996814 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:13.996629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn" event={"ID":"d1b1b075-586e-445f-98a5-88c09a1ee8d6","Type":"ContainerDied","Data":"7a57b757b1ff5cada54b072cb8e160971f044222e890e6f12679b798b5b90542"}
Jul 16 01:15:13.996814 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:13.996661    2578 scope.go:117] "RemoveContainer" containerID="e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49"
Jul 16 01:15:14.005947 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.005931    2578 scope.go:117] "RemoveContainer" containerID="632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"
Jul 16 01:15:14.016221 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.016204    2578 scope.go:117] "RemoveContainer" containerID="e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49"
Jul 16 01:15:14.016471 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:15:14.016452    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49\": container with ID starting with e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49 not found: ID does not exist" containerID="e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49"
Jul 16 01:15:14.016554 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.016484    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49"} err="failed to get container status \"e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49\": rpc error: code = NotFound desc = could not find container \"e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49\": container with ID starting with e74bb72a8157a9af2d7b7acca13bb4d74da740d8fb709ea0a3507768951a8e49 not found: ID does not exist"
Jul 16 01:15:14.016554 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.016509    2578 scope.go:117] "RemoveContainer" containerID="632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"
Jul 16 01:15:14.016835 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:15:14.016819    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7\": container with ID starting with 632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7 not found: ID does not exist" containerID="632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"
Jul 16 01:15:14.016896 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.016844    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7"} err="failed to get container status \"632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7\": rpc error: code = NotFound desc = could not find container \"632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7\": container with ID starting with 632bbad6704e90e237ac19441eab29d166174d2714d1e12e2dc6868adff7a3f7 not found: ID does not exist"
Jul 16 01:15:14.065290 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065256    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-certs\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065449 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-podinfo\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065449 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-socket\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065449 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-envoy\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065483    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-credential-socket\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065521    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-data\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:15:14.065625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065559    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whs6j\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-kube-api-access-whs6j\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-token\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istiod-ca-cert\") pod \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\" (UID: \"d1b1b075-586e-445f-98a5-88c09a1ee8d6\") "
Jul 16 01:15:14.065932 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065750    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:15:14.065932 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.065781    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:15:14.066072 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.066052    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.066144 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.066077    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.066144 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.066093    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.066144 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.066091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:15:14.066435 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.066412    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:15:14.067702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.067668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:15:14.067879 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.067856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:15:14.068005 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.067985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:15:14.068101 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.068081    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-kube-api-access-whs6j" (OuterVolumeSpecName: "kube-api-access-whs6j") pod "d1b1b075-586e-445f-98a5-88c09a1ee8d6" (UID: "d1b1b075-586e-445f-98a5-88c09a1ee8d6"). InnerVolumeSpecName "kube-api-access-whs6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:15:14.166702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.166668    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.166702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.166696    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whs6j\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-kube-api-access-whs6j\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.166702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.166706    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.166960 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.166716    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.166960 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.166725    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.166960 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.166733    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b1b075-586e-445f-98a5-88c09a1ee8d6-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:15:14.320026 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.319994    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"]
Jul 16 01:15:14.323817 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.323782    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-54ada037-openshift-default-ccdf877c5-hd7nn"]
Jul 16 01:15:14.632941 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:15:14.632860    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" path="/var/lib/kubelet/pods/d1b1b075-586e-445f-98a5-88c09a1ee8d6/volumes"
Jul 16 01:16:22.719128 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.719097    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"]
Jul 16 01:16:22.719750 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.719635    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy"
Jul 16 01:16:22.719750 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.719654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy"
Jul 16 01:16:22.719750 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.719675    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy"
Jul 16 01:16:22.719750 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.719683    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy"
Jul 16 01:16:22.719998 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.719812    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy"
Jul 16 01:16:22.723022 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.723002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.725571 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.725556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-53347c-openshift-default-dockercfg-7mqml\""
Jul 16 01:16:22.737771 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.737740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"]
Jul 16 01:16:22.767335 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-certs\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767493 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-data\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767493 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-credential-socket\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767493 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istiod-ca-cert\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767650 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-envoy\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767650 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-token\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767650 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s6gk\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-kube-api-access-2s6gk\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767787 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-socket\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.767787 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.767701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-podinfo\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868412 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-certs\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868628 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-data\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868628 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-credential-socket\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868628 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istiod-ca-cert\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868833 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-envoy\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868833 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-token\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868833 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s6gk\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-kube-api-access-2s6gk\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.868833 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-socket\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.869042 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-podinfo\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.869042 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.868861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-certs\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.869145 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.869069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-data\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.869207 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.869178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-credential-socket\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.869266 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.869253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-socket\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.869417 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.869398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istiod-ca-cert\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.870786 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.870768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-envoy\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.871237 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.871218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-podinfo\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.876930 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.876904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-token\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:22.877045 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:22.877022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s6gk\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-kube-api-access-2s6gk\") pod \"e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") " pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:23.033676 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.033627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:23.185696 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.182996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"]
Jul 16 01:16:23.187857 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.187819    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:23.187952 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.187901    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:23.187952 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.187941    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:23.388116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.388011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" event={"ID":"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0","Type":"ContainerStarted","Data":"404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"}
Jul 16 01:16:23.388116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.388069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" event={"ID":"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0","Type":"ContainerStarted","Data":"31065e73cc6c436beba32d59f37a9be929181b1267fe72d90f4ac127957fbad5"}
Jul 16 01:16:23.411211 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:23.411165    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podStartSLOduration=1.411150459 podStartE2EDuration="1.411150459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:16:23.408561842 +0000 UTC m=+1925.331385727" watchObservedRunningTime="2026-07-16 01:16:23.411150459 +0000 UTC m=+1925.333974328"
Jul 16 01:16:24.034703 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:24.034668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:24.040338 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:24.040314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:24.394334 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:24.394240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:24.395536 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:24.395514    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:30.465923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.465882    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"]
Jul 16 01:16:30.466478 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.466463    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b1b075-586e-445f-98a5-88c09a1ee8d6" containerName="istio-proxy"
Jul 16 01:16:30.469754 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.469736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.472075 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.472055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-640a35-openshift-default-dockercfg-ftgmm\""
Jul 16 01:16:30.482714 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.482695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"]
Jul 16 01:16:30.543096 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-envoy\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543263 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc892ca-3323-48f5-a82f-555efb89e3ca-istiod-ca-cert\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543263 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-podinfo\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543263 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz9gg\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-kube-api-access-hz9gg\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543263 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-certs\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-token\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-data\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-socket\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.543423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.543380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-credential-socket\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.644517 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-credential-socket\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.644698 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-envoy\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.644698 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc892ca-3323-48f5-a82f-555efb89e3ca-istiod-ca-cert\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.644698 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-podinfo\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.644698 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz9gg\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-kube-api-access-hz9gg\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.644698 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-certs\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645026 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-token\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645026 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-data\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645026 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-socket\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645026 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.644906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-credential-socket\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645242 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.645154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-socket\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645242 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.645186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-certs\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645357 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.645250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-data\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.645411 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.645395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc892ca-3323-48f5-a82f-555efb89e3ca-istiod-ca-cert\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.646804 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.646770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-envoy\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.647155 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.647135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-podinfo\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.652761 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.652735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-token\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.653152 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.653128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz9gg\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-kube-api-access-hz9gg\") pod \"e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") " pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.782527 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.782499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:30.928874 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.928840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"]
Jul 16 01:16:30.930688 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:16:30.930662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc892ca_3323_48f5_a82f_555efb89e3ca.slice/crio-4979ef4909d5c31de526896a4c27be3636ea194ac5fc9f1807db5b7105988ea6 WatchSource:0}: Error finding container 4979ef4909d5c31de526896a4c27be3636ea194ac5fc9f1807db5b7105988ea6: Status 404 returned error can't find the container with id 4979ef4909d5c31de526896a4c27be3636ea194ac5fc9f1807db5b7105988ea6
Jul 16 01:16:30.933326 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.933292    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:30.933388 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.933374    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:30.933427 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:30.933414    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:31.437657 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:31.437615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" event={"ID":"fdc892ca-3323-48f5-a82f-555efb89e3ca","Type":"ContainerStarted","Data":"868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"}
Jul 16 01:16:31.437877 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:31.437686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" event={"ID":"fdc892ca-3323-48f5-a82f-555efb89e3ca","Type":"ContainerStarted","Data":"4979ef4909d5c31de526896a4c27be3636ea194ac5fc9f1807db5b7105988ea6"}
Jul 16 01:16:31.460811 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:31.460745    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" podStartSLOduration=1.460729827 podStartE2EDuration="1.460729827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:16:31.459000985 +0000 UTC m=+1933.381824870" watchObservedRunningTime="2026-07-16 01:16:31.460729827 +0000 UTC m=+1933.383553693"
Jul 16 01:16:31.783583 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:31.783552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:31.788722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:31.788698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:32.444166 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:32.444140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:32.445153 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:32.445134    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:40.437983 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:40.437938    2578 patch_prober.go:28] interesting pod/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 01:16:40.438375 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:40.438014    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 01:16:42.503183 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:42.503149    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerID="404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33" exitCode=0
Jul 16 01:16:42.503616 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:42.503228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" event={"ID":"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0","Type":"ContainerDied","Data":"404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"}
Jul 16 01:16:42.503718 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:42.503700    2578 scope.go:117] "RemoveContainer" containerID="404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"
Jul 16 01:16:42.505031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:42.505005    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:42.505098 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:42.505077    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:42.505138 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:42.505114    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:43.510779 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:43.510746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" event={"ID":"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0","Type":"ContainerStarted","Data":"175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3"}
Jul 16 01:16:44.034710 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:44.034678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:44.035092 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:44.035068    2578 patch_prober.go:28] interesting pod/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 01:16:44.035241 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:44.035216    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 01:16:45.034299 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:45.034250    2578 patch_prober.go:28] interesting pod/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 01:16:45.034836 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:45.034336    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 01:16:46.035077 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:46.035034    2578 patch_prober.go:28] interesting pod/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 01:16:46.035589 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:46.035108    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 01:16:47.035147 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:47.035104    2578 patch_prober.go:28] interesting pod/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 01:16:47.035655 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:47.035187    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 01:16:48.043214 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:48.043180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:48.044360 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:48.044328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:48.047574 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:48.047549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:16:51.559550 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:51.559519    2578 generic.go:356] "Generic (PLEG): container finished" podID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerID="868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da" exitCode=0
Jul 16 01:16:51.560007 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:51.559595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" event={"ID":"fdc892ca-3323-48f5-a82f-555efb89e3ca","Type":"ContainerDied","Data":"868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"}
Jul 16 01:16:51.560102 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:51.560085    2578 scope.go:117] "RemoveContainer" containerID="868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"
Jul 16 01:16:51.561231 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:51.561199    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:51.561293 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:51.561273    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:51.561329 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:51.561312    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:16:52.568045 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:52.568012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" event={"ID":"fdc892ca-3323-48f5-a82f-555efb89e3ca","Type":"ContainerStarted","Data":"c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71"}
Jul 16 01:16:52.782970 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:52.782937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:52.783143 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:52.783122    2578 patch_prober.go:28] interesting pod/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 01:16:52.783200 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:52.783167    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 01:16:53.783079 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:53.783043    2578 patch_prober.go:28] interesting pod/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 01:16:53.783574 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:53.783122    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 01:16:54.783492 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:54.783451    2578 patch_prober.go:28] interesting pod/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 01:16:54.784001 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:54.783513    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 01:16:55.783598 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:55.783565    2578 patch_prober.go:28] interesting pod/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 01:16:55.784018 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:55.783620    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 01:16:56.786117 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:56.786082    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:56.786585 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:56.786349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:16:56.786948 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:16:56.786933    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:17:05.993390 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:05.993347    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"]
Jul 16 01:17:05.998731 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:05.998706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.002100 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.002071    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-640a35\"/\"default-dockercfg-99jxg\""
Jul 16 01:17:06.002603 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.002579    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-640a35\"/\"openshift-service-ca.crt\""
Jul 16 01:17:06.002787 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.002661    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-640a35\"/\"test-model-640a35-kserve-self-signed-certs\""
Jul 16 01:17:06.002962 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.002689    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-640a35\"/\"kube-root-ca.crt\""
Jul 16 01:17:06.006244 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.006180    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"]
Jul 16 01:17:06.114111 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.114076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-home\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.114292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.114130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-dshm\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.114292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.114179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tmp-dir\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.114292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.114216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tls-certs\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.114292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.114237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-model-cache\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.114292 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.114283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8mb\" (UniqueName: \"kubernetes.io/projected/decde6af-80f7-43c7-a8a3-ce756e37ecbf-kube-api-access-vk8mb\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215112 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-home\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215296 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-dshm\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215296 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tmp-dir\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215296 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tls-certs\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215427 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-model-cache\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215527 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8mb\" (UniqueName: \"kubernetes.io/projected/decde6af-80f7-43c7-a8a3-ce756e37ecbf-kube-api-access-vk8mb\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215592 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-home\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215592 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tmp-dir\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.215771 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.215750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-model-cache\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.217553 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.217525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-dshm\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.217730 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.217714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tls-certs\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.224091 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.224070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8mb\" (UniqueName: \"kubernetes.io/projected/decde6af-80f7-43c7-a8a3-ce756e37ecbf-kube-api-access-vk8mb\") pod \"test-model-640a35-kserve-79496d78dc-mmhgf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") " pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.310784 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.310760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:06.655417 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:06.655393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"]
Jul 16 01:17:06.657054 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:17:06.657024    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddecde6af_80f7_43c7_a8a3_ce756e37ecbf.slice/crio-b925b607f339bf88a85c8d403344966e9a8cbde9e57f468d44462351ff2d6f20 WatchSource:0}: Error finding container b925b607f339bf88a85c8d403344966e9a8cbde9e57f468d44462351ff2d6f20: Status 404 returned error can't find the container with id b925b607f339bf88a85c8d403344966e9a8cbde9e57f468d44462351ff2d6f20
Jul 16 01:17:07.658049 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:07.657999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf" event={"ID":"decde6af-80f7-43c7-a8a3-ce756e37ecbf","Type":"ContainerStarted","Data":"6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80"}
Jul 16 01:17:07.658049 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:07.658053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf" event={"ID":"decde6af-80f7-43c7-a8a3-ce756e37ecbf","Type":"ContainerStarted","Data":"b925b607f339bf88a85c8d403344966e9a8cbde9e57f468d44462351ff2d6f20"}
Jul 16 01:17:07.678588 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:07.678531    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf" podStartSLOduration=2.678517467 podStartE2EDuration="2.678517467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:17:07.675626664 +0000 UTC m=+1969.598450530" watchObservedRunningTime="2026-07-16 01:17:07.678517467 +0000 UTC m=+1969.601341368"
Jul 16 01:17:16.311167 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:16.311126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:16.311631 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:16.311182    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:16.323719 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:16.323694    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:16.717031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:16.716952    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:37.485385 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:37.485354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"]
Jul 16 01:17:52.505392 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.505323    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf" podUID="decde6af-80f7-43c7-a8a3-ce756e37ecbf" containerName="main" containerID="cri-o://6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80" gracePeriod=45
Jul 16 01:17:52.763249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.763192    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:52.853813 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.853763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-dshm\") pod \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") "
Jul 16 01:17:52.853957 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.853878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tls-certs\") pod \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") "
Jul 16 01:17:52.853957 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.853899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-home\") pod \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") "
Jul 16 01:17:52.853957 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.853946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk8mb\" (UniqueName: \"kubernetes.io/projected/decde6af-80f7-43c7-a8a3-ce756e37ecbf-kube-api-access-vk8mb\") pod \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") "
Jul 16 01:17:52.854078 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.853972    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-model-cache\") pod \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") "
Jul 16 01:17:52.854148 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tmp-dir\") pod \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\" (UID: \"decde6af-80f7-43c7-a8a3-ce756e37ecbf\") "
Jul 16 01:17:52.854201 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854177    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-model-cache" (OuterVolumeSpecName: "model-cache") pod "decde6af-80f7-43c7-a8a3-ce756e37ecbf" (UID: "decde6af-80f7-43c7-a8a3-ce756e37ecbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:17:52.854201 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854189    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-home" (OuterVolumeSpecName: "home") pod "decde6af-80f7-43c7-a8a3-ce756e37ecbf" (UID: "decde6af-80f7-43c7-a8a3-ce756e37ecbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:17:52.854386 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854362    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "decde6af-80f7-43c7-a8a3-ce756e37ecbf" (UID: "decde6af-80f7-43c7-a8a3-ce756e37ecbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:17:52.854542 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854526    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:17:52.854595 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854549    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:17:52.854595 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.854561    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:17:52.856015 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.855997    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-dshm" (OuterVolumeSpecName: "dshm") pod "decde6af-80f7-43c7-a8a3-ce756e37ecbf" (UID: "decde6af-80f7-43c7-a8a3-ce756e37ecbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:17:52.856125 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.856110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/decde6af-80f7-43c7-a8a3-ce756e37ecbf-kube-api-access-vk8mb" (OuterVolumeSpecName: "kube-api-access-vk8mb") pod "decde6af-80f7-43c7-a8a3-ce756e37ecbf" (UID: "decde6af-80f7-43c7-a8a3-ce756e37ecbf"). InnerVolumeSpecName "kube-api-access-vk8mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:17:52.856204 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.856185    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "decde6af-80f7-43c7-a8a3-ce756e37ecbf" (UID: "decde6af-80f7-43c7-a8a3-ce756e37ecbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:17:52.915331 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.915301    2578 generic.go:356] "Generic (PLEG): container finished" podID="decde6af-80f7-43c7-a8a3-ce756e37ecbf" containerID="6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80" exitCode=0
Jul 16 01:17:52.915486 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.915343    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"
Jul 16 01:17:52.915486 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.915388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf" event={"ID":"decde6af-80f7-43c7-a8a3-ce756e37ecbf","Type":"ContainerDied","Data":"6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80"}
Jul 16 01:17:52.915486 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.915439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf" event={"ID":"decde6af-80f7-43c7-a8a3-ce756e37ecbf","Type":"ContainerDied","Data":"b925b607f339bf88a85c8d403344966e9a8cbde9e57f468d44462351ff2d6f20"}
Jul 16 01:17:52.915486 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.915462    2578 scope.go:117] "RemoveContainer" containerID="6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80"
Jul 16 01:17:52.925031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.925007    2578 scope.go:117] "RemoveContainer" containerID="6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80"
Jul 16 01:17:52.925270 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:17:52.925252    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80\": container with ID starting with 6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80 not found: ID does not exist" containerID="6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80"
Jul 16 01:17:52.925337 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.925283    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80"} err="failed to get container status \"6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80\": rpc error: code = NotFound desc = could not find container \"6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80\": container with ID starting with 6fca61b1f79ea3e16c591fdd6cd6c26c6848ae3e59e4140f7afe806aa1194a80 not found: ID does not exist"
Jul 16 01:17:52.937708 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.937678    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"]
Jul 16 01:17:52.947731 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.944193    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-640a35/test-model-640a35-kserve-79496d78dc-mmhgf"]
Jul 16 01:17:52.955327 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.955302    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/decde6af-80f7-43c7-a8a3-ce756e37ecbf-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:17:52.955415 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.955330    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk8mb\" (UniqueName: \"kubernetes.io/projected/decde6af-80f7-43c7-a8a3-ce756e37ecbf-kube-api-access-vk8mb\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:17:52.955415 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:52.955341    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/decde6af-80f7-43c7-a8a3-ce756e37ecbf-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:17:54.632947 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:17:54.632902    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="decde6af-80f7-43c7-a8a3-ce756e37ecbf" path="/var/lib/kubelet/pods/decde6af-80f7-43c7-a8a3-ce756e37ecbf/volumes"
Jul 16 01:18:20.633310 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:20.633280    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"]
Jul 16 01:18:20.633786 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:20.633534    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy" containerID="cri-o://175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3" gracePeriod=30
Jul 16 01:18:25.883666 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.883641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:18:25.959835 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959740    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-data\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.959835 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959774    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s6gk\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-kube-api-access-2s6gk\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.959835 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-certs\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-podinfo\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-token\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-credential-socket\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.959963    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-socket\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960116 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-envoy\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960382 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960109    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:25.960382 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960150    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istiod-ca-cert\") pod \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\" (UID: \"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0\") "
Jul 16 01:18:25.960382 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:25.960541 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960473    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:25.960609 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960514    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:25.960609 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960564    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:25.960609 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:25.960765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.960643    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:18:25.962262 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.962228    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:25.962388 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.962294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-kube-api-access-2s6gk" (OuterVolumeSpecName: "kube-api-access-2s6gk") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "kube-api-access-2s6gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:18:25.962500 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.962483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:18:25.962538 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:25.962507    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" (UID: "8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:18:26.062085 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062057    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.062085 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062081    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.062085 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062090    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.062299 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062099    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s6gk\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-kube-api-access-2s6gk\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.062299 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062109    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.062299 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062116    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.062299 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.062125    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:26.104166 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.104132    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerID="175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3" exitCode=0
Jul 16 01:18:26.104283 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.104177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"
Jul 16 01:18:26.104283 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.104216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" event={"ID":"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0","Type":"ContainerDied","Data":"175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3"}
Jul 16 01:18:26.104283 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.104271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr" event={"ID":"8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0","Type":"ContainerDied","Data":"31065e73cc6c436beba32d59f37a9be929181b1267fe72d90f4ac127957fbad5"}
Jul 16 01:18:26.104419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.104294    2578 scope.go:117] "RemoveContainer" containerID="175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3"
Jul 16 01:18:26.116502 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.116477    2578 scope.go:117] "RemoveContainer" containerID="404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"
Jul 16 01:18:26.124915 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.124827    2578 scope.go:117] "RemoveContainer" containerID="175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3"
Jul 16 01:18:26.125306 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:18:26.125181    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3\": container with ID starting with 175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3 not found: ID does not exist" containerID="175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3"
Jul 16 01:18:26.125306 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.125217    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3"} err="failed to get container status \"175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3\": rpc error: code = NotFound desc = could not find container \"175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3\": container with ID starting with 175847534d1b3689cacc7791660cdfe39f62d3f8b3d07d173dc143f5eb3c63f3 not found: ID does not exist"
Jul 16 01:18:26.125306 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.125241    2578 scope.go:117] "RemoveContainer" containerID="404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"
Jul 16 01:18:26.125554 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:18:26.125534    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33\": container with ID starting with 404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33 not found: ID does not exist" containerID="404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"
Jul 16 01:18:26.125600 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.125562    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33"} err="failed to get container status \"404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33\": rpc error: code = NotFound desc = could not find container \"404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33\": container with ID starting with 404366286df191bcd694bdb3c3e3a35b4545b4ca2a810a1976c6af505d412d33 not found: ID does not exist"
Jul 16 01:18:26.127679 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.127661    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"]
Jul 16 01:18:26.131469 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.131448    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-53347c-openshift-default-847599ccdc-gvwdr"]
Jul 16 01:18:26.633508 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:26.633470    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" path="/var/lib/kubelet/pods/8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0/volumes"
Jul 16 01:18:27.793696 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:27.793664    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"]
Jul 16 01:18:27.794117 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:27.793882    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy" containerID="cri-o://c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71" gracePeriod=30
Jul 16 01:18:28.686215 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686185    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"]
Jul 16 01:18:28.686647 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686629    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decde6af-80f7-43c7-a8a3-ce756e37ecbf" containerName="main"
Jul 16 01:18:28.686647 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686647    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="decde6af-80f7-43c7-a8a3-ce756e37ecbf" containerName="main"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686663    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686669    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686680    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686688    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686763    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686776    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac12726-0d9c-4fbb-82a9-f0c4dc0e28d0" containerName="istio-proxy"
Jul 16 01:18:28.686848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.686809    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="decde6af-80f7-43c7-a8a3-ce756e37ecbf" containerName="main"
Jul 16 01:18:28.691599 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.691580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.694016 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.693997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-314e69-openshift-default-dockercfg-wr65h\""
Jul 16 01:18:28.701754 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.701732    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"]
Jul 16 01:18:28.787199 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-envoy\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.787385 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-token\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.787459 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-data\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.787516 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8jf\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-kube-api-access-mc8jf\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.787616 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-socket\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.787892 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-podinfo\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.788043 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-certs\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.788043 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.787971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istiod-ca-cert\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.788043 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.788038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-credential-socket\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889401 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-envoy\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-token\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-data\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8jf\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-kube-api-access-mc8jf\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-socket\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-podinfo\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-certs\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istiod-ca-cert\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.889923 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-credential-socket\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.890318 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.889935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-data\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.890452 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.890429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-certs\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.890452 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.890442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istiod-ca-cert\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.890574 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.890460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-socket\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.890574 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.890526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-credential-socket\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.891725 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.891701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-envoy\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.892406 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.892384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-podinfo\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.899029 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.898963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8jf\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-kube-api-access-mc8jf\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:28.899171 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:28.899151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-token\") pod \"e2e-api-a-314e69-openshift-default-69675d5c87-677k5\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") " pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:29.002582 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:29.002499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:29.148272 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:29.148242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"]
Jul 16 01:18:29.150113 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:18:29.150080    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe3b630_3ffc_4381_9775_6a8d6d5f5405.slice/crio-8877e90b284594ab9e8e507ec18a282df5493c9d7c40bedab25aadb23fbab59c WatchSource:0}: Error finding container 8877e90b284594ab9e8e507ec18a282df5493c9d7c40bedab25aadb23fbab59c: Status 404 returned error can't find the container with id 8877e90b284594ab9e8e507ec18a282df5493c9d7c40bedab25aadb23fbab59c
Jul 16 01:18:29.152389 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:29.152358    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:29.152454 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:29.152424    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:29.152492 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:29.152451    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:30.128848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:30.128809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" event={"ID":"5fe3b630-3ffc-4381-9775-6a8d6d5f5405","Type":"ContainerStarted","Data":"eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"}
Jul 16 01:18:30.129240 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:30.128875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" event={"ID":"5fe3b630-3ffc-4381-9775-6a8d6d5f5405","Type":"ContainerStarted","Data":"8877e90b284594ab9e8e507ec18a282df5493c9d7c40bedab25aadb23fbab59c"}
Jul 16 01:18:30.151842 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:30.151782    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" podStartSLOduration=2.151767641 podStartE2EDuration="2.151767641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:18:30.14974377 +0000 UTC m=+2052.072567657" watchObservedRunningTime="2026-07-16 01:18:30.151767641 +0000 UTC m=+2052.074591507"
Jul 16 01:18:31.003297 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:31.003263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:31.008664 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:31.008634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:31.137563 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:31.137523    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:31.138527 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:31.138510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:33.054419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.054362    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:18:33.132769 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.132741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-podinfo\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.132936 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.132808    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-envoy\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.132936 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.132849    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc892ca-3323-48f5-a82f-555efb89e3ca-istiod-ca-cert\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.132936 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.132905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-certs\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.133089 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.132956    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-token\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.133089 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.132988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz9gg\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-kube-api-access-hz9gg\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.133089 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-data\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.133250 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133094    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-socket\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.133250 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133118    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-credential-socket\") pod \"fdc892ca-3323-48f5-a82f-555efb89e3ca\" (UID: \"fdc892ca-3323-48f5-a82f-555efb89e3ca\") "
Jul 16 01:18:33.133359 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:33.133359 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdc892ca-3323-48f5-a82f-555efb89e3ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:18:33.133497 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:33.133556 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133494    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:33.133901 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133830    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.133901 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133855    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.133901 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133870    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc892ca-3323-48f5-a82f-555efb89e3ca-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.133901 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.133881    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.134210 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.134189    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:33.135823 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.135784    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:18:33.135933 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.135834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-kube-api-access-hz9gg" (OuterVolumeSpecName: "kube-api-access-hz9gg") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "kube-api-access-hz9gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:18:33.135933 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.135850    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:18:33.135933 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.135930    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdc892ca-3323-48f5-a82f-555efb89e3ca" (UID: "fdc892ca-3323-48f5-a82f-555efb89e3ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:18:33.150240 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.150216    2578 generic.go:356] "Generic (PLEG): container finished" podID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerID="c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71" exitCode=0
Jul 16 01:18:33.150340 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.150268    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"
Jul 16 01:18:33.150340 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.150298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" event={"ID":"fdc892ca-3323-48f5-a82f-555efb89e3ca","Type":"ContainerDied","Data":"c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71"}
Jul 16 01:18:33.150436 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.150353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s" event={"ID":"fdc892ca-3323-48f5-a82f-555efb89e3ca","Type":"ContainerDied","Data":"4979ef4909d5c31de526896a4c27be3636ea194ac5fc9f1807db5b7105988ea6"}
Jul 16 01:18:33.150436 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.150375    2578 scope.go:117] "RemoveContainer" containerID="c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71"
Jul 16 01:18:33.159927 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.159902    2578 scope.go:117] "RemoveContainer" containerID="868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"
Jul 16 01:18:33.168634 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.168618    2578 scope.go:117] "RemoveContainer" containerID="c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71"
Jul 16 01:18:33.168892 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:18:33.168875    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71\": container with ID starting with c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71 not found: ID does not exist" containerID="c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71"
Jul 16 01:18:33.168939 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.168901    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71"} err="failed to get container status \"c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71\": rpc error: code = NotFound desc = could not find container \"c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71\": container with ID starting with c89250e5119adc55770d1bbe031a1b31d71ac3d6e64c07985f1dde992065eb71 not found: ID does not exist"
Jul 16 01:18:33.168939 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.168916    2578 scope.go:117] "RemoveContainer" containerID="868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"
Jul 16 01:18:33.169117 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:18:33.169101    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da\": container with ID starting with 868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da not found: ID does not exist" containerID="868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"
Jul 16 01:18:33.169160 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.169121    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da"} err="failed to get container status \"868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da\": rpc error: code = NotFound desc = could not find container \"868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da\": container with ID starting with 868d41eafb55af07b26958c7e379ef73fda63a63c3ddd9842adfe07c87bea7da not found: ID does not exist"
Jul 16 01:18:33.174035 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.174014    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"]
Jul 16 01:18:33.182738 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.182717    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-640a35-openshift-default-7b7bfd9d7c-f4h7s"]
Jul 16 01:18:33.235107 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.235076    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.235107 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.235102    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.235280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.235117    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.235280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.235131    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz9gg\" (UniqueName: \"kubernetes.io/projected/fdc892ca-3323-48f5-a82f-555efb89e3ca-kube-api-access-hz9gg\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:33.235280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:33.235147    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc892ca-3323-48f5-a82f-555efb89e3ca-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:18:34.633765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:34.633725    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" path="/var/lib/kubelet/pods/fdc892ca-3323-48f5-a82f-555efb89e3ca/volumes"
Jul 16 01:18:37.338815 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.338463    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"]
Jul 16 01:18:37.342737 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.339396    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy"
Jul 16 01:18:37.342737 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.339439    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy"
Jul 16 01:18:37.342737 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.339460    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy"
Jul 16 01:18:37.342737 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.339469    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy"
Jul 16 01:18:37.342737 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.339628    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy"
Jul 16 01:18:37.342737 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.339667    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdc892ca-3323-48f5-a82f-555efb89e3ca" containerName="istio-proxy"
Jul 16 01:18:37.348825 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.348784    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.353179 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.353156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-edba78-openshift-default-dockercfg-8zpjw\""
Jul 16 01:18:37.363883 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.363740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"]
Jul 16 01:18:37.477203 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-envoy\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477203 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-data\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-istio-token\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-certs\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-socket\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477423 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2dbh\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-kube-api-access-w2dbh\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477551 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-credential-socket\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477551 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28cb5315-7629-45c6-916b-defceccd12bb-istio-podinfo\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.477551 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.477535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28cb5315-7629-45c6-916b-defceccd12bb-istiod-ca-cert\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579038 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-socket\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579038 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2dbh\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-kube-api-access-w2dbh\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-credential-socket\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28cb5315-7629-45c6-916b-defceccd12bb-istio-podinfo\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28cb5315-7629-45c6-916b-defceccd12bb-istiod-ca-cert\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-envoy\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-data\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-istio-token\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579281 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-certs\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579637 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-socket\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579741 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-credential-socket\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579741 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-data\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.579897 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.579860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-certs\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.580164 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.580148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28cb5315-7629-45c6-916b-defceccd12bb-istiod-ca-cert\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.581577 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.581553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28cb5315-7629-45c6-916b-defceccd12bb-istio-podinfo\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.581744 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.581726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-envoy\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.587590 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.587566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-istio-token\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.587675 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.587639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2dbh\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-kube-api-access-w2dbh\") pod \"e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") " pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.665722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.665642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:37.847490 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.847387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"]
Jul 16 01:18:37.860813 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:18:37.860086    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cb5315_7629_45c6_916b_defceccd12bb.slice/crio-dbf495bc15f4cb681c32cfb7db8a5831bb98b7ed08830dd07fd843e791aeabc4 WatchSource:0}: Error finding container dbf495bc15f4cb681c32cfb7db8a5831bb98b7ed08830dd07fd843e791aeabc4: Status 404 returned error can't find the container with id dbf495bc15f4cb681c32cfb7db8a5831bb98b7ed08830dd07fd843e791aeabc4
Jul 16 01:18:37.861941 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.861900    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:37.862037 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.861990    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:37.862037 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:37.862030    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:38.187024 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:38.186920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" event={"ID":"28cb5315-7629-45c6-916b-defceccd12bb","Type":"ContainerStarted","Data":"ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"}
Jul 16 01:18:38.187024 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:38.186981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" event={"ID":"28cb5315-7629-45c6-916b-defceccd12bb","Type":"ContainerStarted","Data":"dbf495bc15f4cb681c32cfb7db8a5831bb98b7ed08830dd07fd843e791aeabc4"}
Jul 16 01:18:38.211827 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:38.211752    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" podStartSLOduration=1.2117340620000001 podStartE2EDuration="1.211734062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:18:38.210893215 +0000 UTC m=+2060.133717104" watchObservedRunningTime="2026-07-16 01:18:38.211734062 +0000 UTC m=+2060.134557930"
Jul 16 01:18:38.666076 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:38.666045    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:38.671270 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:38.671240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:39.193347 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:39.193310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:39.194342 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:39.194319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:44.221705 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:44.221670    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerID="eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d" exitCode=0
Jul 16 01:18:44.222158 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:44.221745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" event={"ID":"5fe3b630-3ffc-4381-9775-6a8d6d5f5405","Type":"ContainerDied","Data":"eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"}
Jul 16 01:18:44.222202 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:44.222167    2578 scope.go:117] "RemoveContainer" containerID="eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"
Jul 16 01:18:44.223184 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:44.223158    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:44.223248 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:44.223235    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:44.223285 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:44.223270    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:45.230476 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:45.230430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" event={"ID":"5fe3b630-3ffc-4381-9775-6a8d6d5f5405","Type":"ContainerStarted","Data":"025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56"}
Jul 16 01:18:46.003682 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:46.003652    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:46.004651 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:46.004626    2578 patch_prober.go:28] interesting pod/e2e-api-a-314e69-openshift-default-69675d5c87-677k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 01:18:46.004775 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:46.004672    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 01:18:46.138173 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:46.138128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:47.003684 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:47.003642    2578 patch_prober.go:28] interesting pod/e2e-api-a-314e69-openshift-default-69675d5c87-677k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 01:18:47.004171 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:47.003699    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 01:18:48.003574 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:48.003541    2578 patch_prober.go:28] interesting pod/e2e-api-a-314e69-openshift-default-69675d5c87-677k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 01:18:48.003760 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:48.003606    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 01:18:49.003119 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:49.003086    2578 patch_prober.go:28] interesting pod/e2e-api-a-314e69-openshift-default-69675d5c87-677k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 01:18:49.003317 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:49.003146    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 01:18:50.007321 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:50.007284    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:50.008329 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:50.008306    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:18:52.282339 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:52.282308    2578 generic.go:356] "Generic (PLEG): container finished" podID="28cb5315-7629-45c6-916b-defceccd12bb" containerID="ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30" exitCode=0
Jul 16 01:18:52.282744 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:52.282382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" event={"ID":"28cb5315-7629-45c6-916b-defceccd12bb","Type":"ContainerDied","Data":"ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"}
Jul 16 01:18:52.282843 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:52.282828    2578 scope.go:117] "RemoveContainer" containerID="ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"
Jul 16 01:18:52.283783 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:52.283756    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:52.283853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:52.283839    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:52.283892 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:52.283875    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:18:53.290094 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:53.290062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" event={"ID":"28cb5315-7629-45c6-916b-defceccd12bb","Type":"ContainerStarted","Data":"8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58"}
Jul 16 01:18:53.666149 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:53.666053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:53.667328 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:53.667300    2578 patch_prober.go:28] interesting pod/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 01:18:53.667451 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:53.667352    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 01:18:54.194251 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:54.194224    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:54.666840 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:54.666769    2578 patch_prober.go:28] interesting pod/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 01:18:54.667237 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:54.666867    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 01:18:55.666982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:55.666947    2578 patch_prober.go:28] interesting pod/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 01:18:55.667456 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:55.667008    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 01:18:56.666758 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:56.666720    2578 patch_prober.go:28] interesting pod/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 01:18:56.666964 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:56.666785    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 01:18:57.670679 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:57.670645    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:18:57.671849 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:18:57.671827    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:19:05.295003 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:05.294969    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"]
Jul 16 01:19:05.295556 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:05.295221    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy" containerID="cri-o://025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56" gracePeriod=30
Jul 16 01:19:10.553617 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.553589    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:19:10.713482 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc8jf\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-kube-api-access-mc8jf\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713482 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713446    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istiod-ca-cert\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713510    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-envoy\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-podinfo\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-socket\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-data\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-token\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713688    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-certs\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.713722 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713722    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-credential-socket\") pod \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\" (UID: \"5fe3b630-3ffc-4381-9775-6a8d6d5f5405\") "
Jul 16 01:19:10.714133 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.713940    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:19:10.714219 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.714184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:10.714431 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.714196    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.714431 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.714393    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:10.714637 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.714607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:10.715011 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.714989    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:10.716064 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.716043    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:19:10.716170 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.716133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-kube-api-access-mc8jf" (OuterVolumeSpecName: "kube-api-access-mc8jf") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "kube-api-access-mc8jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:19:10.716231 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.716200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:10.716417 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.716401    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fe3b630-3ffc-4381-9775-6a8d6d5f5405" (UID: "5fe3b630-3ffc-4381-9775-6a8d6d5f5405"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:19:10.815301 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815274    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815301 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815301    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815315    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc8jf\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-kube-api-access-mc8jf\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815327    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815340    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815350    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815361    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:10.815510 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:10.815372    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fe3b630-3ffc-4381-9775-6a8d6d5f5405-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:11.394037 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.394000    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerID="025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56" exitCode=0
Jul 16 01:19:11.394245 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.394062    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"
Jul 16 01:19:11.394245 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.394082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" event={"ID":"5fe3b630-3ffc-4381-9775-6a8d6d5f5405","Type":"ContainerDied","Data":"025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56"}
Jul 16 01:19:11.394245 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.394138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5" event={"ID":"5fe3b630-3ffc-4381-9775-6a8d6d5f5405","Type":"ContainerDied","Data":"8877e90b284594ab9e8e507ec18a282df5493c9d7c40bedab25aadb23fbab59c"}
Jul 16 01:19:11.394245 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.394166    2578 scope.go:117] "RemoveContainer" containerID="025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56"
Jul 16 01:19:11.404350 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.404331    2578 scope.go:117] "RemoveContainer" containerID="eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"
Jul 16 01:19:11.414097 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.413910    2578 scope.go:117] "RemoveContainer" containerID="025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56"
Jul 16 01:19:11.414250 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:19:11.414229    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56\": container with ID starting with 025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56 not found: ID does not exist" containerID="025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56"
Jul 16 01:19:11.414309 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.414260    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56"} err="failed to get container status \"025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56\": rpc error: code = NotFound desc = could not find container \"025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56\": container with ID starting with 025efb04b3706430842256e2aae8930fd4dcf41c43c60b2452d0b25153410d56 not found: ID does not exist"
Jul 16 01:19:11.414309 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.414276    2578 scope.go:117] "RemoveContainer" containerID="eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"
Jul 16 01:19:11.414567 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:19:11.414540    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d\": container with ID starting with eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d not found: ID does not exist" containerID="eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"
Jul 16 01:19:11.414661 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.414574    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d"} err="failed to get container status \"eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d\": rpc error: code = NotFound desc = could not find container \"eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d\": container with ID starting with eb9f9f93dda76f1f0b890d83d281dbbc011afe19849ab4273a9182f9984e6b7d not found: ID does not exist"
Jul 16 01:19:11.418364 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.418343    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"]
Jul 16 01:19:11.424855 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:11.424833    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-314e69-openshift-default-69675d5c87-677k5"]
Jul 16 01:19:12.632975 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:12.632938    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" path="/var/lib/kubelet/pods/5fe3b630-3ffc-4381-9775-6a8d6d5f5405/volumes"
Jul 16 01:19:18.169421 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:18.169387    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"]
Jul 16 01:19:18.169837 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:18.169595    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy" containerID="cri-o://8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58" gracePeriod=30
Jul 16 01:19:18.686861 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:18.686829    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:19:18.690369 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:18.690347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:19:18.699244 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:18.699223    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:19:18.702357 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:18.702339    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:19:19.060332 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060298    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"]
Jul 16 01:19:19.060727 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060713    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy"
Jul 16 01:19:19.060774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060729    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy"
Jul 16 01:19:19.060774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060748    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy"
Jul 16 01:19:19.060774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060756    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy"
Jul 16 01:19:19.060894 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060850    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy"
Jul 16 01:19:19.060894 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.060860    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe3b630-3ffc-4381-9775-6a8d6d5f5405" containerName="istio-proxy"
Jul 16 01:19:19.064183 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.064165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.067007 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.066986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-44361b-openshift-default-dockercfg-b2k2n\""
Jul 16 01:19:19.083087 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.083064    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"]
Jul 16 01:19:19.193233 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istiod-ca-cert\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-token\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-certs\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-socket\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrt6\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-kube-api-access-rtrt6\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-envoy\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-podinfo\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.193702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-credential-socket\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.194018 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.193708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-data\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.294843 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.294779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istiod-ca-cert\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295013 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.294921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-token\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295013 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.294943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-certs\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295013 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.294975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-socket\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295188 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrt6\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-kube-api-access-rtrt6\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295188 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-envoy\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295188 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-podinfo\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295188 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-credential-socket\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295188 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-data\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295442 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-certs\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295489 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-socket\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295570 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istiod-ca-cert\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295628 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-data\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.295628 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.295619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-credential-socket\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.297462 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.297441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-envoy\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.297623 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.297608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-podinfo\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.303863 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.303843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-token\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.304404 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.304382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrt6\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-kube-api-access-rtrt6\") pod \"e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") " pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.374338 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.374270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:19.537128 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.537066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"]
Jul 16 01:19:19.537264 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:19:19.537242    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a32fef_ad8a_4b1d_a19f_1a54b1b2349a.slice/crio-863db8318fb3b979c47248bff869e583a72c5805ac9025dde979e3af16ec6a8b WatchSource:0}: Error finding container 863db8318fb3b979c47248bff869e583a72c5805ac9025dde979e3af16ec6a8b: Status 404 returned error can't find the container with id 863db8318fb3b979c47248bff869e583a72c5805ac9025dde979e3af16ec6a8b
Jul 16 01:19:19.539928 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.539889    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:19.540028 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.539971    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:19.540028 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:19.540012    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:20.450669 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:20.450631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" event={"ID":"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a","Type":"ContainerStarted","Data":"97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"}
Jul 16 01:19:20.451113 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:20.450690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" event={"ID":"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a","Type":"ContainerStarted","Data":"863db8318fb3b979c47248bff869e583a72c5805ac9025dde979e3af16ec6a8b"}
Jul 16 01:19:20.473657 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:20.473614    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podStartSLOduration=1.4735989680000001 podStartE2EDuration="1.473598968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:19:20.4710722 +0000 UTC m=+2102.393896058" watchObservedRunningTime="2026-07-16 01:19:20.473598968 +0000 UTC m=+2102.396422834"
Jul 16 01:19:21.374986 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:21.374945    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:21.379858 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:21.379832    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:21.457540 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:21.457493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:21.458426 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:21.458408    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:23.417713 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.417688    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:19:23.470186 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.470111    2578 generic.go:356] "Generic (PLEG): container finished" podID="28cb5315-7629-45c6-916b-defceccd12bb" containerID="8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58" exitCode=0
Jul 16 01:19:23.470186 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.470151    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"
Jul 16 01:19:23.470359 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.470187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" event={"ID":"28cb5315-7629-45c6-916b-defceccd12bb","Type":"ContainerDied","Data":"8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58"}
Jul 16 01:19:23.470359 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.470238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt" event={"ID":"28cb5315-7629-45c6-916b-defceccd12bb","Type":"ContainerDied","Data":"dbf495bc15f4cb681c32cfb7db8a5831bb98b7ed08830dd07fd843e791aeabc4"}
Jul 16 01:19:23.470359 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.470262    2578 scope.go:117] "RemoveContainer" containerID="8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58"
Jul 16 01:19:23.481463 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.481409    2578 scope.go:117] "RemoveContainer" containerID="ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"
Jul 16 01:19:23.490028 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.490013    2578 scope.go:117] "RemoveContainer" containerID="8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58"
Jul 16 01:19:23.490295 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:19:23.490277    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58\": container with ID starting with 8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58 not found: ID does not exist" containerID="8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58"
Jul 16 01:19:23.490346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.490303    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58"} err="failed to get container status \"8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58\": rpc error: code = NotFound desc = could not find container \"8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58\": container with ID starting with 8844482e94b8e9b2c8ca5d7089e2553337d9ece655ace3054c82cd95f80dbc58 not found: ID does not exist"
Jul 16 01:19:23.490346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.490319    2578 scope.go:117] "RemoveContainer" containerID="ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"
Jul 16 01:19:23.490553 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:19:23.490537    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30\": container with ID starting with ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30 not found: ID does not exist" containerID="ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"
Jul 16 01:19:23.490598 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.490560    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30"} err="failed to get container status \"ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30\": rpc error: code = NotFound desc = could not find container \"ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30\": container with ID starting with ebf2dba47dcef41fc0147257c773ad20574d6814651bed3ad0f6a8363ed56a30 not found: ID does not exist"
Jul 16 01:19:23.536531 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536504    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-socket\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536647 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-credential-socket\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536647 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28cb5315-7629-45c6-916b-defceccd12bb-istiod-ca-cert\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-data\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536693    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-envoy\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536722    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28cb5315-7629-45c6-916b-defceccd12bb-istio-podinfo\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-istio-token\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536989 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536773    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-certs\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.536989 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:23.536989 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.536828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2dbh\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-kube-api-access-w2dbh\") pod \"28cb5315-7629-45c6-916b-defceccd12bb\" (UID: \"28cb5315-7629-45c6-916b-defceccd12bb\") "
Jul 16 01:19:23.537235 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.537199    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.537330 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.537308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:23.537855 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.537828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:23.538014 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.537992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28cb5315-7629-45c6-916b-defceccd12bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:19:23.538101 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.538051    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:23.539279 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.539249    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28cb5315-7629-45c6-916b-defceccd12bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:19:23.539377 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.539308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-kube-api-access-w2dbh" (OuterVolumeSpecName: "kube-api-access-w2dbh") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "kube-api-access-w2dbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:19:23.539377 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.539322    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:19:23.539377 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.539336    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28cb5315-7629-45c6-916b-defceccd12bb" (UID: "28cb5315-7629-45c6-916b-defceccd12bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:19:23.638922 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638886    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.638922 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638919    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28cb5315-7629-45c6-916b-defceccd12bb-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.639114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638933    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.639114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638946    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.639114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638958    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28cb5315-7629-45c6-916b-defceccd12bb-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.639114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638972    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.639114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.638986    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28cb5315-7629-45c6-916b-defceccd12bb-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.639114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.639008    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2dbh\" (UniqueName: \"kubernetes.io/projected/28cb5315-7629-45c6-916b-defceccd12bb-kube-api-access-w2dbh\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:19:23.793755 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.793724    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"]
Jul 16 01:19:23.797749 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:23.797727    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-edba78-openshift-default-8c8865bf9-cftnt"]
Jul 16 01:19:24.634088 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:24.634053    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28cb5315-7629-45c6-916b-defceccd12bb" path="/var/lib/kubelet/pods/28cb5315-7629-45c6-916b-defceccd12bb/volumes"
Jul 16 01:19:27.518192 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"]
Jul 16 01:19:27.518766 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518736    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy"
Jul 16 01:19:27.518766 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518762    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy"
Jul 16 01:19:27.518982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518819    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy"
Jul 16 01:19:27.518982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518829    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy"
Jul 16 01:19:27.518982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518941    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy"
Jul 16 01:19:27.518982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.518955    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="28cb5315-7629-45c6-916b-defceccd12bb" containerName="istio-proxy"
Jul 16 01:19:27.522042 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.522023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.524310 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.524290    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-908f0c-openshift-default-dockercfg-985bb\""
Jul 16 01:19:27.542030 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.542000    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"]
Jul 16 01:19:27.572534 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-envoy\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572671 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-data\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572671 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istiod-ca-cert\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572824 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-certs\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572824 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvl7m\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-kube-api-access-mvl7m\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572824 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-credential-socket\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572824 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-token\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.572824 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-podinfo\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.573088 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.572852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-socket\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673409 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istiod-ca-cert\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673605 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-certs\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673605 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvl7m\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-kube-api-access-mvl7m\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673605 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-credential-socket\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673605 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-token\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673605 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-podinfo\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673995 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-socket\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673995 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-envoy\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673995 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-data\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.673995 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.673873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-certs\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.674219 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.674174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-socket\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.674280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.674215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-data\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.674280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.674250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istiod-ca-cert\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.674280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.674263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-credential-socket\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.675998 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.675982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-envoy\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.676102 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.676084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-podinfo\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.689218 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.689190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvl7m\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-kube-api-access-mvl7m\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.689741 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.689724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-token\") pod \"e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") " pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.833267 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.833185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:27.982150 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.982126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"]
Jul 16 01:19:27.984465 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:19:27.984438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf117d26_6d31_4d61_ab7b_d272c1ef5552.slice/crio-13e3a192f37d199865d3ab25918d30dd0ec6a8bd7cf63e6b362866b001cca11d WatchSource:0}: Error finding container 13e3a192f37d199865d3ab25918d30dd0ec6a8bd7cf63e6b362866b001cca11d: Status 404 returned error can't find the container with id 13e3a192f37d199865d3ab25918d30dd0ec6a8bd7cf63e6b362866b001cca11d
Jul 16 01:19:27.986556 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.986521    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:27.986650 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.986591    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:27.986650 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:27.986623    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:28.501613 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:28.501575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" event={"ID":"cf117d26-6d31-4d61-ab7b-d272c1ef5552","Type":"ContainerStarted","Data":"57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"}
Jul 16 01:19:28.501819 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:28.501640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" event={"ID":"cf117d26-6d31-4d61-ab7b-d272c1ef5552","Type":"ContainerStarted","Data":"13e3a192f37d199865d3ab25918d30dd0ec6a8bd7cf63e6b362866b001cca11d"}
Jul 16 01:19:28.530726 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:28.530667    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podStartSLOduration=1.530645243 podStartE2EDuration="1.530645243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:19:28.528600338 +0000 UTC m=+2110.451424205" watchObservedRunningTime="2026-07-16 01:19:28.530645243 +0000 UTC m=+2110.453469112"
Jul 16 01:19:28.833279 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:28.833241    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:29.839954 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:29.839916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:30.516114 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:30.516079    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:30.517619 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:30.517590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:39.579185 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:39.579152    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerID="97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee" exitCode=0
Jul 16 01:19:39.579649 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:39.579230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" event={"ID":"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a","Type":"ContainerDied","Data":"97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"}
Jul 16 01:19:39.579765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:39.579748    2578 scope.go:117] "RemoveContainer" containerID="97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"
Jul 16 01:19:39.580848 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:39.580819    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:39.580924 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:39.580904    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:39.580962 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:39.580952    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:40.590647 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:40.590599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" event={"ID":"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a","Type":"ContainerStarted","Data":"fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431"}
Jul 16 01:19:41.374906 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:41.374869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:41.375131 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:41.375104    2578 patch_prober.go:28] interesting pod/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 16 01:19:41.375500 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:41.375187    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 16 01:19:42.375059 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:42.375021    2578 patch_prober.go:28] interesting pod/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 16 01:19:42.375452 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:42.375095    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 16 01:19:43.375214 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:43.375169    2578 patch_prober.go:28] interesting pod/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 16 01:19:43.375885 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:43.375846    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 16 01:19:44.383817 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:44.380418    2578 patch_prober.go:28] interesting pod/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 16 01:19:44.383817 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:44.380499    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 16 01:19:45.379007 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:45.378978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:45.379347 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:45.379325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:45.380053 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:45.380035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:19:49.646410 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.646335    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerID="57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4" exitCode=0
Jul 16 01:19:49.646822 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.646415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" event={"ID":"cf117d26-6d31-4d61-ab7b-d272c1ef5552","Type":"ContainerDied","Data":"57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"}
Jul 16 01:19:49.646896 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.646878    2578 scope.go:117] "RemoveContainer" containerID="57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"
Jul 16 01:19:49.647926 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.647898    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:49.647999 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.647981    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:49.648048 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.648031    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 01:19:49.701360 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.701330    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"]
Jul 16 01:19:49.705593 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.705570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.708483 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.708464    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"kube-root-ca.crt\""
Jul 16 01:19:49.708734 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.708710    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"default-dockercfg-2sw78\""
Jul 16 01:19:49.709207 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.708562    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"openshift-service-ca.crt\""
Jul 16 01:19:49.709207 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.708591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"auth-test-model-44361b-kserve-self-signed-certs\""
Jul 16 01:19:49.714276 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.714247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"]
Jul 16 01:19:49.807638 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.807601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tmp-dir\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.807853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.807708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-model-cache\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.807853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.807749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-home\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.807853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.807811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-dshm\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.808042 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.807858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9ks\" (UniqueName: \"kubernetes.io/projected/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-kube-api-access-bw9ks\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.808042 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.807907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tls-certs\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.908619 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.908583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9ks\" (UniqueName: \"kubernetes.io/projected/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-kube-api-access-bw9ks\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.908832 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.908629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tls-certs\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.908832 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.908692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tmp-dir\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.908832 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.908742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-model-cache\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.908832 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.908782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-home\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.909022 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.908851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-dshm\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.909236 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.909211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tmp-dir\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.909236 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.909226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-model-cache\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.909410 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.909388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-home\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.911216 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.911193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tls-certs\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.911350 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.911330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-dshm\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:49.923311 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:49.923285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9ks\" (UniqueName: \"kubernetes.io/projected/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-kube-api-access-bw9ks\") pod \"auth-test-model-44361b-kserve-5c456cbc95-tglbs\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") " pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:50.021708 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.021680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:19:50.177424 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.177394    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"]
Jul 16 01:19:50.178803 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:19:50.178757    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dd62629_40cf_4f19_ba61_9a9dfabeddf5.slice/crio-7a92da21ddaebe9df531b9df5d591a143b692707f9f5762a2df6b2971eac455c WatchSource:0}: Error finding container 7a92da21ddaebe9df531b9df5d591a143b692707f9f5762a2df6b2971eac455c: Status 404 returned error can't find the container with id 7a92da21ddaebe9df531b9df5d591a143b692707f9f5762a2df6b2971eac455c
Jul 16 01:19:50.654921 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.654880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" event={"ID":"cf117d26-6d31-4d61-ab7b-d272c1ef5552","Type":"ContainerStarted","Data":"4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06"}
Jul 16 01:19:50.659979 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.659947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs" event={"ID":"6dd62629-40cf-4f19-ba61-9a9dfabeddf5","Type":"ContainerStarted","Data":"6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094"}
Jul 16 01:19:50.660110 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.659986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs" event={"ID":"6dd62629-40cf-4f19-ba61-9a9dfabeddf5","Type":"ContainerStarted","Data":"7a92da21ddaebe9df531b9df5d591a143b692707f9f5762a2df6b2971eac455c"}
Jul 16 01:19:50.695425 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.695377    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs" podStartSLOduration=1.69536193 podStartE2EDuration="1.69536193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:19:50.693349851 +0000 UTC m=+2132.616173719" watchObservedRunningTime="2026-07-16 01:19:50.69536193 +0000 UTC m=+2132.618185796"
Jul 16 01:19:50.833764 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.833727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:50.833971 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.833940    2578 patch_prober.go:28] interesting pod/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 16 01:19:50.834053 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:50.833996    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 16 01:19:51.835852 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:51.835386    2578 patch_prober.go:28] interesting pod/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 16 01:19:51.835852 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:51.835443    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 16 01:19:52.834214 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:52.834178    2578 patch_prober.go:28] interesting pod/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 16 01:19:52.834533 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:52.834504    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 16 01:19:53.834508 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:53.834467    2578 patch_prober.go:28] interesting pod/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 16 01:19:53.835121 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:53.835087    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 16 01:19:54.834707 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:54.834661    2578 patch_prober.go:28] interesting pod/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 16 01:19:54.835238 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:54.834741    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 16 01:19:55.838371 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:55.838339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:55.838845 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:55.838643    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:19:55.839318 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:19:55.839301    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:20:00.022745 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:00.022710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:20:00.023193 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:00.022918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:20:00.039204 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:00.039176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:20:00.727103 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:00.727077    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:20:19.296331 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.296296    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"]
Jul 16 01:20:19.300342 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.300320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.302871 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.302851    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"kube-root-ca.crt\""
Jul 16 01:20:19.303700 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.303677    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"default-dockercfg-vnn7l\""
Jul 16 01:20:19.303860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.303717    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"auth-test-model-908f0c-kserve-self-signed-certs\""
Jul 16 01:20:19.303943 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.303876    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"openshift-service-ca.crt\""
Jul 16 01:20:19.309590 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.309572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"]
Jul 16 01:20:19.402623 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.402585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682504d7-24e0-4df6-988b-3b227a591d9e-tls-certs\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.402906 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.402631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-tmp-dir\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.402906 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.402757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-dshm\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.402906 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.402783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvrsw\" (UniqueName: \"kubernetes.io/projected/682504d7-24e0-4df6-988b-3b227a591d9e-kube-api-access-nvrsw\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.402906 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.402882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-home\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.403098 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.402943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-model-cache\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.503988 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.503946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-dshm\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.503988 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.503987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvrsw\" (UniqueName: \"kubernetes.io/projected/682504d7-24e0-4df6-988b-3b227a591d9e-kube-api-access-nvrsw\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504254 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-home\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504254 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-model-cache\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504254 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682504d7-24e0-4df6-988b-3b227a591d9e-tls-certs\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504254 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-tmp-dir\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504562 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-model-cache\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504704 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-home\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.504704 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.504578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-tmp-dir\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.506235 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.506217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-dshm\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.506499 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.506482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682504d7-24e0-4df6-988b-3b227a591d9e-tls-certs\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.515871 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.515847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvrsw\" (UniqueName: \"kubernetes.io/projected/682504d7-24e0-4df6-988b-3b227a591d9e-kube-api-access-nvrsw\") pod \"auth-test-model-908f0c-kserve-664b989f95-dcb8j\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") " pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.612093 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.612013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:19.756604 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.756576    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"]
Jul 16 01:20:19.758656 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:20:19.758627    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod682504d7_24e0_4df6_988b_3b227a591d9e.slice/crio-5a9d83fd0fb8089f292942e5efa1a3217422d6d1ad243f2468ee9b6238d88bb0 WatchSource:0}: Error finding container 5a9d83fd0fb8089f292942e5efa1a3217422d6d1ad243f2468ee9b6238d88bb0: Status 404 returned error can't find the container with id 5a9d83fd0fb8089f292942e5efa1a3217422d6d1ad243f2468ee9b6238d88bb0
Jul 16 01:20:19.830702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.830648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j" event={"ID":"682504d7-24e0-4df6-988b-3b227a591d9e","Type":"ContainerStarted","Data":"1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921"}
Jul 16 01:20:19.830702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.830697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j" event={"ID":"682504d7-24e0-4df6-988b-3b227a591d9e","Type":"ContainerStarted","Data":"5a9d83fd0fb8089f292942e5efa1a3217422d6d1ad243f2468ee9b6238d88bb0"}
Jul 16 01:20:19.851624 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:19.851574    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j" podStartSLOduration=0.851557429 podStartE2EDuration="851.557429ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:20:19.849580205 +0000 UTC m=+2161.772404066" watchObservedRunningTime="2026-07-16 01:20:19.851557429 +0000 UTC m=+2161.774381296"
Jul 16 01:20:29.612765 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:29.612726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:29.613183 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:29.612808    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:29.625532 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:29.625510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:20:29.901032 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:20:29.900956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:22:29.647811 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:29.647764    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"]
Jul 16 01:22:30.670934 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:30.670894    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"]
Jul 16 01:22:44.668643 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:44.668606    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs" podUID="6dd62629-40cf-4f19-ba61-9a9dfabeddf5" containerName="main" containerID="cri-o://6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094" gracePeriod=45
Jul 16 01:22:44.927486 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:44.927431    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:22:45.019590 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tmp-dir\") pod \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") "
Jul 16 01:22:45.019777 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw9ks\" (UniqueName: \"kubernetes.io/projected/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-kube-api-access-bw9ks\") pod \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") "
Jul 16 01:22:45.019777 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019713    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-home\") pod \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") "
Jul 16 01:22:45.019777 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-model-cache\") pod \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") "
Jul 16 01:22:45.019777 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tls-certs\") pod \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") "
Jul 16 01:22:45.020031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019810    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6dd62629-40cf-4f19-ba61-9a9dfabeddf5" (UID: "6dd62629-40cf-4f19-ba61-9a9dfabeddf5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:45.020031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.019842    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-dshm\") pod \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\" (UID: \"6dd62629-40cf-4f19-ba61-9a9dfabeddf5\") "
Jul 16 01:22:45.020031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.020007    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-home" (OuterVolumeSpecName: "home") pod "6dd62629-40cf-4f19-ba61-9a9dfabeddf5" (UID: "6dd62629-40cf-4f19-ba61-9a9dfabeddf5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:45.020153 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.020021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-model-cache" (OuterVolumeSpecName: "model-cache") pod "6dd62629-40cf-4f19-ba61-9a9dfabeddf5" (UID: "6dd62629-40cf-4f19-ba61-9a9dfabeddf5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:45.020189 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.020176    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:45.020224 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.020189    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:45.020224 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.020217    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:45.021975 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.021951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-dshm" (OuterVolumeSpecName: "dshm") pod "6dd62629-40cf-4f19-ba61-9a9dfabeddf5" (UID: "6dd62629-40cf-4f19-ba61-9a9dfabeddf5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:45.022215 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.022198    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6dd62629-40cf-4f19-ba61-9a9dfabeddf5" (UID: "6dd62629-40cf-4f19-ba61-9a9dfabeddf5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:22:45.022278 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.022201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-kube-api-access-bw9ks" (OuterVolumeSpecName: "kube-api-access-bw9ks") pod "6dd62629-40cf-4f19-ba61-9a9dfabeddf5" (UID: "6dd62629-40cf-4f19-ba61-9a9dfabeddf5"). InnerVolumeSpecName "kube-api-access-bw9ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:22:45.121233 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.121189    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw9ks\" (UniqueName: \"kubernetes.io/projected/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-kube-api-access-bw9ks\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:45.121233 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.121227    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:45.121233 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.121236    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dd62629-40cf-4f19-ba61-9a9dfabeddf5-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:45.660901 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.660864    2578 generic.go:356] "Generic (PLEG): container finished" podID="6dd62629-40cf-4f19-ba61-9a9dfabeddf5" containerID="6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094" exitCode=0
Jul 16 01:22:45.660901 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.660899    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"
Jul 16 01:22:45.661150 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.660943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs" event={"ID":"6dd62629-40cf-4f19-ba61-9a9dfabeddf5","Type":"ContainerDied","Data":"6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094"}
Jul 16 01:22:45.661150 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.660981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs" event={"ID":"6dd62629-40cf-4f19-ba61-9a9dfabeddf5","Type":"ContainerDied","Data":"7a92da21ddaebe9df531b9df5d591a143b692707f9f5762a2df6b2971eac455c"}
Jul 16 01:22:45.661150 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.660997    2578 scope.go:117] "RemoveContainer" containerID="6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094"
Jul 16 01:22:45.670670 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.670478    2578 scope.go:117] "RemoveContainer" containerID="6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094"
Jul 16 01:22:45.670946 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:22:45.670726    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094\": container with ID starting with 6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094 not found: ID does not exist" containerID="6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094"
Jul 16 01:22:45.670946 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.670747    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094"} err="failed to get container status \"6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094\": rpc error: code = NotFound desc = could not find container \"6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094\": container with ID starting with 6b1d4b4e65e35c804ddadc8e34109d4f594bfd257679f6bdb904f350e29db094 not found: ID does not exist"
Jul 16 01:22:45.682844 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.682818    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"]
Jul 16 01:22:45.689880 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.689861    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/auth-test-model-44361b-kserve-5c456cbc95-tglbs"]
Jul 16 01:22:45.692893 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.692870    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j" podUID="682504d7-24e0-4df6-988b-3b227a591d9e" containerName="main" containerID="cri-o://1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921" gracePeriod=45
Jul 16 01:22:45.956702 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:45.956679    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:22:46.028134 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682504d7-24e0-4df6-988b-3b227a591d9e-tls-certs\") pod \"682504d7-24e0-4df6-988b-3b227a591d9e\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") "
Jul 16 01:22:46.028302 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-home\") pod \"682504d7-24e0-4df6-988b-3b227a591d9e\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") "
Jul 16 01:22:46.028302 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-dshm\") pod \"682504d7-24e0-4df6-988b-3b227a591d9e\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") "
Jul 16 01:22:46.028302 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028270    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-tmp-dir\") pod \"682504d7-24e0-4df6-988b-3b227a591d9e\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") "
Jul 16 01:22:46.028476 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028364    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-model-cache\") pod \"682504d7-24e0-4df6-988b-3b227a591d9e\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") "
Jul 16 01:22:46.028476 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvrsw\" (UniqueName: \"kubernetes.io/projected/682504d7-24e0-4df6-988b-3b227a591d9e-kube-api-access-nvrsw\") pod \"682504d7-24e0-4df6-988b-3b227a591d9e\" (UID: \"682504d7-24e0-4df6-988b-3b227a591d9e\") "
Jul 16 01:22:46.028476 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028457    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-home" (OuterVolumeSpecName: "home") pod "682504d7-24e0-4df6-988b-3b227a591d9e" (UID: "682504d7-24e0-4df6-988b-3b227a591d9e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:46.028642 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028602    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "682504d7-24e0-4df6-988b-3b227a591d9e" (UID: "682504d7-24e0-4df6-988b-3b227a591d9e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:46.028642 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028624    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-model-cache" (OuterVolumeSpecName: "model-cache") pod "682504d7-24e0-4df6-988b-3b227a591d9e" (UID: "682504d7-24e0-4df6-988b-3b227a591d9e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:46.028746 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028731    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:46.028784 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028747    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:46.028784 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.028756    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:46.030470 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.030443    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-dshm" (OuterVolumeSpecName: "dshm") pod "682504d7-24e0-4df6-988b-3b227a591d9e" (UID: "682504d7-24e0-4df6-988b-3b227a591d9e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:22:46.030590 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.030576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/682504d7-24e0-4df6-988b-3b227a591d9e-kube-api-access-nvrsw" (OuterVolumeSpecName: "kube-api-access-nvrsw") pod "682504d7-24e0-4df6-988b-3b227a591d9e" (UID: "682504d7-24e0-4df6-988b-3b227a591d9e"). InnerVolumeSpecName "kube-api-access-nvrsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:22:46.030640 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.030607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/682504d7-24e0-4df6-988b-3b227a591d9e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "682504d7-24e0-4df6-988b-3b227a591d9e" (UID: "682504d7-24e0-4df6-988b-3b227a591d9e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:22:46.130050 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.130020    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvrsw\" (UniqueName: \"kubernetes.io/projected/682504d7-24e0-4df6-988b-3b227a591d9e-kube-api-access-nvrsw\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:46.130050 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.130046    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682504d7-24e0-4df6-988b-3b227a591d9e-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:46.130050 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.130055    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682504d7-24e0-4df6-988b-3b227a591d9e-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:22:46.633875 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.633840    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd62629-40cf-4f19-ba61-9a9dfabeddf5" path="/var/lib/kubelet/pods/6dd62629-40cf-4f19-ba61-9a9dfabeddf5/volumes"
Jul 16 01:22:46.667409 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.667380    2578 generic.go:356] "Generic (PLEG): container finished" podID="682504d7-24e0-4df6-988b-3b227a591d9e" containerID="1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921" exitCode=0
Jul 16 01:22:46.667550 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.667421    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"
Jul 16 01:22:46.667550 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.667466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j" event={"ID":"682504d7-24e0-4df6-988b-3b227a591d9e","Type":"ContainerDied","Data":"1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921"}
Jul 16 01:22:46.667550 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.667513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j" event={"ID":"682504d7-24e0-4df6-988b-3b227a591d9e","Type":"ContainerDied","Data":"5a9d83fd0fb8089f292942e5efa1a3217422d6d1ad243f2468ee9b6238d88bb0"}
Jul 16 01:22:46.667550 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.667539    2578 scope.go:117] "RemoveContainer" containerID="1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921"
Jul 16 01:22:46.676697 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.676511    2578 scope.go:117] "RemoveContainer" containerID="1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921"
Jul 16 01:22:46.676950 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:22:46.676772    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921\": container with ID starting with 1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921 not found: ID does not exist" containerID="1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921"
Jul 16 01:22:46.676950 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.676888    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921"} err="failed to get container status \"1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921\": rpc error: code = NotFound desc = could not find container \"1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921\": container with ID starting with 1a5b5689fa95dc1f5f4498c3517603a30cd1be60208ace95da6e76e2ebbac921 not found: ID does not exist"
Jul 16 01:22:46.685627 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.685605    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"]
Jul 16 01:22:46.689363 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.689346    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/auth-test-model-908f0c-kserve-664b989f95-dcb8j"]
Jul 16 01:22:46.802655 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.802627    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"]
Jul 16 01:22:46.803111 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.803093    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682504d7-24e0-4df6-988b-3b227a591d9e" containerName="main"
Jul 16 01:22:46.803111 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.803112    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="682504d7-24e0-4df6-988b-3b227a591d9e" containerName="main"
Jul 16 01:22:46.803298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.803144    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd62629-40cf-4f19-ba61-9a9dfabeddf5" containerName="main"
Jul 16 01:22:46.803298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.803154    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd62629-40cf-4f19-ba61-9a9dfabeddf5" containerName="main"
Jul 16 01:22:46.803298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.803253    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd62629-40cf-4f19-ba61-9a9dfabeddf5" containerName="main"
Jul 16 01:22:46.803298 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.803268    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="682504d7-24e0-4df6-988b-3b227a591d9e" containerName="main"
Jul 16 01:22:46.807898 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.807877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:46.810490 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.810468    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"openshift-service-ca.crt\""
Jul 16 01:22:46.810996 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.810977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"sub-test-model-44361b-kserve-self-signed-certs\""
Jul 16 01:22:46.811081 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.811031    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"default-dockercfg-2sw78\""
Jul 16 01:22:46.811081 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.811040    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"kube-root-ca.crt\""
Jul 16 01:22:46.818879 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.818859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"]
Jul 16 01:22:46.937833 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.937716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-tmp-dir\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:46.937833 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.937775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-home\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:46.938061 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.937914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97851364-431e-4ed3-9721-0d73dcac9637-tls-certs\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:46.938061 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.937972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5k4l\" (UniqueName: \"kubernetes.io/projected/97851364-431e-4ed3-9721-0d73dcac9637-kube-api-access-z5k4l\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:46.938061 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.938023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-dshm\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:46.938211 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:46.938057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-model-cache\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039193 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97851364-431e-4ed3-9721-0d73dcac9637-tls-certs\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5k4l\" (UniqueName: \"kubernetes.io/projected/97851364-431e-4ed3-9721-0d73dcac9637-kube-api-access-z5k4l\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-dshm\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-model-cache\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-tmp-dir\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-home\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039759 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-model-cache\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039885 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-tmp-dir\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.039885 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.039836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-home\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.041631 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.041606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-dshm\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.041971 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.041954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97851364-431e-4ed3-9721-0d73dcac9637-tls-certs\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.051556 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.051529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5k4l\" (UniqueName: \"kubernetes.io/projected/97851364-431e-4ed3-9721-0d73dcac9637-kube-api-access-z5k4l\") pod \"sub-test-model-44361b-kserve-77968b9467-fjrbj\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") " pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.117811 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.117767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:47.259871 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.259846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"]
Jul 16 01:22:47.262068 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:22:47.262037    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97851364_431e_4ed3_9721_0d73dcac9637.slice/crio-d2beb33ad0e544cbf8bd00d31fefc67fa67dce30151e8a08f83bf41721ce2fc3 WatchSource:0}: Error finding container d2beb33ad0e544cbf8bd00d31fefc67fa67dce30151e8a08f83bf41721ce2fc3: Status 404 returned error can't find the container with id d2beb33ad0e544cbf8bd00d31fefc67fa67dce30151e8a08f83bf41721ce2fc3
Jul 16 01:22:47.683088 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.683053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj" event={"ID":"97851364-431e-4ed3-9721-0d73dcac9637","Type":"ContainerStarted","Data":"03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa"}
Jul 16 01:22:47.683088 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.683093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj" event={"ID":"97851364-431e-4ed3-9721-0d73dcac9637","Type":"ContainerStarted","Data":"d2beb33ad0e544cbf8bd00d31fefc67fa67dce30151e8a08f83bf41721ce2fc3"}
Jul 16 01:22:47.703981 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:47.703932    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj" podStartSLOduration=1.703915615 podStartE2EDuration="1.703915615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:22:47.701036918 +0000 UTC m=+2309.623860785" watchObservedRunningTime="2026-07-16 01:22:47.703915615 +0000 UTC m=+2309.626739481"
Jul 16 01:22:48.634444 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:48.634401    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682504d7-24e0-4df6-988b-3b227a591d9e" path="/var/lib/kubelet/pods/682504d7-24e0-4df6-988b-3b227a591d9e/volumes"
Jul 16 01:22:57.118970 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:57.118935    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:57.119389 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:57.118991    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:57.131562 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:57.131541    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:22:57.751778 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:22:57.751753    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:23:28.079000 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.078966    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"]
Jul 16 01:23:28.082412 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.082396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.085602 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.085575    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"default-dockercfg-vnn7l\""
Jul 16 01:23:28.085738 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.085618    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"kube-root-ca.crt\""
Jul 16 01:23:28.085738 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.085657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"sub-test-model-908f0c-kserve-self-signed-certs\""
Jul 16 01:23:28.085738 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.085645    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"openshift-service-ca.crt\""
Jul 16 01:23:28.094990 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.094970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"]
Jul 16 01:23:28.132248 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.132205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-model-cache\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.132413 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.132249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v58rm\" (UniqueName: \"kubernetes.io/projected/34dc5b48-f571-424d-ac24-9cc99408a6ea-kube-api-access-v58rm\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.132413 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.132279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc5b48-f571-424d-ac24-9cc99408a6ea-tls-certs\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.132413 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.132402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-dshm\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.132601 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.132436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-tmp-dir\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.132601 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.132502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-home\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233310 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-model-cache\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233310 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v58rm\" (UniqueName: \"kubernetes.io/projected/34dc5b48-f571-424d-ac24-9cc99408a6ea-kube-api-access-v58rm\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233562 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc5b48-f571-424d-ac24-9cc99408a6ea-tls-certs\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233562 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-dshm\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233562 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-tmp-dir\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233562 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-home\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.233919 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.233893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-tmp-dir\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.234090 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.234063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-model-cache\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.234167 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.234101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-home\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.236159 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.236132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-dshm\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.236604 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.236578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc5b48-f571-424d-ac24-9cc99408a6ea-tls-certs\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.242618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.242590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v58rm\" (UniqueName: \"kubernetes.io/projected/34dc5b48-f571-424d-ac24-9cc99408a6ea-kube-api-access-v58rm\") pod \"sub-test-model-908f0c-kserve-56c4c575d7-jvhtw\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") " pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.392020 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.391941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:28.539008 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.538947    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"]
Jul 16 01:23:28.543120 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:23:28.543092    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34dc5b48_f571_424d_ac24_9cc99408a6ea.slice/crio-dfefddf0836b1aedf95fc0dcd2b87e679c7268e832ecb049768699fdc19fdb07 WatchSource:0}: Error finding container dfefddf0836b1aedf95fc0dcd2b87e679c7268e832ecb049768699fdc19fdb07: Status 404 returned error can't find the container with id dfefddf0836b1aedf95fc0dcd2b87e679c7268e832ecb049768699fdc19fdb07
Jul 16 01:23:28.916856 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.916812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw" event={"ID":"34dc5b48-f571-424d-ac24-9cc99408a6ea","Type":"ContainerStarted","Data":"4b101f03e0aeef21b640758cc38664450298b86d2ce1450e15a348e823dad7fe"}
Jul 16 01:23:28.917022 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.916868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw" event={"ID":"34dc5b48-f571-424d-ac24-9cc99408a6ea","Type":"ContainerStarted","Data":"dfefddf0836b1aedf95fc0dcd2b87e679c7268e832ecb049768699fdc19fdb07"}
Jul 16 01:23:28.938120 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:28.938076    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw" podStartSLOduration=0.93806174 podStartE2EDuration="938.06174ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:23:28.937989388 +0000 UTC m=+2350.860813271" watchObservedRunningTime="2026-07-16 01:23:28.93806174 +0000 UTC m=+2350.860885603"
Jul 16 01:23:38.392109 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:38.392079    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:38.392495 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:38.392128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:38.404552 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:38.404516    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:23:38.991352 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:23:38.991326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:24:18.734018 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:18.733991    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:24:18.737678 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:18.737654    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:24:18.744851 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:18.744832    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:24:18.748230 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:18.748214    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvzwt_e513803d-327c-4deb-973b-600531818aab/ovn-acl-logging/0.log"
Jul 16 01:24:22.267773 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:22.267743    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"]
Jul 16 01:24:23.100067 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:23.100031    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"]
Jul 16 01:24:37.287771 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.287703    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj" podUID="97851364-431e-4ed3-9721-0d73dcac9637" containerName="main" containerID="cri-o://03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa" gracePeriod=45
Jul 16 01:24:37.546755 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.546687    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:24:37.597368 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97851364-431e-4ed3-9721-0d73dcac9637-tls-certs\") pod \"97851364-431e-4ed3-9721-0d73dcac9637\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") "
Jul 16 01:24:37.597558 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597423    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-dshm\") pod \"97851364-431e-4ed3-9721-0d73dcac9637\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") "
Jul 16 01:24:37.597558 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-home\") pod \"97851364-431e-4ed3-9721-0d73dcac9637\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") "
Jul 16 01:24:37.597685 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-model-cache\") pod \"97851364-431e-4ed3-9721-0d73dcac9637\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") "
Jul 16 01:24:37.597685 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5k4l\" (UniqueName: \"kubernetes.io/projected/97851364-431e-4ed3-9721-0d73dcac9637-kube-api-access-z5k4l\") pod \"97851364-431e-4ed3-9721-0d73dcac9637\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") "
Jul 16 01:24:37.597825 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597717    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-tmp-dir\") pod \"97851364-431e-4ed3-9721-0d73dcac9637\" (UID: \"97851364-431e-4ed3-9721-0d73dcac9637\") "
Jul 16 01:24:37.597825 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597765    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-home" (OuterVolumeSpecName: "home") pod "97851364-431e-4ed3-9721-0d73dcac9637" (UID: "97851364-431e-4ed3-9721-0d73dcac9637"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:37.597937 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.597903    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-model-cache" (OuterVolumeSpecName: "model-cache") pod "97851364-431e-4ed3-9721-0d73dcac9637" (UID: "97851364-431e-4ed3-9721-0d73dcac9637"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:37.598028 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.598004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "97851364-431e-4ed3-9721-0d73dcac9637" (UID: "97851364-431e-4ed3-9721-0d73dcac9637"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:37.598196 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.598175    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:37.598284 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.598199    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:37.598284 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.598214    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:37.599530 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.599497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-dshm" (OuterVolumeSpecName: "dshm") pod "97851364-431e-4ed3-9721-0d73dcac9637" (UID: "97851364-431e-4ed3-9721-0d73dcac9637"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:37.599778 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.599744    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97851364-431e-4ed3-9721-0d73dcac9637-kube-api-access-z5k4l" (OuterVolumeSpecName: "kube-api-access-z5k4l") pod "97851364-431e-4ed3-9721-0d73dcac9637" (UID: "97851364-431e-4ed3-9721-0d73dcac9637"). InnerVolumeSpecName "kube-api-access-z5k4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:24:37.599885 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.599857    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97851364-431e-4ed3-9721-0d73dcac9637-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97851364-431e-4ed3-9721-0d73dcac9637" (UID: "97851364-431e-4ed3-9721-0d73dcac9637"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:24:37.699648 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.699614    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97851364-431e-4ed3-9721-0d73dcac9637-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:37.699648 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.699641    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97851364-431e-4ed3-9721-0d73dcac9637-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:37.699648 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:37.699650    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5k4l\" (UniqueName: \"kubernetes.io/projected/97851364-431e-4ed3-9721-0d73dcac9637-kube-api-access-z5k4l\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.120274 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.120214    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw" podUID="34dc5b48-f571-424d-ac24-9cc99408a6ea" containerName="main" containerID="cri-o://4b101f03e0aeef21b640758cc38664450298b86d2ce1450e15a348e823dad7fe" gracePeriod=45
Jul 16 01:24:38.341636 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.341602    2578 generic.go:356] "Generic (PLEG): container finished" podID="97851364-431e-4ed3-9721-0d73dcac9637" containerID="03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa" exitCode=0
Jul 16 01:24:38.342041 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.341644    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"
Jul 16 01:24:38.342041 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.341683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj" event={"ID":"97851364-431e-4ed3-9721-0d73dcac9637","Type":"ContainerDied","Data":"03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa"}
Jul 16 01:24:38.342041 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.341730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj" event={"ID":"97851364-431e-4ed3-9721-0d73dcac9637","Type":"ContainerDied","Data":"d2beb33ad0e544cbf8bd00d31fefc67fa67dce30151e8a08f83bf41721ce2fc3"}
Jul 16 01:24:38.342041 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.341751    2578 scope.go:117] "RemoveContainer" containerID="03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa"
Jul 16 01:24:38.343985 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.343962    2578 generic.go:356] "Generic (PLEG): container finished" podID="34dc5b48-f571-424d-ac24-9cc99408a6ea" containerID="4b101f03e0aeef21b640758cc38664450298b86d2ce1450e15a348e823dad7fe" exitCode=0
Jul 16 01:24:38.344105 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.343990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw" event={"ID":"34dc5b48-f571-424d-ac24-9cc99408a6ea","Type":"ContainerDied","Data":"4b101f03e0aeef21b640758cc38664450298b86d2ce1450e15a348e823dad7fe"}
Jul 16 01:24:38.352553 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.352530    2578 scope.go:117] "RemoveContainer" containerID="03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa"
Jul 16 01:24:38.352811 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:24:38.352780    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa\": container with ID starting with 03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa not found: ID does not exist" containerID="03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa"
Jul 16 01:24:38.352886 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.352818    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa"} err="failed to get container status \"03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa\": rpc error: code = NotFound desc = could not find container \"03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa\": container with ID starting with 03277b372c97e9b277a80d57671db5ff79d0bebebe00617ab10eeedfbf5d73aa not found: ID does not exist"
Jul 16 01:24:38.370202 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.370176    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"]
Jul 16 01:24:38.372595 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.372547    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/sub-test-model-44361b-kserve-77968b9467-fjrbj"]
Jul 16 01:24:38.383669 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.383644    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:24:38.406212 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-dshm\") pod \"34dc5b48-f571-424d-ac24-9cc99408a6ea\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") "
Jul 16 01:24:38.406331 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406316    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v58rm\" (UniqueName: \"kubernetes.io/projected/34dc5b48-f571-424d-ac24-9cc99408a6ea-kube-api-access-v58rm\") pod \"34dc5b48-f571-424d-ac24-9cc99408a6ea\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") "
Jul 16 01:24:38.406373 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-model-cache\") pod \"34dc5b48-f571-424d-ac24-9cc99408a6ea\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") "
Jul 16 01:24:38.406419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406386    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc5b48-f571-424d-ac24-9cc99408a6ea-tls-certs\") pod \"34dc5b48-f571-424d-ac24-9cc99408a6ea\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") "
Jul 16 01:24:38.406419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406411    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-home\") pod \"34dc5b48-f571-424d-ac24-9cc99408a6ea\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") "
Jul 16 01:24:38.406520 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406437    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-tmp-dir\") pod \"34dc5b48-f571-424d-ac24-9cc99408a6ea\" (UID: \"34dc5b48-f571-424d-ac24-9cc99408a6ea\") "
Jul 16 01:24:38.406635 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406613    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "34dc5b48-f571-424d-ac24-9cc99408a6ea" (UID: "34dc5b48-f571-424d-ac24-9cc99408a6ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:38.406819 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406777    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.406900 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406786    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-home" (OuterVolumeSpecName: "home") pod "34dc5b48-f571-424d-ac24-9cc99408a6ea" (UID: "34dc5b48-f571-424d-ac24-9cc99408a6ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:38.406900 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.406842    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34dc5b48-f571-424d-ac24-9cc99408a6ea" (UID: "34dc5b48-f571-424d-ac24-9cc99408a6ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:38.408558 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.408525    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34dc5b48-f571-424d-ac24-9cc99408a6ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34dc5b48-f571-424d-ac24-9cc99408a6ea" (UID: "34dc5b48-f571-424d-ac24-9cc99408a6ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:24:38.408682 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.408578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34dc5b48-f571-424d-ac24-9cc99408a6ea-kube-api-access-v58rm" (OuterVolumeSpecName: "kube-api-access-v58rm") pod "34dc5b48-f571-424d-ac24-9cc99408a6ea" (UID: "34dc5b48-f571-424d-ac24-9cc99408a6ea"). InnerVolumeSpecName "kube-api-access-v58rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:24:38.408774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.408751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-dshm" (OuterVolumeSpecName: "dshm") pod "34dc5b48-f571-424d-ac24-9cc99408a6ea" (UID: "34dc5b48-f571-424d-ac24-9cc99408a6ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:24:38.508132 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.508098    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.508132 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.508127    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v58rm\" (UniqueName: \"kubernetes.io/projected/34dc5b48-f571-424d-ac24-9cc99408a6ea-kube-api-access-v58rm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.508132 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.508136    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc5b48-f571-424d-ac24-9cc99408a6ea-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.508132 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.508143    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.508392 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.508151    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc5b48-f571-424d-ac24-9cc99408a6ea-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:24:38.634412 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:38.634330    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97851364-431e-4ed3-9721-0d73dcac9637" path="/var/lib/kubelet/pods/97851364-431e-4ed3-9721-0d73dcac9637/volumes"
Jul 16 01:24:39.351742 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:39.351712    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"
Jul 16 01:24:39.352189 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:39.351757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw" event={"ID":"34dc5b48-f571-424d-ac24-9cc99408a6ea","Type":"ContainerDied","Data":"dfefddf0836b1aedf95fc0dcd2b87e679c7268e832ecb049768699fdc19fdb07"}
Jul 16 01:24:39.352189 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:39.351816    2578 scope.go:117] "RemoveContainer" containerID="4b101f03e0aeef21b640758cc38664450298b86d2ce1450e15a348e823dad7fe"
Jul 16 01:24:39.370542 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:39.370518    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"]
Jul 16 01:24:39.374844 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:39.374822    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/sub-test-model-908f0c-kserve-56c4c575d7-jvhtw"]
Jul 16 01:24:40.633525 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:40.633424    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34dc5b48-f571-424d-ac24-9cc99408a6ea" path="/var/lib/kubelet/pods/34dc5b48-f571-424d-ac24-9cc99408a6ea/volumes"
Jul 16 01:24:43.292395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.292355    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"]
Jul 16 01:24:43.293065 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.292983    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97851364-431e-4ed3-9721-0d73dcac9637" containerName="main"
Jul 16 01:24:43.293065 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.293002    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="97851364-431e-4ed3-9721-0d73dcac9637" containerName="main"
Jul 16 01:24:43.293065 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.293014    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34dc5b48-f571-424d-ac24-9cc99408a6ea" containerName="main"
Jul 16 01:24:43.293065 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.293023    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34dc5b48-f571-424d-ac24-9cc99408a6ea" containerName="main"
Jul 16 01:24:43.293354 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.293122    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="97851364-431e-4ed3-9721-0d73dcac9637" containerName="main"
Jul 16 01:24:43.293354 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.293135    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34dc5b48-f571-424d-ac24-9cc99408a6ea" containerName="main"
Jul 16 01:24:43.297595 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.297576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.300130 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.300101    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"openshift-service-ca.crt\""
Jul 16 01:24:43.300253 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.300228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"default-dockercfg-2sw78\""
Jul 16 01:24:43.300853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.300831    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"kube-root-ca.crt\""
Jul 16 01:24:43.301033 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.301019    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44361b\"/\"rate-test-model-44361b-kserve-self-signed-certs\""
Jul 16 01:24:43.307920 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.307899    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"]
Jul 16 01:24:43.354066 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.354034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tmp-dir\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.354232 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.354076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-model-cache\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.354232 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.354104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-dshm\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.354232 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.354155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nllg4\" (UniqueName: \"kubernetes.io/projected/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-kube-api-access-nllg4\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.354232 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.354173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-home\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.354232 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.354201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tls-certs\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.455649 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.455616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tmp-dir\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.455849 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.455660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-model-cache\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.455849 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.455683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-dshm\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.455849 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.455830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllg4\" (UniqueName: \"kubernetes.io/projected/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-kube-api-access-nllg4\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.456009 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.455873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-home\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.456009 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.455916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tls-certs\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.456113 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.456036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-model-cache\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.456166 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.456131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tmp-dir\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.456215 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.456199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-home\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.457938 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.457918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-dshm\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.458416 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.458395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tls-certs\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.465620 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.465577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllg4\" (UniqueName: \"kubernetes.io/projected/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-kube-api-access-nllg4\") pod \"rate-test-model-44361b-kserve-5985c9848c-xx2mn\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") " pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.607937 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.607846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:43.751512 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:43.751485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"]
Jul 16 01:24:43.752937 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:24:43.752908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76b99a9e_9695_4e50_bf9e_f75776ae8c7a.slice/crio-17ed2d7c462593bf579fcad27e749357e7eaa2aab185dd9e604e4f9c5328b241 WatchSource:0}: Error finding container 17ed2d7c462593bf579fcad27e749357e7eaa2aab185dd9e604e4f9c5328b241: Status 404 returned error can't find the container with id 17ed2d7c462593bf579fcad27e749357e7eaa2aab185dd9e604e4f9c5328b241
Jul 16 01:24:44.381805 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:44.381757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn" event={"ID":"76b99a9e-9695-4e50-bf9e-f75776ae8c7a","Type":"ContainerStarted","Data":"ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60"}
Jul 16 01:24:44.382199 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:44.381821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn" event={"ID":"76b99a9e-9695-4e50-bf9e-f75776ae8c7a","Type":"ContainerStarted","Data":"17ed2d7c462593bf579fcad27e749357e7eaa2aab185dd9e604e4f9c5328b241"}
Jul 16 01:24:44.401338 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:44.401289    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn" podStartSLOduration=1.401274712 podStartE2EDuration="1.401274712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:24:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:24:44.39966109 +0000 UTC m=+2426.322484959" watchObservedRunningTime="2026-07-16 01:24:44.401274712 +0000 UTC m=+2426.324098578"
Jul 16 01:24:53.608156 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:53.608120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:53.610668 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:53.608172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:53.620595 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:53.620574    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:24:54.453469 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:24:54.453439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:25:12.197836 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.197773    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"]
Jul 16 01:25:12.203328 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.202294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.205469 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.205444    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"rate-test-model-908f0c-kserve-self-signed-certs\""
Jul 16 01:25:12.206048 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.206026    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"kube-root-ca.crt\""
Jul 16 01:25:12.206151 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.206133    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"openshift-service-ca.crt\""
Jul 16 01:25:12.206265 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.206241    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-908f0c\"/\"default-dockercfg-vnn7l\""
Jul 16 01:25:12.213881 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.213858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"]
Jul 16 01:25:12.235031 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.235002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-tmp-dir\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.235224 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.235051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-dshm\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.235224 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.235136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-home\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.235317 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.235237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0c39485-11c9-4bf8-9556-37c460181b93-tls-certs\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.235317 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.235276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-model-cache\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.235317 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.235308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xqzz\" (UniqueName: \"kubernetes.io/projected/f0c39485-11c9-4bf8-9556-37c460181b93-kube-api-access-7xqzz\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336217 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0c39485-11c9-4bf8-9556-37c460181b93-tls-certs\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-model-cache\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xqzz\" (UniqueName: \"kubernetes.io/projected/f0c39485-11c9-4bf8-9556-37c460181b93-kube-api-access-7xqzz\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-tmp-dir\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-dshm\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336419 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-home\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336739 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-model-cache\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336814 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-tmp-dir\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.336877 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.336828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-home\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.338636 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.338615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-dshm\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.339048 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.339026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0c39485-11c9-4bf8-9556-37c460181b93-tls-certs\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.343918 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.343893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xqzz\" (UniqueName: \"kubernetes.io/projected/f0c39485-11c9-4bf8-9556-37c460181b93-kube-api-access-7xqzz\") pod \"rate-test-model-908f0c-kserve-557764b667-88pxn\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") " pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.516713 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.516679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:12.656673 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:12.656651    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"]
Jul 16 01:25:12.658742 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:25:12.658710    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0c39485_11c9_4bf8_9556_37c460181b93.slice/crio-1e1da1a11c243b78a7672fc1ee815e6cb1209ddf3ce42e3c950a8d69f73256b4 WatchSource:0}: Error finding container 1e1da1a11c243b78a7672fc1ee815e6cb1209ddf3ce42e3c950a8d69f73256b4: Status 404 returned error can't find the container with id 1e1da1a11c243b78a7672fc1ee815e6cb1209ddf3ce42e3c950a8d69f73256b4
Jul 16 01:25:13.551780 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:13.551747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn" event={"ID":"f0c39485-11c9-4bf8-9556-37c460181b93","Type":"ContainerStarted","Data":"bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9"}
Jul 16 01:25:13.551780 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:13.551787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn" event={"ID":"f0c39485-11c9-4bf8-9556-37c460181b93","Type":"ContainerStarted","Data":"1e1da1a11c243b78a7672fc1ee815e6cb1209ddf3ce42e3c950a8d69f73256b4"}
Jul 16 01:25:13.570920 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:13.570875    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn" podStartSLOduration=1.5708605580000001 podStartE2EDuration="1.570860558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:25:13.567740764 +0000 UTC m=+2455.490564630" watchObservedRunningTime="2026-07-16 01:25:13.570860558 +0000 UTC m=+2455.493684424"
Jul 16 01:25:22.517468 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:22.517429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:22.517468 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:22.517471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:22.530276 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:22.530250    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:22.624585 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:22.624559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:25:58.961225 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:58.961193    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"]
Jul 16 01:25:59.909830 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:25:59.909785    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"]
Jul 16 01:26:13.981041 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:13.981001    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn" podUID="76b99a9e-9695-4e50-bf9e-f75776ae8c7a" containerName="main" containerID="cri-o://ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60" gracePeriod=45
Jul 16 01:26:14.247414 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.247390    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:26:14.345059 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345021    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-home\") pod \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") "
Jul 16 01:26:14.345249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-model-cache\") pod \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") "
Jul 16 01:26:14.345249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tls-certs\") pod \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") "
Jul 16 01:26:14.345249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nllg4\" (UniqueName: \"kubernetes.io/projected/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-kube-api-access-nllg4\") pod \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") "
Jul 16 01:26:14.345249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-dshm\") pod \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") "
Jul 16 01:26:14.345487 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345264    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tmp-dir\") pod \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\" (UID: \"76b99a9e-9695-4e50-bf9e-f75776ae8c7a\") "
Jul 16 01:26:14.345487 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345323    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-home" (OuterVolumeSpecName: "home") pod "76b99a9e-9695-4e50-bf9e-f75776ae8c7a" (UID: "76b99a9e-9695-4e50-bf9e-f75776ae8c7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:14.345487 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "76b99a9e-9695-4e50-bf9e-f75776ae8c7a" (UID: "76b99a9e-9695-4e50-bf9e-f75776ae8c7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:14.345656 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345568    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:14.345656 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76b99a9e-9695-4e50-bf9e-f75776ae8c7a" (UID: "76b99a9e-9695-4e50-bf9e-f75776ae8c7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:14.345656 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.345588    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:14.347327 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.347307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-dshm" (OuterVolumeSpecName: "dshm") pod "76b99a9e-9695-4e50-bf9e-f75776ae8c7a" (UID: "76b99a9e-9695-4e50-bf9e-f75776ae8c7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:14.347479 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.347457    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76b99a9e-9695-4e50-bf9e-f75776ae8c7a" (UID: "76b99a9e-9695-4e50-bf9e-f75776ae8c7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:26:14.347535 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.347473    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-kube-api-access-nllg4" (OuterVolumeSpecName: "kube-api-access-nllg4") pod "76b99a9e-9695-4e50-bf9e-f75776ae8c7a" (UID: "76b99a9e-9695-4e50-bf9e-f75776ae8c7a"). InnerVolumeSpecName "kube-api-access-nllg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:14.446774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.446747    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:14.446774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.446772    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nllg4\" (UniqueName: \"kubernetes.io/projected/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-kube-api-access-nllg4\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:14.446967 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.446784    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:14.446967 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.446811    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76b99a9e-9695-4e50-bf9e-f75776ae8c7a-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:14.918508 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.918423    2578 generic.go:356] "Generic (PLEG): container finished" podID="76b99a9e-9695-4e50-bf9e-f75776ae8c7a" containerID="ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60" exitCode=0
Jul 16 01:26:14.918508 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.918481    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"
Jul 16 01:26:14.918740 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.918515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn" event={"ID":"76b99a9e-9695-4e50-bf9e-f75776ae8c7a","Type":"ContainerDied","Data":"ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60"}
Jul 16 01:26:14.918740 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.918567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn" event={"ID":"76b99a9e-9695-4e50-bf9e-f75776ae8c7a","Type":"ContainerDied","Data":"17ed2d7c462593bf579fcad27e749357e7eaa2aab185dd9e604e4f9c5328b241"}
Jul 16 01:26:14.918740 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.918590    2578 scope.go:117] "RemoveContainer" containerID="ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60"
Jul 16 01:26:14.929504 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.929272    2578 scope.go:117] "RemoveContainer" containerID="ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60"
Jul 16 01:26:14.929829 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:14.929719    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60\": container with ID starting with ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60 not found: ID does not exist" containerID="ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60"
Jul 16 01:26:14.929829 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.929764    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60"} err="failed to get container status \"ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60\": rpc error: code = NotFound desc = could not find container \"ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60\": container with ID starting with ee7495b1552ab115146d5afcb326161a7b8c54464a5236e031a989f6ccd42d60 not found: ID does not exist"
Jul 16 01:26:14.935032 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.931063    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn" podUID="f0c39485-11c9-4bf8-9556-37c460181b93" containerName="main" containerID="cri-o://bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9" gracePeriod=45
Jul 16 01:26:14.940489 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.940454    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"]
Jul 16 01:26:14.943120 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:14.943096    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44361b/rate-test-model-44361b-kserve-5985c9848c-xx2mn"]
Jul 16 01:26:15.201035 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.201011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:26:15.355411 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-home\") pod \"f0c39485-11c9-4bf8-9556-37c460181b93\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") "
Jul 16 01:26:15.355618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355429    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xqzz\" (UniqueName: \"kubernetes.io/projected/f0c39485-11c9-4bf8-9556-37c460181b93-kube-api-access-7xqzz\") pod \"f0c39485-11c9-4bf8-9556-37c460181b93\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") "
Jul 16 01:26:15.355618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-tmp-dir\") pod \"f0c39485-11c9-4bf8-9556-37c460181b93\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") "
Jul 16 01:26:15.355618 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355597    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-dshm\") pod \"f0c39485-11c9-4bf8-9556-37c460181b93\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") "
Jul 16 01:26:15.355821 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0c39485-11c9-4bf8-9556-37c460181b93-tls-certs\") pod \"f0c39485-11c9-4bf8-9556-37c460181b93\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") "
Jul 16 01:26:15.355821 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-home" (OuterVolumeSpecName: "home") pod "f0c39485-11c9-4bf8-9556-37c460181b93" (UID: "f0c39485-11c9-4bf8-9556-37c460181b93"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:15.355821 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355692    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-model-cache\") pod \"f0c39485-11c9-4bf8-9556-37c460181b93\" (UID: \"f0c39485-11c9-4bf8-9556-37c460181b93\") "
Jul 16 01:26:15.355821 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0c39485-11c9-4bf8-9556-37c460181b93" (UID: "f0c39485-11c9-4bf8-9556-37c460181b93"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:15.356052 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.355988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0c39485-11c9-4bf8-9556-37c460181b93" (UID: "f0c39485-11c9-4bf8-9556-37c460181b93"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:15.356108 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.356080    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-model-cache\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:15.356108 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.356093    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-home\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:15.356108 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.356102    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-tmp-dir\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:15.357697 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.357670    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-dshm" (OuterVolumeSpecName: "dshm") pod "f0c39485-11c9-4bf8-9556-37c460181b93" (UID: "f0c39485-11c9-4bf8-9556-37c460181b93"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:15.357839 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.357716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c39485-11c9-4bf8-9556-37c460181b93-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0c39485-11c9-4bf8-9556-37c460181b93" (UID: "f0c39485-11c9-4bf8-9556-37c460181b93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 01:26:15.357839 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.357764    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c39485-11c9-4bf8-9556-37c460181b93-kube-api-access-7xqzz" (OuterVolumeSpecName: "kube-api-access-7xqzz") pod "f0c39485-11c9-4bf8-9556-37c460181b93" (UID: "f0c39485-11c9-4bf8-9556-37c460181b93"). InnerVolumeSpecName "kube-api-access-7xqzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:15.457183 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.457103    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0c39485-11c9-4bf8-9556-37c460181b93-dshm\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:15.457183 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.457129    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0c39485-11c9-4bf8-9556-37c460181b93-tls-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:15.457183 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.457139    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xqzz\" (UniqueName: \"kubernetes.io/projected/f0c39485-11c9-4bf8-9556-37c460181b93-kube-api-access-7xqzz\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:15.925220 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.925189    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0c39485-11c9-4bf8-9556-37c460181b93" containerID="bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9" exitCode=0
Jul 16 01:26:15.925415 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.925231    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"
Jul 16 01:26:15.925415 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.925273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn" event={"ID":"f0c39485-11c9-4bf8-9556-37c460181b93","Type":"ContainerDied","Data":"bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9"}
Jul 16 01:26:15.925415 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.925316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn" event={"ID":"f0c39485-11c9-4bf8-9556-37c460181b93","Type":"ContainerDied","Data":"1e1da1a11c243b78a7672fc1ee815e6cb1209ddf3ce42e3c950a8d69f73256b4"}
Jul 16 01:26:15.925415 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.925332    2578 scope.go:117] "RemoveContainer" containerID="bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9"
Jul 16 01:26:15.936218 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.936201    2578 scope.go:117] "RemoveContainer" containerID="bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9"
Jul 16 01:26:15.936475 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:15.936451    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9\": container with ID starting with bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9 not found: ID does not exist" containerID="bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9"
Jul 16 01:26:15.936578 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.936480    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9"} err="failed to get container status \"bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9\": rpc error: code = NotFound desc = could not find container \"bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9\": container with ID starting with bc478b0c0c662e5608dc2b2e6ca04864177a3024955adc23d3ca3c87b8cbfce9 not found: ID does not exist"
Jul 16 01:26:15.948034 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.948011    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"]
Jul 16 01:26:15.950201 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:15.950183    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-908f0c/rate-test-model-908f0c-kserve-557764b667-88pxn"]
Jul 16 01:26:16.502206 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502174    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7348-139786016801104"]
Jul 16 01:26:16.502589 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502565    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b99a9e-9695-4e50-bf9e-f75776ae8c7a" containerName="main"
Jul 16 01:26:16.502589 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502576    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b99a9e-9695-4e50-bf9e-f75776ae8c7a" containerName="main"
Jul 16 01:26:16.502589 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502589    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c39485-11c9-4bf8-9556-37c460181b93" containerName="main"
Jul 16 01:26:16.502696 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502595    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c39485-11c9-4bf8-9556-37c460181b93" containerName="main"
Jul 16 01:26:16.502696 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502660    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b99a9e-9695-4e50-bf9e-f75776ae8c7a" containerName="main"
Jul 16 01:26:16.502696 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.502670    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c39485-11c9-4bf8-9556-37c460181b93" containerName="main"
Jul 16 01:26:16.507191 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.507171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:16.510565 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.510548    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wtk8p\""
Jul 16 01:26:16.519090 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.519064    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"]
Jul 16 01:26:16.633130 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.633098    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b99a9e-9695-4e50-bf9e-f75776ae8c7a" path="/var/lib/kubelet/pods/76b99a9e-9695-4e50-bf9e-f75776ae8c7a/volumes"
Jul 16 01:26:16.633506 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.633493    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c39485-11c9-4bf8-9556-37c460181b93" path="/var/lib/kubelet/pods/f0c39485-11c9-4bf8-9556-37c460181b93/volumes"
Jul 16 01:26:16.670103 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.670081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjj4\" (UniqueName: \"kubernetes.io/projected/bb29375f-3139-4222-9828-b4c17aeef4be-kube-api-access-cmjj4\") pod \"test-curl-7348-139786016801104\" (UID: \"bb29375f-3139-4222-9828-b4c17aeef4be\") " pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:16.771537 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.771508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjj4\" (UniqueName: \"kubernetes.io/projected/bb29375f-3139-4222-9828-b4c17aeef4be-kube-api-access-cmjj4\") pod \"test-curl-7348-139786016801104\" (UID: \"bb29375f-3139-4222-9828-b4c17aeef4be\") " pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:16.782499 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.782471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjj4\" (UniqueName: \"kubernetes.io/projected/bb29375f-3139-4222-9828-b4c17aeef4be-kube-api-access-cmjj4\") pod \"test-curl-7348-139786016801104\" (UID: \"bb29375f-3139-4222-9828-b4c17aeef4be\") " pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:16.816105 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.816078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:16.969822 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.969772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"]
Jul 16 01:26:16.973297 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:26:16.973259    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb29375f_3139_4222_9828_b4c17aeef4be.slice/crio-e40700009e16282fc0a65b4befce1da1368da27506c1215fbcb349bd5cad316b WatchSource:0}: Error finding container e40700009e16282fc0a65b4befce1da1368da27506c1215fbcb349bd5cad316b: Status 404 returned error can't find the container with id e40700009e16282fc0a65b4befce1da1368da27506c1215fbcb349bd5cad316b
Jul 16 01:26:16.974697 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:16.974674    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 01:26:17.942919 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:17.942831    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb29375f-3139-4222-9828-b4c17aeef4be" containerID="ec758f5da86538fdedad27cc76ab758a9b9150b5cb8d1a241b7fe73aefcc44bf" exitCode=0
Jul 16 01:26:17.943249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:17.942925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016801104" event={"ID":"bb29375f-3139-4222-9828-b4c17aeef4be","Type":"ContainerDied","Data":"ec758f5da86538fdedad27cc76ab758a9b9150b5cb8d1a241b7fe73aefcc44bf"}
Jul 16 01:26:17.943249 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:17.942971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016801104" event={"ID":"bb29375f-3139-4222-9828-b4c17aeef4be","Type":"ContainerStarted","Data":"e40700009e16282fc0a65b4befce1da1368da27506c1215fbcb349bd5cad316b"}
Jul 16 01:26:19.086594 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.086570    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:19.124218 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.124194    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7348-139786016801104_bb29375f-3139-4222-9828-b4c17aeef4be/test-curl-7348-139786016801104/0.log"
Jul 16 01:26:19.149912 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.149838    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"]
Jul 16 01:26:19.154144 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.154122    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"]
Jul 16 01:26:19.195525 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.195505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmjj4\" (UniqueName: \"kubernetes.io/projected/bb29375f-3139-4222-9828-b4c17aeef4be-kube-api-access-cmjj4\") pod \"bb29375f-3139-4222-9828-b4c17aeef4be\" (UID: \"bb29375f-3139-4222-9828-b4c17aeef4be\") "
Jul 16 01:26:19.197687 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.197660    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb29375f-3139-4222-9828-b4c17aeef4be-kube-api-access-cmjj4" (OuterVolumeSpecName: "kube-api-access-cmjj4") pod "bb29375f-3139-4222-9828-b4c17aeef4be" (UID: "bb29375f-3139-4222-9828-b4c17aeef4be"). InnerVolumeSpecName "kube-api-access-cmjj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:19.296407 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.296374    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmjj4\" (UniqueName: \"kubernetes.io/projected/bb29375f-3139-4222-9828-b4c17aeef4be-kube-api-access-cmjj4\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:19.955113 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.955088    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:19.955284 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:19.955142    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e40700009e16282fc0a65b4befce1da1368da27506c1215fbcb349bd5cad316b"
Jul 16 01:26:19.966364 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:19.966336    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7348-139786016801104\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="bb29375f-3139-4222-9828-b4c17aeef4be" pod="opendatahub/test-curl-7348-139786016801104"
Jul 16 01:26:20.631993 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:20.631957    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb29375f-3139-4222-9828-b4c17aeef4be" path="/var/lib/kubelet/pods/bb29375f-3139-4222-9828-b4c17aeef4be/volumes"
Jul 16 01:26:26.126182 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:26.126149    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"]
Jul 16 01:26:26.126646 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:26.126442    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy" containerID="cri-o://fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431" gracePeriod=30
Jul 16 01:26:30.381083 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:30.381043    2578 patch_prober.go:28] interesting pod/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 01:26:30.381496 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:30.381116    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 01:26:31.388692 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.388635    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:26:31.404500 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404475    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-socket\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404651 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404511    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-envoy\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404651 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtrt6\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-kube-api-access-rtrt6\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404651 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404602    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-credential-socket\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404651 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-token\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404899 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istiod-ca-cert\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404899 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-podinfo\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404899 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-data\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.404899 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:31.404899 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-certs\") pod \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\" (UID: \"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a\") "
Jul 16 01:26:31.405170 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.404952    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:31.405170 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.405042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:26:31.405289 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.405167    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:31.405289 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.405216    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.405289 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.405235    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.405289 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.405250    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.405761 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.405740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-data" (OuterVolumeSpecName: "istio-data") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:31.407152 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.407125    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-token" (OuterVolumeSpecName: "istio-token") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:31.407258 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.407199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-kube-api-access-rtrt6" (OuterVolumeSpecName: "kube-api-access-rtrt6") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "kube-api-access-rtrt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:31.407443 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.407423    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:31.407491 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.407440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" (UID: "62a32fef-ad8a-4b1d-a19f-1a54b1b2349a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:26:31.506188 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.506153    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtrt6\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-kube-api-access-rtrt6\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.506346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.506206    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.506346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.506221    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.506346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.506231    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.506346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.506243    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:31.506346 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:31.506255    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:32.029686 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.029650    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerID="fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431" exitCode=0
Jul 16 01:26:32.029891 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.029707    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"
Jul 16 01:26:32.029891 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.029716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" event={"ID":"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a","Type":"ContainerDied","Data":"fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431"}
Jul 16 01:26:32.029891 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.029828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4" event={"ID":"62a32fef-ad8a-4b1d-a19f-1a54b1b2349a","Type":"ContainerDied","Data":"863db8318fb3b979c47248bff869e583a72c5805ac9025dde979e3af16ec6a8b"}
Jul 16 01:26:32.029891 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.029861    2578 scope.go:117] "RemoveContainer" containerID="fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431"
Jul 16 01:26:32.039814 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.039769    2578 scope.go:117] "RemoveContainer" containerID="97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"
Jul 16 01:26:32.048563 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.048533    2578 scope.go:117] "RemoveContainer" containerID="fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431"
Jul 16 01:26:32.048779 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:32.048762    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431\": container with ID starting with fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431 not found: ID does not exist" containerID="fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431"
Jul 16 01:26:32.048886 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.048800    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431"} err="failed to get container status \"fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431\": rpc error: code = NotFound desc = could not find container \"fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431\": container with ID starting with fa47ee4c94c43a52be2b0663795fe3ae2be0440ec4a1470287b9b16d6bd67431 not found: ID does not exist"
Jul 16 01:26:32.048886 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.048822    2578 scope.go:117] "RemoveContainer" containerID="97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"
Jul 16 01:26:32.049040 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:32.049026    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee\": container with ID starting with 97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee not found: ID does not exist" containerID="97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"
Jul 16 01:26:32.049081 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.049044    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee"} err="failed to get container status \"97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee\": rpc error: code = NotFound desc = could not find container \"97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee\": container with ID starting with 97685fa582ec5ec5e40aa653a580bc1109064e8622ac1e0e5dc6dd86fd5c75ee not found: ID does not exist"
Jul 16 01:26:32.055880 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.055856    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"]
Jul 16 01:26:32.059583 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.059564    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-44361b-openshift-default-6485bcb99f-vn7c4"]
Jul 16 01:26:32.633062 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:32.633021    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" path="/var/lib/kubelet/pods/62a32fef-ad8a-4b1d-a19f-1a54b1b2349a/volumes"
Jul 16 01:26:33.134698 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:33.134667    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"]
Jul 16 01:26:33.134932 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:33.134905    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy" containerID="cri-o://4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06" gracePeriod=30
Jul 16 01:26:33.808486 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:33.808444    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-764bfb59d9-249k4_239f04cf-9a8b-4b84-9e36-46530fb30436/authorino/0.log"
Jul 16 01:26:38.385001 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.384976    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:26:38.467707 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467626    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-data\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.467707 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467665    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-token\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.467707 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-credential-socket\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467729    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-envoy\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-podinfo\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-socket\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467927    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvl7m\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-kube-api-access-mvl7m\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.467958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-certs\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468036 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istiod-ca-cert\") pod \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\" (UID: \"cf117d26-6d31-4d61-ab7b-d272c1ef5552\") "
Jul 16 01:26:38.468340 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468123    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:38.468340 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468295    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:38.468450 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468343    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.468450 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:38.468588 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 01:26:38.468664 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.468646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:38.470020 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.469996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 01:26:38.470020 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.470012    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:38.470395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.470365    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 01:26:38.470395 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.470371    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-kube-api-access-mvl7m" (OuterVolumeSpecName: "kube-api-access-mvl7m") pod "cf117d26-6d31-4d61-ab7b-d272c1ef5552" (UID: "cf117d26-6d31-4d61-ab7b-d272c1ef5552"). InnerVolumeSpecName "kube-api-access-mvl7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 01:26:38.568749 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568721    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-credential-socket\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568749 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568744    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-envoy\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568749 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568753    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-podinfo\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568974 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568762    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvl7m\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-kube-api-access-mvl7m\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568974 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568770    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-workload-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568974 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568779    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istiod-ca-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568974 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568787    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-data\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:38.568974 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:38.568814    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf117d26-6d31-4d61-ab7b-d272c1ef5552-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\""
Jul 16 01:26:39.076460 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.076429    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerID="4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06" exitCode=0
Jul 16 01:26:39.076631 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.076479    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"
Jul 16 01:26:39.076631 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.076510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" event={"ID":"cf117d26-6d31-4d61-ab7b-d272c1ef5552","Type":"ContainerDied","Data":"4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06"}
Jul 16 01:26:39.076631 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.076575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4" event={"ID":"cf117d26-6d31-4d61-ab7b-d272c1ef5552","Type":"ContainerDied","Data":"13e3a192f37d199865d3ab25918d30dd0ec6a8bd7cf63e6b362866b001cca11d"}
Jul 16 01:26:39.076631 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.076605    2578 scope.go:117] "RemoveContainer" containerID="4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06"
Jul 16 01:26:39.085822 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.085781    2578 scope.go:117] "RemoveContainer" containerID="57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"
Jul 16 01:26:39.094313 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.094293    2578 scope.go:117] "RemoveContainer" containerID="4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06"
Jul 16 01:26:39.094541 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:39.094522    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06\": container with ID starting with 4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06 not found: ID does not exist" containerID="4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06"
Jul 16 01:26:39.094585 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.094549    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06"} err="failed to get container status \"4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06\": rpc error: code = NotFound desc = could not find container \"4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06\": container with ID starting with 4f9ad85e5ff0be1c39f5c0eb6f894cf6db8abf772229ba0be33826b1ae854e06 not found: ID does not exist"
Jul 16 01:26:39.094585 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.094565    2578 scope.go:117] "RemoveContainer" containerID="57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"
Jul 16 01:26:39.094806 ip-10-0-142-236 kubenswrapper[2578]: E0716 01:26:39.094774    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4\": container with ID starting with 57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4 not found: ID does not exist" containerID="57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"
Jul 16 01:26:39.094867 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.094817    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4"} err="failed to get container status \"57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4\": rpc error: code = NotFound desc = could not find container \"57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4\": container with ID starting with 57694931a2f1d349a804aaf0f849ab2360d9a90c31c3a9cc92506240fdaee6e4 not found: ID does not exist"
Jul 16 01:26:39.095756 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.095736    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"]
Jul 16 01:26:39.100290 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.100272    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-908f0c-openshift-default-c9d78576c-d6jt4"]
Jul 16 01:26:39.247447 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.247417    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b69c8_81d0c082-aefd-4d61-a9a0-7ab7735e10a1/manager/0.log"
Jul 16 01:26:39.371956 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.371870    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qg5t6_2bd80188-406c-46c6-953d-c109352a7f89/manager/0.log"
Jul 16 01:26:39.619264 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.619242    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-99vb9_0eb3beb7-19a2-47fe-819e-652a665f0bcc/server/0.log"
Jul 16 01:26:39.747265 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.747234    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-b8t2q_073fe6e6-99fc-4f03-9333-14f46fc17779/manager/0.log"
Jul 16 01:26:39.860768 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.860739    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-9p66h_b693d5d4-5254-493e-a591-fb854d817f02/manager/0.log"
Jul 16 01:26:39.867955 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:39.867935    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-9p66h_b693d5d4-5254-493e-a591-fb854d817f02/copy-manifests/0.log"
Jul 16 01:26:40.632712 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:40.632680    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" path="/var/lib/kubelet/pods/cf117d26-6d31-4d61-ab7b-d272c1ef5552/volumes"
Jul 16 01:26:43.253180 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.253152    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr_95bfceeb-6089-48ba-bcf3-3a0b5544bb78/util/0.log"
Jul 16 01:26:43.261949 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.261920    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr_95bfceeb-6089-48ba-bcf3-3a0b5544bb78/pull/0.log"
Jul 16 01:26:43.267804 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.267761    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr_95bfceeb-6089-48ba-bcf3-3a0b5544bb78/extract/0.log"
Jul 16 01:26:43.377254 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.377228    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk_06d27642-3cff-43b2-a43b-103d3beb266a/util/0.log"
Jul 16 01:26:43.383524 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.383502    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk_06d27642-3cff-43b2-a43b-103d3beb266a/pull/0.log"
Jul 16 01:26:43.389883 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.389861    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk_06d27642-3cff-43b2-a43b-103d3beb266a/extract/0.log"
Jul 16 01:26:43.505131 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.505064    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx_8c62c55d-a7d9-41a0-9a2d-a38b105759d9/util/0.log"
Jul 16 01:26:43.511477 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.511453    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx_8c62c55d-a7d9-41a0-9a2d-a38b105759d9/pull/0.log"
Jul 16 01:26:43.518020 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.518004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx_8c62c55d-a7d9-41a0-9a2d-a38b105759d9/extract/0.log"
Jul 16 01:26:43.638686 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.638661    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf_c04a32ad-35e8-4a7f-9ac5-f1743cf3435b/util/0.log"
Jul 16 01:26:43.645915 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.645896    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf_c04a32ad-35e8-4a7f-9ac5-f1743cf3435b/pull/0.log"
Jul 16 01:26:43.652693 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.652670    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf_c04a32ad-35e8-4a7f-9ac5-f1743cf3435b/extract/0.log"
Jul 16 01:26:43.774502 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.774481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-764bfb59d9-249k4_239f04cf-9a8b-4b84-9e36-46530fb30436/authorino/0.log"
Jul 16 01:26:43.891626 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:43.891603    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lchhm_93994bb8-008a-4580-a66f-832a03dc8e64/manager/0.log"
Jul 16 01:26:44.259943 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:44.259863    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4pfcz_06164899-ad61-4e71-be10-3013dfd49e2a/registry-server/0.log"
Jul 16 01:26:44.384308 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:44.384279    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ct5rx_8ec4eaa1-c90d-471a-8593-a996a1c46225/manager/0.log"
Jul 16 01:26:44.613991 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:44.613962    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8djdv_152cd166-ac1a-4a7e-b4b5-52d781fedb48/manager/0.log"
Jul 16 01:26:44.971382 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:44.971299    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4m42gd_96f3e6d8-71c0-4020-bd11-4e53272a9028/istio-proxy/0.log"
Jul 16 01:26:45.213474 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:45.213447    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-csscl_0b16e72f-e958-4a4c-963b-c3457f9a8c3a/kube-auth-proxy/0.log"
Jul 16 01:26:45.454459 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:45.454431    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/1.log"
Jul 16 01:26:45.809661 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:45.809632    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb5fd56db-fx8qh_2f04b6ee-46d2-4270-bb18-27c09be9b858/router/0.log"
Jul 16 01:26:46.492420 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:46.492386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtdf6l_8b639d2a-64fb-419c-b3ce-4439f594ddd9/main/0.log"
Jul 16 01:26:46.719746 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:46.719719    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-b5mzc_be317fc6-913a-41c2-a75e-d3ff0f598d47/main/0.log"
Jul 16 01:26:52.567807 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.567764    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld8p/must-gather-4lnnh"]
Jul 16 01:26:52.568367 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568348    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568369    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568402    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb29375f-3139-4222-9828-b4c17aeef4be" containerName="test-curl-7348-139786016801104"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568412    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb29375f-3139-4222-9828-b4c17aeef4be" containerName="test-curl-7348-139786016801104"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568438    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568447    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy"
Jul 16 01:26:52.568467 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568454    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568566    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568578    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb29375f-3139-4222-9828-b4c17aeef4be" containerName="test-curl-7348-139786016801104"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568588    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf117d26-6d31-4d61-ab7b-d272c1ef5552" containerName="istio-proxy"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568597    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568607    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568713    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy"
Jul 16 01:26:52.568860 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.568723    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a32fef-ad8a-4b1d-a19f-1a54b1b2349a" containerName="istio-proxy"
Jul 16 01:26:52.573400 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.573379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.575847 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.575811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld8p\"/\"openshift-service-ca.crt\""
Jul 16 01:26:52.575955 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.575846    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld8p\"/\"kube-root-ca.crt\""
Jul 16 01:26:52.576379 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.576364    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bld8p\"/\"default-dockercfg-smqpt\""
Jul 16 01:26:52.581042 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.581023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/must-gather-4lnnh"]
Jul 16 01:26:52.699770 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.699737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qsd6\" (UniqueName: \"kubernetes.io/projected/64273257-c648-4e46-9b05-cffbf41608ea-kube-api-access-7qsd6\") pod \"must-gather-4lnnh\" (UID: \"64273257-c648-4e46-9b05-cffbf41608ea\") " pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.699959 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.699821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/64273257-c648-4e46-9b05-cffbf41608ea-must-gather-output\") pod \"must-gather-4lnnh\" (UID: \"64273257-c648-4e46-9b05-cffbf41608ea\") " pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.801026 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.800992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qsd6\" (UniqueName: \"kubernetes.io/projected/64273257-c648-4e46-9b05-cffbf41608ea-kube-api-access-7qsd6\") pod \"must-gather-4lnnh\" (UID: \"64273257-c648-4e46-9b05-cffbf41608ea\") " pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.801185 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.801056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/64273257-c648-4e46-9b05-cffbf41608ea-must-gather-output\") pod \"must-gather-4lnnh\" (UID: \"64273257-c648-4e46-9b05-cffbf41608ea\") " pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.801377 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.801362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/64273257-c648-4e46-9b05-cffbf41608ea-must-gather-output\") pod \"must-gather-4lnnh\" (UID: \"64273257-c648-4e46-9b05-cffbf41608ea\") " pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.809094 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.809064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qsd6\" (UniqueName: \"kubernetes.io/projected/64273257-c648-4e46-9b05-cffbf41608ea-kube-api-access-7qsd6\") pod \"must-gather-4lnnh\" (UID: \"64273257-c648-4e46-9b05-cffbf41608ea\") " pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:52.883223 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:52.883147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/must-gather-4lnnh"
Jul 16 01:26:53.062701 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:53.062672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/must-gather-4lnnh"]
Jul 16 01:26:53.062884 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:26:53.062759    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64273257_c648_4e46_9b05_cffbf41608ea.slice/crio-0fe4fdb26de1bddc80b50e1a056f750a7cd59b0573344b915a0bfc7e19065c01 WatchSource:0}: Error finding container 0fe4fdb26de1bddc80b50e1a056f750a7cd59b0573344b915a0bfc7e19065c01: Status 404 returned error can't find the container with id 0fe4fdb26de1bddc80b50e1a056f750a7cd59b0573344b915a0bfc7e19065c01
Jul 16 01:26:53.156100 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:53.156028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/must-gather-4lnnh" event={"ID":"64273257-c648-4e46-9b05-cffbf41608ea","Type":"ContainerStarted","Data":"0fe4fdb26de1bddc80b50e1a056f750a7cd59b0573344b915a0bfc7e19065c01"}
Jul 16 01:26:54.166774 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:54.166730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/must-gather-4lnnh" event={"ID":"64273257-c648-4e46-9b05-cffbf41608ea","Type":"ContainerStarted","Data":"7ed4073e3bf9a5776b4a1ecc5e2d84f6da0278fbe5ae31814e4a797e713fb64c"}
Jul 16 01:26:54.167169 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:54.166809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/must-gather-4lnnh" event={"ID":"64273257-c648-4e46-9b05-cffbf41608ea","Type":"ContainerStarted","Data":"f74adfd4da75e451a10c371f85cd43f33b8b34f4c8a54adb4c96f05460cd44f7"}
Jul 16 01:26:54.186625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:54.186562    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld8p/must-gather-4lnnh" podStartSLOduration=1.299828852 podStartE2EDuration="2.186540483s" totalImagesPullingTime="886.711631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:26:54.183057151 +0000 UTC m=+2556.105881020" watchObservedRunningTime="2026-07-16 01:26:54.186540483 +0000 UTC m=+2556.109364351"
Jul 16 01:26:55.509957 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:55.509921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6t24c_22844470-6776-4ac9-8bbb-647de271bf46/global-pull-secret-syncer/0.log"
Jul 16 01:26:55.677311 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:55.677261    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lxhrt_5264f69b-0ae5-416e-a2ac-ed5e067e84b7/konnectivity-agent/0.log"
Jul 16 01:26:55.787579 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:26:55.787547    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-236.ec2.internal_6d92aa44007fbeeba58b77b0f3aaedc2/haproxy/0.log"
Jul 16 01:27:00.302991 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.302958    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr_95bfceeb-6089-48ba-bcf3-3a0b5544bb78/extract/0.log"
Jul 16 01:27:00.328015 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.327985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr_95bfceeb-6089-48ba-bcf3-3a0b5544bb78/util/0.log"
Jul 16 01:27:00.349719 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.349691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j4wxr_95bfceeb-6089-48ba-bcf3-3a0b5544bb78/pull/0.log"
Jul 16 01:27:00.375853 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.375820    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk_06d27642-3cff-43b2-a43b-103d3beb266a/extract/0.log"
Jul 16 01:27:00.400616 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.400585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk_06d27642-3cff-43b2-a43b-103d3beb266a/util/0.log"
Jul 16 01:27:00.425554 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.425525    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lq2xk_06d27642-3cff-43b2-a43b-103d3beb266a/pull/0.log"
Jul 16 01:27:00.458709 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.458606    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx_8c62c55d-a7d9-41a0-9a2d-a38b105759d9/extract/0.log"
Jul 16 01:27:00.483293 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.483195    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx_8c62c55d-a7d9-41a0-9a2d-a38b105759d9/util/0.log"
Jul 16 01:27:00.511128 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.511097    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltdnx_8c62c55d-a7d9-41a0-9a2d-a38b105759d9/pull/0.log"
Jul 16 01:27:00.542300 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.542267    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf_c04a32ad-35e8-4a7f-9ac5-f1743cf3435b/extract/0.log"
Jul 16 01:27:00.564502 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.564471    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf_c04a32ad-35e8-4a7f-9ac5-f1743cf3435b/util/0.log"
Jul 16 01:27:00.585016 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:00.584983    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gmsrf_c04a32ad-35e8-4a7f-9ac5-f1743cf3435b/pull/0.log"
Jul 16 01:27:01.144713 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:01.143401    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-764bfb59d9-249k4_239f04cf-9a8b-4b84-9e36-46530fb30436/authorino/0.log"
Jul 16 01:27:01.182980 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:01.182948    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lchhm_93994bb8-008a-4580-a66f-832a03dc8e64/manager/0.log"
Jul 16 01:27:01.310824 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:01.310661    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4pfcz_06164899-ad61-4e71-be10-3013dfd49e2a/registry-server/0.log"
Jul 16 01:27:01.475862 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:01.475466    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ct5rx_8ec4eaa1-c90d-471a-8593-a996a1c46225/manager/0.log"
Jul 16 01:27:01.597389 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:01.597322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8djdv_152cd166-ac1a-4a7e-b4b5-52d781fedb48/manager/0.log"
Jul 16 01:27:03.472155 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.472071    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-w6nhz_a701510d-d625-4177-990e-ba398667d6c5/monitoring-plugin/0.log"
Jul 16 01:27:03.654433 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.654402    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nhcrn_b7bdbd81-6b3a-4d04-acbb-7f70549107fc/node-exporter/0.log"
Jul 16 01:27:03.680187 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.680155    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nhcrn_b7bdbd81-6b3a-4d04-acbb-7f70549107fc/kube-rbac-proxy/0.log"
Jul 16 01:27:03.704322 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.704294    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nhcrn_b7bdbd81-6b3a-4d04-acbb-7f70549107fc/init-textfile/0.log"
Jul 16 01:27:03.736625 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.736533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-k5np6_7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9/kube-rbac-proxy-main/0.log"
Jul 16 01:27:03.757058 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.757029    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-k5np6_7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9/kube-rbac-proxy-self/0.log"
Jul 16 01:27:03.779420 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:03.779386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-k5np6_7d27a0e5-a22f-4ee9-a2c3-bb87673ceda9/openshift-state-metrics/0.log"
Jul 16 01:27:04.007604 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:04.007530    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-mf2rz_024fc01c-ad59-42eb-b9db-b3b639e20e23/prometheus-operator/0.log"
Jul 16 01:27:04.031884 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:04.031854    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-mf2rz_024fc01c-ad59-42eb-b9db-b3b639e20e23/kube-rbac-proxy/0.log"
Jul 16 01:27:05.769910 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.769871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"]
Jul 16 01:27:05.778112 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.778084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:05.781759 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.781730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"]
Jul 16 01:27:05.952449 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.952412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-sys\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:05.952654 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.952630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrwbw\" (UniqueName: \"kubernetes.io/projected/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-kube-api-access-nrwbw\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:05.952911 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.952889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-podres\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:05.953102 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.953085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-proc\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:05.953242 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:05.953227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-lib-modules\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.054856 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.054759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-sys\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.054856 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.054831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrwbw\" (UniqueName: \"kubernetes.io/projected/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-kube-api-access-nrwbw\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.054902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-podres\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.054908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-sys\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.054944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-proc\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.054982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-lib-modules\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055071 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.055015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-podres\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055307 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.055090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-proc\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.055307 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.055128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-lib-modules\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.064025 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.063996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrwbw\" (UniqueName: \"kubernetes.io/projected/ad3eeb22-d5ff-4f63-9fc7-fef334334f79-kube-api-access-nrwbw\") pod \"perf-node-gather-daemonset-cjppk\" (UID: \"ad3eeb22-d5ff-4f63-9fc7-fef334334f79\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.083768 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.083739    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/1.log"
Jul 16 01:27:06.092119 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.092089    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-r77qh_7099ab79-8ce0-4762-bfa5-b3ae3d33d65a/console-operator/2.log"
Jul 16 01:27:06.092713 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.092693    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:06.285889 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.285853    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"]
Jul 16 01:27:06.288353 ip-10-0-142-236 kubenswrapper[2578]: W0716 01:27:06.288323    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podad3eeb22_d5ff_4f63_9fc7_fef334334f79.slice/crio-8d8ada3c0fed0683b20146ea806fb15acf0f289ae2c9b99dced3fde6d398367d WatchSource:0}: Error finding container 8d8ada3c0fed0683b20146ea806fb15acf0f289ae2c9b99dced3fde6d398367d: Status 404 returned error can't find the container with id 8d8ada3c0fed0683b20146ea806fb15acf0f289ae2c9b99dced3fde6d398367d
Jul 16 01:27:06.620124 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:06.620041    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6479b996d7-84bpj_d288563f-17e9-467b-9486-590cba4d0373/console/0.log"
Jul 16 01:27:07.266082 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:07.266055    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-f6ggc_4a39fba5-407e-4844-bc98-3054f8cbea67/volume-data-source-validator/0.log"
Jul 16 01:27:07.285814 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:07.285760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk" event={"ID":"ad3eeb22-d5ff-4f63-9fc7-fef334334f79","Type":"ContainerStarted","Data":"6ad33e7dea15b4e3314f86bf595a6a040aa9f8439c6388c4c145c26336bed91d"}
Jul 16 01:27:07.285982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:07.285826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk" event={"ID":"ad3eeb22-d5ff-4f63-9fc7-fef334334f79","Type":"ContainerStarted","Data":"8d8ada3c0fed0683b20146ea806fb15acf0f289ae2c9b99dced3fde6d398367d"}
Jul 16 01:27:07.285982 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:07.285858    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:07.316129 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:07.316054    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk" podStartSLOduration=2.316033466 podStartE2EDuration="2.316033466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 01:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:27:07.312278421 +0000 UTC m=+2569.235102291" watchObservedRunningTime="2026-07-16 01:27:07.316033466 +0000 UTC m=+2569.238857334"
Jul 16 01:27:08.361374 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:08.361347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8kbnj_0cdc85b9-99ca-4e10-a269-5bdfe9e680ca/dns/0.log"
Jul 16 01:27:08.382284 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:08.382250    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8kbnj_0cdc85b9-99ca-4e10-a269-5bdfe9e680ca/kube-rbac-proxy/0.log"
Jul 16 01:27:08.471956 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:08.471929    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ggd7_bc3b94c1-ffa7-4a33-a4b3-1a58d545c186/dns-node-resolver/0.log"
Jul 16 01:27:09.056836 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:09.056780    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h8jgz_ba6772b7-dafe-4bcc-ac65-8385c85b1644/node-ca/0.log"
Jul 16 01:27:10.044979 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:10.044947    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4m42gd_96f3e6d8-71c0-4020-bd11-4e53272a9028/istio-proxy/0.log"
Jul 16 01:27:10.234109 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:10.234079    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-csscl_0b16e72f-e958-4a4c-963b-c3457f9a8c3a/kube-auth-proxy/0.log"
Jul 16 01:27:10.293977 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:10.293948    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/0.log"
Jul 16 01:27:10.360083 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:10.360000    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/1.log"
Jul 16 01:27:10.471578 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:10.471544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb5fd56db-fx8qh_2f04b6ee-46d2-4270-bb18-27c09be9b858/router/0.log"
Jul 16 01:27:11.143384 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:11.143350    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84whq_ba6fd493-fc4b-4ebd-a7fd-de201f127040/serve-healthcheck-canary/0.log"
Jul 16 01:27:11.692017 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:11.691979    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-kpmvf_bc0805a9-c09a-4ed8-a5ad-6e8775a38e70/insights-operator/0.log"
Jul 16 01:27:11.692413 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:11.692383    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-kpmvf_bc0805a9-c09a-4ed8-a5ad-6e8775a38e70/insights-operator/1.log"
Jul 16 01:27:11.715981 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:11.715951    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4ddvq_ae57c2bb-c9f0-4051-988c-086cf5f33ded/kube-rbac-proxy/0.log"
Jul 16 01:27:11.737704 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:11.737678    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4ddvq_ae57c2bb-c9f0-4051-988c-086cf5f33ded/exporter/0.log"
Jul 16 01:27:11.759665 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:11.759633    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4ddvq_ae57c2bb-c9f0-4051-988c-086cf5f33ded/extractor/0.log"
Jul 16 01:27:13.302217 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:13.302188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-cjppk"
Jul 16 01:27:13.971278 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:13.971228    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b69c8_81d0c082-aefd-4d61-a9a0-7ab7735e10a1/manager/0.log"
Jul 16 01:27:14.201248 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:14.201207    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qg5t6_2bd80188-406c-46c6-953d-c109352a7f89/manager/0.log"
Jul 16 01:27:14.392285 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:14.392235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-99vb9_0eb3beb7-19a2-47fe-819e-652a665f0bcc/server/0.log"
Jul 16 01:27:14.504332 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:14.504295    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-b8t2q_073fe6e6-99fc-4f03-9333-14f46fc17779/manager/0.log"
Jul 16 01:27:14.530392 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:14.530353    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-9p66h_b693d5d4-5254-493e-a591-fb854d817f02/manager/0.log"
Jul 16 01:27:14.551495 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:14.551470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-9p66h_b693d5d4-5254-493e-a591-fb854d817f02/copy-manifests/0.log"
Jul 16 01:27:16.150462 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:16.150427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4m42gd_96f3e6d8-71c0-4020-bd11-4e53272a9028/istio-proxy/0.log"
Jul 16 01:27:16.277976 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:16.277948    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4pdf4_b6bf25a4-3d29-4de6-b389-db2d105ca6b2/openshift-lws-operator/0.log"
Jul 16 01:27:16.318065 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:16.318042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-csscl_0b16e72f-e958-4a4c-963b-c3457f9a8c3a/kube-auth-proxy/0.log"
Jul 16 01:27:16.358280 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:16.357808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/0.log"
Jul 16 01:27:16.417027 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:16.416993    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/1.log"
Jul 16 01:27:16.509937 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:16.509903    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb5fd56db-fx8qh_2f04b6ee-46d2-4270-bb18-27c09be9b858/router/0.log"
Jul 16 01:27:17.729540 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:17.729467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4m42gd_96f3e6d8-71c0-4020-bd11-4e53272a9028/istio-proxy/0.log"
Jul 16 01:27:17.898076 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:17.898051    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-csscl_0b16e72f-e958-4a4c-963b-c3457f9a8c3a/kube-auth-proxy/0.log"
Jul 16 01:27:17.937657 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:17.937617    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/0.log"
Jul 16 01:27:17.998929 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:17.998782    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hzn8_6cb2a4bb-a239-42d8-b964-45f181b12cba/istio-proxy/1.log"
Jul 16 01:27:18.087164 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:18.087137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb5fd56db-fx8qh_2f04b6ee-46d2-4270-bb18-27c09be9b858/router/0.log"
Jul 16 01:27:21.770521 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:21.770486    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-769ss_3dffb8d6-eb00-4f11-ac83-1f46d79cd485/kube-storage-version-migrator-operator/1.log"
Jul 16 01:27:21.772209 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:21.772181    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-769ss_3dffb8d6-eb00-4f11-ac83-1f46d79cd485/kube-storage-version-migrator-operator/0.log"
Jul 16 01:27:22.791078 ip-10-0-142-236 kubenswrapper[2578]: I0716 01:27:22.791049    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-94gvb_49aeb313-0dbc-41b5-a7e4-26ee61c93e9f/kube-multus/0.log"